Research Method Requirements

This Course's Research Project

For this course you will be examining human communication behavior in and around new media the internet. This means how people behave and interact in and around technology.

Method Selection

For this project you must use the three (3) methods from the methods covered in this course. At least one method must quantitative/qualitative. One method (data gathering) must conducted primarily online. For example, conducting a survey via Qualtrics, SurveyMonkey, or Facebook, using Skype for your interviews, or collect data via the internet on organizations. Here are the methods for the course. See the individual workshop pages for details:

A good strategy is start with focus groups and use the data to create a survey and write your interview questions (pilot them), then run your surveys (Since they are automated bit may take some time) while you conduct your interviews.

Working in Teams

Working in self-selected teams (3 people max) does not increase the amount of writing or sources or methods you need to perform. However, it does increase the amount of data you must collect and process. The amount of data required for each method below is for a single researcher. For each addition team member in your team you will need to double the data required. For example, if one of your methods was doing multiple interviews you would need to and you have a two person team you would need 4-5 interview EACH (so 8-10 total) and for a three person team 12-15. The more data the better the results. Most students who work in pairs or teams state that they were very happy working with others and liked being able to double check they were doing things correctly. Those students who worked solo often state they wish they had worked with at least one other person. Teams turn in one assignment and get the same grade. Team submitted assignments should be in the first person plural (we not I); should not have sections arranged or labeled by who did what; and should read smoothly in one "voice." DO NOT have each member complete specific sections and then just stitch them together Frankenstein-style. Always have one person due a final edit for flow and consistency.

TO BE CLEAR: Create a contract or at least an explicit agreement about expectations:

What is the desired outcome - the top paper? survival? Be honest and clear.
How work is distributed (who does what?)
Team deadlines (not assignment deadlines - when do teammates need to have their work ready to submit to the team?

Pick one team facilitator to make sure deadlines get met and work is coordinated. You do not need a "leader" but you do need someone driving.

Assign one person to do the final pass on each submission. So, to make sure that all technical requirements are met, APA is correct and consistent, and all needed elements are included.

Assign one person to do a final editing pass. These assignments can't be "Frankensteined" together at the last minute with parts contributed by each member. This needs to read consistently and smoothly in a single voice. All references should be we since there is not "I" in team.

IMPORTANT!

It is better to leave a team than suffer in a team where you are not a good fit. Since teams are both optional and who you work with voluntary, the instructor will not referee disputes or conflicts or otherwise get involved in how your team works (or doesn't work).

If you find you wish to leave a team after an assignment has been submitted, your team will keep the assignment grade but will submit different assignments in the future. You may change topics or keep the same topic and use previously submitted work as its basis. If you are leaving a team contact the instructor to work out the details.

A Note on Dealing with People

Getting cooperation for participants in research studies can be incredibly challenging. This includes using teammates or co-workers, close friends, or even relatives. Moreover, even if you do get a pledge of cooperation, people still may flake on you - expect it. Here are some tips on gaining cooperation.

Provide an incentive. The simplest inducement or incentive can create a degree of reciprocity and gain you cooperation. Offer to provide simple beverages or snacks for interviewees or focus groups (note: any "adult" beverages should be withheld until AFTER you are done), a raffle for survey participants may also help.
Do not try and schedule participants during times they may be otherwise occupied such as breaks. midterms, or finals.
Design your study to use people you know and have access to, so researching student behavior is always a safe bet.
Use people with an built in incentive to help you.
Ask for cooperation, warn them, and remind them of their obligations.
Choose people who have an interest in your topic.

Piloting

Every method should be piloted (tested) PRIOR to using it to collect data. This may seem like a waste of time, but it really saves 10 time as much stress and time later on and you will get better data. Students never complain about piloting after the fact, on the contrary, they are either thankful the piloted or wish they would have done more piloting!

Pilots should NOT be conducted using teammates, but a good strategy is to "trade" piloting with peers. Have people fill out complete surveys and then ask them about it. Where questions and answers clear? Conduct and record full length interviews. Note if interviewees had to ask for clarification. Were some questions or probes a waste of time or did not yield good data? You should conduct a full focus group pilot and run your planned activity. Better to to epic fail here then with real participants. Use housemates, frat/sorority peers, or other groups. Riding herd on a bunch a people and keeping them focused is something that takes practice.

Data Collection Method Guidelines

Good research requires enough data to provide meaningful results. Depending on your research, here are what I consider the minimum amounts of data you need to collect for each method. No matter what you choose, you must have a solid rationale for why you chose to analyze what you did. PLEASE do not hesitate to have me look over any interview questions or surveys. I have included some general advice as well.

All choices for methods and choosing participants must have a solid rationale. That is, a detailed explanation for why that choice was made.

Interviewing (qualitative)

Interviewing can be complex, but it is also a great way to get at the motivations for people's media use preferences or perceptions of media. If you plan to use interviewing, first go to the Interviewing Workshop page and take the interviewing tutorial to find out the tricks and tips to make this method work for you. Please note that an interview schedule is not when you did your interview, but the list of questions that you have created to ask.

Citing your interview: interviews are data and do not need to be and should be cited like sources. Simply reference the interviewee inline when quoting or paraphrasing (eg. "Interviewee #3 stated that..." or "Roxanne explained...").

Poorly conducted interviews are painful and waste of time.

Minimum Requirements

Multiple Short Interviews: You can get good comparative data by interviewed 4-5 people with interview schedules with a MINIMUM of 10 questions with 2 follow-up/probes each.
For each additions team member, double the number of interviewees. So for two people you need 8-10, and three 12-16.
All interviews should be sound recorded unless interviewees specifically decline to be recorded. Using Garage Band or phone apps that record voice are good strategies. You DO NOT need to transcribe interviews to submit recordings

Here are some additional resources on recording interviews:

http://www.therenegadewriter.com/2014/01/15/the-ultimate-freelance-writers-guide-to-recording-interviews/

http://commons.trincoll.edu/jackdougherty/how-to/record-and-transcribe/

All interviewees should sign a consent form - Interviewee_ConsentForm_151i.doc Download Interviewee_ConsentForm_151i.doc- you must submit a consent form with your final assignment if you chose to interview people. Consent forms MUST be readable, converted to pdf, and merged into one document. Note that there is a free app for both Android and iPhone that converts photos to pdfs!

Things to watch out for >

The main problems with interviews is scheduling and flaking. Interviews need to be schedule with large margins for errors and students should always have at least one back-up interviewee. The main problems for student researchers is that they fail to adequately code their interviews and neglect to quote their interviewees in the discussion. Also, failure to have enough questions and required follow-ups. Finally, resist scheduling the minimum number of interviews required as you may come up short.

Surveys (quantitative)

Surveys can be a good way to gather more extensive, if more superficial, data. Qualtrics, Facebook, Survey Monkey, and other online resources can get you access to a wider variety of people. A copy of the survey form should be included in your final submission. Here are some suggestions to guide you.

Keep it short. The willingness of people to fill out and return a survey drops off quickly as the length increases. I suggest 8 questions and definitely no more than 10.
Keep it simple. The more complex the question the more likely people will be unwilling to participate. Always test your survey on classmates or friends first.
Get used to disappointment. People you know are more likely to complete surveys for you, but in any event, if you get over 50% responding you are doing VERY well. If you use Facebook to contact participants, list it as an Event. This will reduce you message as being seen as spam and will keep it foregrounded on the page. Send reminders regularly.
Keep in numeric (eg. multiple choice) or use a Likert Scale (look it up). This is your quantitative method.
Surveys are often helpful when paired with interviews. Use the survey to ask for interviewee volunteers.

Minimum Requirements

You will need at least 40 completed and usable surveys.
For each additions team member, you should double the surveys required. For example, for 2 team members 80 completed and usable surveys, for 3 team members 100.

Things to watch out for >

Student love surveys going into projects and usually hate them coming out. It seems easy, but is actually a lot of work for often little pay-off. There are two main problems for student researcher using surveys. First, a good survey requires a lot of work upfront to craft good questions that may yield useful data. Often survey results are almost useless. Second, getting cooperation from participants is much more difficult than you would expect and often the quality of responses is very low. It is hard to get people to take the time to provide the information you need/desire.

Focus Groups

Focus groups (basically group interviews for our purposes) can be a great way to expose people to media/objects/situations and get their reactions. Often, groups can encourage discussion and exploration of a topic. However, it can be easy for a few people to dominate focus groups, so a strong moderator, a clear agenda, and formal topics/questions are needed to "focus" participants. Here are some tips to guide you.

Focus Groups must have an agenda, plan, and a list of discussion topics and questions, and the demographic information for each member as well as a rationale for their participation, that need to be submitted with the final project.
Focus groups should always be recorded to capture all comments and discussion.
Focus group members should be identified by number, letter, or assigned name or other code that is linked to their demographic information.
Please avoid having an unfocused group discussion/meeting of friends and put off any alcohol consumption until AFTERWARD.
It is best to have a planned activity where participants review any materials, then answer questions on a provided form. This helps to focus participants, keep people from social loafing ("yeah, what he said"), and provided ready made recorded data.
It is recommended that one team member run the group, while another takes notes and operates any media. Switch off roles for different groups.

Focus Group members should sign this group release form - FocusGroup_ConsentForm_151i.doc Download FocusGroup_ConsentForm_151i.doc- (to be submitted with project). Consent forms MUST be readable, converted to pdf, and merged into one document. Note that there is a free app for both Android and iPhone that converts photos to pdfs!

Minimum Requirements

You will need at least 8-10 people for your focus group and one focus group per team member.

Things to watch out for >

The main problems for this method is "group think" in the sense of social loafing where participants simply agree with others' statements, the tendency to get off-topic and to perform roles for others in the group (especially for the other sex). If you are looking at gender differences or similar phenomena you may wish to consider have two or more smaller focus groups. Other problems for student researchers is that they fail to adequately code their focus group discussion and neglect to quote their participants in the discussion. Finally, if you use friends or others you know well the group can degenerate into casual conversation and it can also be difficult to exert discipline.