Research Methods Flashcards
The Research Cycle
1.Figure out what matters to you (values, context, state of field)
2.Formulate a testable theory (tentative explanation of a phenomenon that usually specifies cause[s] + effect[s])
•Choices governed by social context/funding
The Research Cycle
- Review existing literature for inspiration + prevent duplication, we want to add to knowledge
- Select method(s) appropriate for the problem
- Collect data
The Research Cycle
- Treat subjects ethically to ensure no harm, anonymity, etc.
•aware of risks, respect of privacy - Analyze data
The Research Cycle
- Report results so they can be evaluated, rejected/accepted, applied
Conference, journal, book: we can’t contribute if we keep knowledge a secret – science is a social institution
•rule is attack: everybody else is obliged to systematically find flaws in research
•encourages researchers to do better next time
•add to stock of knowledge + formulate policies
•give others opportunity to criticize
Operationalization
establishing criteria for assigning numerical value or qualitative values to variables
reliable
consistent results
valid
measurement procedure measures what it is supposed to
Causality
measurement of causes and their effects
generalizable
research findings hold in many contexts
Validity, reliability, and generalizability may be explained by drawing an analogy between measuring a variable and firing at a bull’s-eye
case 1, measures far apart (not reliable) + far from bull’s-eye (not valid)
case 2, shots close (reliable) but far from bull’s-eye (not valid)
Validity, reliability, and generalizability may be explained by drawing an analogy between measuring a variable and firing at a bull’s-eye
case 3, shots close to bull’s-eye (valid) + close to each other (reliable).
case 4, use a second target - shots close to each other (reliable) + close to the bull’s-eye (valid) again.
Because measures were valid + reliable in both cases 3 + 4, we conclude that our results are generalizable.
participant observation
observe social setting from outsider’s POV + take part in activities of subjects
•analytically, systematically, from the outside observe
•participation only: not able to observe objectively, lack of outside information
•only by regularly stepping apart do we get the chance to see what subjects are blind to
•only outside: we don’t understand the culture or why, we don’t know what it means
•we have to move back and forth
Participant Observation: Advantages
Promotes understanding meaning of subjects’ actions
Good for exploratory research (theory construction)
•Often engaged in process of theory construction – mechanism for causal theory
Participant Observation: Disadvantages
High potential for reactivity
Bad for theory testing (establishing cause and effect)
Low reliability: subjective – might be different if someone else did it
•Researchers right there – subjects acting in way to please researchers
•Gotta gain confidence + trust – important if subjects are very different from you
experiment
carefully controlled artificial situation that allows researchers to isolate hypothesized cause + measure effect precisely
•Remove some of the problems from observation
Experiments
1 Recruit subjects: need ppl, advertise
2 Randomly assign them: randomization removes bias
3 Experimental group: group exposed to independent variable (hypothesized cause)
3 Control group: group not exposed
Experiments
4 Measure dependent variable in experimental + control
5 Expose experimental group to independent variable
5 Do not expose control group to independent variable
6 Re-measure dependent variable in experimental + control to determine the degree to which it has changed
•if any change there can only be 1 cause
•we have to do this over and over again to ensure both groups are alike
Experiments: Advantages
Very high reliability
Very good for theory testing (establishing cause and effect)
•Measure things precisely consistently
Experiments: Disadvantages
Do not promote understanding of motives + culture Not useful for exploratory research (theory construction) Low validity (in sociology): not real life setting
Surveys
form containing questions mailed to the respondent + returned to the researcher through the mail system, not very effective
face-to-face interview survey: questions presented by the interviewer during a meeting
Surveys
telephone survey: questions presented by the interviewer over the phone, frequent
•Self select – must be highly motivated, not representative
Surveys
closed-ended question provides respondent with a list of permitted answers
open-ended question allows respondents to answer in their own words.
Sampling
sample is part of a group.
voluntary response sample: group of people who chose themselves in response to a general appeal – not scientific
Sampling
convenience sample: ppl easiest to reach – results not reliable, don’t like this
representative sample: group chosen randomly so characteristics closely match those of the population of interest