Reading and Evaluating Scientific Research Flashcards
Objective Measurements
Are the measure of an entity or behaviour that, within an allowed margin of error, is consistent across instruments and observers
Variable
- Refers to the object, concept, or event being measured
- Behavioural measures
- Magnetic resonance imaging (MRI)
- Blood or saliva
- Self-reporting
Operational Definitions
Statements that describe the procedures (or operations) and/or specific measures that are used to record observations
Reliability
- Is when a measure provides consistent and stable answers across multiple observations and points in time
- Test-retest reliability
- Alternate-forms reliability
- Inter-rater reliability
Validity
Is the degree to which an instrument or produce actually measures what is claims to measure
Generalizability of Results
- Refers to the degree to which one set of results can be applied to other situations, individuals, or events
- Study large groups
- Sample to population
- Critical evaluation of findings
- Beware of cases of over-generalization
- “Mozart effect”
- Study large groups
What are the 2 types of samples?
- Random Sample
- Convenience Sample
Random Sample
Every individual of a population has an equal chance of being included
Convenience Sample
Samples of individuals who are the most readily available
Location of study
Laboratory vs naturalistic research
Ecological validity
The degree to which the results of a laboratory study can be applied to or repeated in the natural environment
Sources of Bias in Research
Researcher Bias vs Subject Bias
Hawthorne Effect
A term used to describe situations in which behaviour changes as a result of being observed
Demand Characteristics
- Inadvertent cues given off by the experimenter or the experimental context that provide information about how participants are expected to behave
- Clever Hans effect
Clever Hans Investigation
- Isolated Hans and questioner from any spectators
- Using people other than his owner to ask the questions
- Tested Hans with blinders
- Varied whether the questioner knew the answer to the question in advance
Social Desirability Responding
- Research participants respond in ways that increase the chances they will be viewed favourably
- Can minimize through assurances of anonymous/confidential questioning
Observer Expectancy Effect
- Researcher’s expectations can influence subject’s behaviour
- Teacher ‘favouritism’
- ‘Bright’ rats vs. ‘dull’ rats
Placebo effect
- A measurable and experienced improvement in health or behaviour that cannot be attributable to a medication or treatment
- “All in their head” or actual physiological response?
- Some evidence of physiological pain relief and changes in brain activation
- Conditioning effects
- Nocebo effect
- “All in their head” or actual physiological response?
What are the techniques that reduce bias?
- Anonymity
- Confidentiality
- Inform Participants
- Single-blind Study
- Double-blind study
Anonymity
Each individual’s responses are recorded without any name or other personal information that could link a particular individual to specific results
Confidentiality
Means the results will only be seen by the researcher
Inform Participants
Reduces participant’s anxiety and social desirability bias
Single-blind Study
The participants do not know the true purpose of the study, or else do not know which type of treatment they are receiving (e.g., placebo or treatment drug)
Double-blind study
A study in which neither the participant nor the experimenter knows the exact treatment for any individual
Sharing the Results
(Academic Journals)
- Peer Review
- Replication