Chapter 2: Reading and Evaluating Scientific Research Flashcards
what is an objective measurement?
- measure of an entity/behaviour that, within an allowed margin of error is consistent across instruments and observers
- Whenever we measure something, it needs to be independent of who is doing the measure
- Ex. weight on a scale - shouldn’t matter where or who is weighing you, the weight should stay the same
what is a variable?
- object, concept, event being measured
- ex. Behavioural measures, Magnetic resonance imaging (MRI), blood/saliva, Self-reporting
what is an operational definition?
- statements that describe the procedures (or operations) and/or specific measures that are used to record observations
- Ex. variable: intoxication - blood alc lvl or Behavioural measure
what is reliability?
when a measure provides consistent and stable answers across multiple observations and points in time
what is test-retest reliability?
give same test to same person and they get the same score
what is alternate-forms reliability?
after taking a test, the next time you take it you may be biased/compromised. If assessing the same underlying knowledge, you should get the same score each time
what is inter-rater reliability?
multiple observers of a behaviour should all come to the same conclusion about that behaviour
what is validity?
degree to which an instrument or procedure actually measures what it claims to measure
what is generalizability?
- degree to which one set of results can be applied to other situations, individuals, or events
- ex. Study large groups of ppl - larger the group of people, the more representative results are and the more confident we can generalize a population
- sample to population
what is a random sample?
every individual of a pop has equal chance of being included
what is a convenience sample?
samples of individuals who are the most readily available
how does location affect generalizability?
- Lab vs. naturalistic research
- In labs, you have control over many factors
- ecological validity affects it
how does sample size affect generalizability?
if you have a large sample, the better you can assume the results are the same for the general population
what is ecological validity?
- degree to which results of a lab study can be applied to or repeated in the natural environment
- Can’t control other peoples behaviours not in the study when doing naturalistic research
what is research bias?
when researchers made themselves too noticeable to the subject
what is subject bias?
when subjects behave in a way they should be bc they’re being observed by researchers
what is the hawthorne effect/study?
- describes idea that behaviour can change if you know you’re being observed
- Comes from a study @ electric factory where they wanted to see how to improve productivity by changing different factors of the environment
- Change in lighting = increase in productivity, Number and duration of breaks also increased productivity
- This info wasn’t useful though - they were being observed all the time so as a result they worked harder
what are demand characteristics?
unintentional clues left in experimental design participants can use to figure out what the experiment is about so they should behave in a certain way
what is the clever hans effect/study?
- claimed this horse could do any kind of math
- Investigator isolated hans and questioner from any spectators, separated him from owner to ask questions, put blinders on hans’ eyes, varied whether the questioner knew the answer to the question in advance
- Hans started to get questions wrong when he couldn’t see the person and when the questioner didn’t know the answer
what is social desirability responding?
- research participants respond in ways that increase chances they’ll be viewed favourable
- Can minimize through assurances of anonymous/confidential questioning
- May feel like they’ll be judged
what is the observer expectancy effect?
- when researcher’s expectations can influence subject’s behavior
- Ex. teacher favoritism - may have more expectations for other students that can cause them to excel more
what is a placebo effect?
measurable and experienced improvement in health or behavior that can’t be attributed to a medication or treatment
what are techniques that reduce bias?
- anonymity
- confidentiality
- inform participants
- single-blind study
- double-blind study
what is anonymity?
when all responses recorded w/o any name or other personal info that could link a particular individual to specific results
what is confidentiality?
when only the researchers have access to data
what does it mean to “inform participants”?
telling participants how their data is going to be used reduces participant anxiety and social desirability bias
what are single-blind studies?
participants don’t know the true purpose of the study, or don’t know which type of treatment they’re receiving