Measurement, reliability + Validity Flashcards

1
Q

Why is it important for psychologist to quantify everything?

A
  • is a defining principle of science = measurement
    • can be objectively obtained
    • publicly available
    • potentially checkable by others
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the requirements for measurements?

A
  • reliable = can be reproduced

- valid = actually measuring what we think it is measuring

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the different levels of measurements?

A
  1. Nominal
  2. Ordinal
  3. Interval
  4. Ratio
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Describe nominal level of measurement

A
  • categorical. frq data
  • when numbers are used as names (eg footballer numbers)
  • All you can do is count how often each number occurs
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Describe ordinal level of measurement

A
  • numbers used as ranks

eg: order of finishing a race

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Describe interval level of measurement

A
  • scale with equal interval between points on a scale
  • no true zero point
    eg: IQ
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Describe ration: level of measurement

A
  • measurements made on a scale with equal interval between points on the scale
  • scale has TRUE 0 point
    Eg: reaction time, error scores
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is reliability?

A
  • does it give consistent/ reproducible results?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Error in reliability may be due to….?

A
  • natural phenomena variation
  • -> within/ between individuals
  • imprecision in defining + measuring psychological constructs
  • -> what exactly is aggression?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are different measures of reliability?

A
  1. Test-retest: time to time
  2. Alternate forms: version to version
  3. Split-half: item to item
  4. Inter-scorer: person to person
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What factors affect reliability?

A
  • phenomena itself
  • -> trait vs state?
  • Precision of measurements
  • Sample size
  • Variability in performance
  • -> High > low
  • Format of test:
  • -> MCQ of 5Q = 25% correct by chance > than ….
  • -> True/ False = 50% correct by chance
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the replication crisis?

A
  • many well-known findings aren’t that reliable
  • -> small sample size
  • -> Exact replication are rare
  • -> “file drawer problem”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the “file drawer problem”?

A
  • hard to get replication failures published
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are some solution to the replication crisis?

A
  • replications
  • Metal-analysis
  • Converging operations = tackling problem with different methods, by different research groups
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the 10 frq cited findings that have failed to replicate as found by Jarrett in 2016?

A
  1. power-posing
  2. Smiling = happier
  3. exposure to age related words = slower walk (x social priming)
  4. Babies are born with the power to imitate adults
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What did Nosek et al in 2015 find when he replicated 100 experimental + correlational studies?

A
  1. og 97% significant results (p<0.5)
  2. replication = 36% significant results
  3. 47% replication significance size similar to og
    = 68% studies w/ statistically significant effects
17
Q

What does validity mean?

A
  • are you measuring what you think you are measuring?

- a measure can be reliable without being valid (since you can replicate it i guess)

18
Q

What link did Paul broca poorly attempt to make?

A
  • anthropometric measurements + intelligence

- eg brain size saying there was a 14% difference between F +M but no regards for age/ body size given

19
Q

What did Gall + Spurzheim which was scientific + testable but had poor vlaidilty?

A
  • different parts of brain responsible for different functions
  • highly developed regions = larger = reflected by bumps on skull
  • craniometry measuring tool
20
Q

What are the different types of validity?

A
  1. Face
    - intuitively looks plausible
  2. Content
    - relevant material covered??
  3. Criterion
    - predictive or concurrent
  4. Construct
    - does performance correlate well with known measures of the phenomena?
  5. Ecological/ external
    - relevance to rl
21
Q

What does the predictive or concurrent criterion mean?

A

p: Does performance on test correlate w/ later performance?
C: does performance on my test correlate w/ other tests of current performance?

22
Q

What factors affect the validity of experiments?

A
  • good or bad experimental design

- method of difference: only one thing needs to differ between comparing conditions

23
Q

What factors affect validity of tests?

A
  • Norms + clear experimental standardisation