Week 4 - Identifying good measurement Flashcards

1
Q

List the three main ways to create measurements?

A

Self-report
Observation
Psychological

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Define observation as a measurement tool

A

Recording observable behaviours or traces of behaviours

Observational measure - measuring observable behaviour
Observational study - another word for correlational study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

In self-report studies what are combined results referred to as?
how bout if the results are in the past?

A

Summary score or composite score

Retrospective report

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What do psychological measures include?

what are some pros and cons of this method?

A

Brain activity, hormone levels, heart rate, eye-movement

Pros - less able to mislead, advances in tech make more accessible, provide insight into subtle effects that are harder to see with observations
Cons - time consuming and expensive, some techniques require million of dollars to operate, questionable links

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Define categorical variables?

A

Levels are categories that have no particular order (ex: gender/political party)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Define ordinal scale?

A

Levels of a variable are in ranked order - don’t know how much different each level is from the other (intervals are not equal)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Define an interval scale?

A

Numbers represent equal intervals between levels but there is no true zero (having 0 on something does not mean nothing)
ex: IQ tests - 0 does not mean 0 intelligence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Define a ratio scale?

A

Numbers have equal intervals and a true 0

lol if you can’t count it, its prob ur mom.. jk a ratio scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is inter-rater reliability? how is this related with correlations?

A

Consistency between observers findings
We quantify test-retest reliability with correlations
Two raters should correlate positively with each other

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How does internal reliability involve itself with multi-item self-report measures?

A

In multi-item self report measure, how consistent are participants responses to similar items

Example: Participants who say “I am satisfied with my life” should also agree with “the conditions of my life are excellent”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Define face validity and content validity?

A

Face validity - does it look like a good measure?

Content validity - does the measure assess all aspects of the theorized construct?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Define convergent and discriminant validity?

A

Convergent - does it correlate with similar measurements?

Discriminant - does it show no correlation with measures that are not similar?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Define criterion validity?

A

Criterion validity - Does the measure correlate with key behaviours/real world outcomes?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Describe the process of designing and evaluating a measure?

Hint: 7 steps

A

1 - conceptual and operational definition
2 - face and content validity
3 - internal reliability
4 - test-retest reliability
5 - interrater reliability
6 - convergent and discriminant validity
7 - criterion validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Ordinal, interval and ratio scales are all examples of what kind of variable?
What is its opposite?

A

Quantitative variable - coded with meaningful numbers

Categorical variable - nominal, categories assigned with a number (ex: age, sex)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are the two aspects of construct validity? how are they different?

A

Reliability; how consistent the results of a measure are

Validity; whether the operationalization is measuring what it is supposed to measure

17
Q

What is the use of a scatter plot in testing reliability?

A

Can show Interrater Agreement or Disagreement (btwn two coders)
Show agreement btwn two administrations of the same measurement (test-retest reliability)

18
Q

What internal math dohickey can u run to test for reliability?

A

Run Cronchachs Alpha to see if measurement scales have internal reliability. Closer to 1.0 the better the reliability, if less than .70 then its internal reliability is poor