Unit 10: Rigour in Research (Reliability + Validity) Flashcards

1
Q

Reliability

A

The consistency and stability of the measuring instrument

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Observed Score

A

True score + Measurement Error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Trait Error

A

From participants

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Method Error

A

From Researchers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Test/Retest

A

Repeat test with same sample and assess consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Alternate Forms

A

2 Equal but different tests

ex. MCAT, LSAT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Inter-Rater Agreement

A

Agreement of observation between two or more researchers
Most Common
# of agreements / # of possible agreements

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Factors affecting reliability:

A
  1. Method of scoring
  2. Heterogeneity of group
  3. Administration procedures
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Factors affecting reliability:

A
  1. Method of scoring
  2. Heterogeneity of group
  3. Administration procedures
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Validity:

A

Does the test measure what it claims to measure? Truthfulness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Validity:

A

Does the test measure what it claims to measure? Truthfulness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

5 Types of validity:

A
  1. Internal
  2. External
  3. Criterion
  4. Construct
  5. Ecological
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

5 Types of validity:

A
  1. Internal
  2. External
  3. Criterion
  4. Construct
  5. Ecological
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Does the test parallel the real world? Do the results extend to predictions of the outside world?

A

External

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Does the test parallel the real world? Do the results extend to predictions of the outside world?

A

External

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q
  • Type of external validity
  • Does the researcher setting emulate the real world?
  • Looking at testing environment
A

Ecological

12
Q
  • Type of external validity
  • Does the researcher setting emulate the real world?
  • Looking at testing environment
A

Ecological

13
Q
  • How well one variable predicts an outcome based on information from other variables
  • Comparing a known standard against itself
A

Criterion

13
Q
  • How well one variable predicts an outcome based on information from other variables
  • Comparing a known standard against itself
A

Criterion

14
Q
  • Could an alternative explanation be the cause of my results
A

Internal

14
Q
  • Could an alternative explanation be the cause of my results
A

Internal

15
Q
  • Am I measuring what I think I’m measuring
A

Construct

15
Q
  • Am I measuring what I think I’m measuring
A

Construct