Chapter 5 - Test 3 Flashcards

1
Q

Validity

A

Truth (Accuracy of measurements, assumptions, …)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Reliability

A

Consistency (Accuracy of measurements, assumptions, …)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

You can have with no, but you cannot have without .

A

reliability, validity, validity, reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Reliability Practices

A
  • Psychological Tests (may already be available)
  • Test-retest
  • Alternate form/Parallel Form
  • Internal Consistency (Inter-item)
    a. split half (odd/even)
    b. item/total
  • Inter-rater/Inter-judge/Inter-observer
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Test-Retest

A
  • static constructs (not changing)
  • possible history effects (practice effects)
    may improve
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Alternate Form/Parallel Form

A

At the same time:
* make two tests (with the same mean and standard deviation)
* Hard to make “Equivalent” tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Internal Consistency

A

each item can be considered a mini test, so…(use correlation matrix for measuring each item = average inter-item correlation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Split-half

A
  • tests you compare are shorter the test you will use
  • odd/even split (or any way to split them in half.)
  • Cronbach’s alpha - all possible split test reliabilities.
    nothing less than .70 RULE OF THUMB
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Cronbach’s alpha

A

All possible split test reliabilities

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Inter-judge/Observer/rater

A

*Controls consistency
provides a measure of the degree to which two judges concur in their respective sorting of N items into K mutually exclusive categories.
Cohen’s Kappa

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

External Validity

A

ability to generalize

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Internal Validity

A

ability to determine cause/effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Construct Validity

A

How well can you measure the construct you are interested in
* true score vs. measurement error (real value and fuzziness - errors)
* Observed score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Types of Constructs

A
  • Face validity
  • Divergent Validity (Discriminant)
  • Convergent Validity
  • Content Validity
  • Predictive Validity (criterion validity)
  • Concurrent Validity (criterion validity)
  • Logical Argument
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Face Validity

A

Does it seem to measure the construct?

Ex: Smith & Sons Welding Job Application

  1. Do you have any pets? (wrong)
  2. How many years have you been welding? (correct)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Divergent (Discriminant) Validity

A

Does it not correlate highly with a similar but different construct?
(tell apart one construct from another)

Ex: IQ Test ——–>Level of education

17
Q

Convergent Validity

A

Does it correlate with another measure of the same construct?

Ex: Stanford-Binet IQ Test—> WAIS IQ Test (comparison to another test)

18
Q

Content Validity

A

Do we sample from the universe of elements that compose the construct?

Ex: American History Test
(Not asking all the questions on only one subject)

19
Q

Predictive Validity

A

Does it predict a future construct?

Ex: SAT Scores ——–> College Success

20
Q

Concurrent Validity

A

Does it measure a current construct?

Ex: SAT Scores ——–> High School GPA

21
Q

Logical Argument

A

Not empirical based

Ex: Does purchasing behavior translate into customer preference?

Coke sales are People like
higher than Pepsi —–> Coke better

22
Q

External Validity

A

ability to generalize

23
Q

Internal Validity

A

ability to determine cause and effect

24
Q

construct validity

A

how well you can measure the construct you are interested in

25
construct
true score vs measurement error observed score
26
Types of constructs
* Face validity * Discriminant validity (divergent) * convergent validity * content validity * predictive validity > criterion validity * concurrent validity > criterion validity * logical argument
27
Face Validity
Does it seem to measure our construct? Example: Smith & Sons Welding Job Application 1. Do you have any pets? 2. How many years have you been welding? > correct ****DEPENDS WHEN NEEDED*****
28
Divergent Validity (DIscriminant)
Does it correlate with another measure of the same construct? (comparison to another test) Example: Stanford Binet IQ test >>>>>WAIS IQ Test
29
Content Validity
Do we sample from the universe of elements that compose the construct? Example: School Exams (varying questions not focusing on one subject only.
30
Predictive Validity
Does it measure a future construct? Example: SAT Scores >>>>>>College Success
31
Concurrent Validity
Does it measure a current construct? Example: SAT Scores >>>>>>High School GPA
32
Logical Argument
Example: Does purchasing behavior translate into customer preference? Coke sales are People like higher than Pepsi Coke better ****NOT EMPIRICAL BASED*****