Chapter 5 - Test 3 Flashcards

1
Q

Validity

A

Truth (Accuracy of measurements, assumptions, …)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Reliability

A

Consistency (Accuracy of measurements, assumptions, …)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

You can have with no, but you cannot have without .

A

reliability, validity, validity, reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Reliability Practices

A
  • Psychological Tests (may already be available)
  • Test-retest
  • Alternate form/Parallel Form
  • Internal Consistency (Inter-item)
    a. split half (odd/even)
    b. item/total
  • Inter-rater/Inter-judge/Inter-observer
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Test-Retest

A
  • static constructs (not changing)
  • possible history effects (practice effects)
    may improve
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Alternate Form/Parallel Form

A

At the same time:
* make two tests (with the same mean and standard deviation)
* Hard to make “Equivalent” tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Internal Consistency

A

each item can be considered a mini test, so…(use correlation matrix for measuring each item = average inter-item correlation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Split-half

A
  • tests you compare are shorter the test you will use
  • odd/even split (or any way to split them in half.)
  • Cronbach’s alpha - all possible split test reliabilities.
    nothing less than .70 RULE OF THUMB
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Cronbach’s alpha

A

All possible split test reliabilities

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Inter-judge/Observer/rater

A

*Controls consistency
provides a measure of the degree to which two judges concur in their respective sorting of N items into K mutually exclusive categories.
Cohen’s Kappa

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

External Validity

A

ability to generalize

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Internal Validity

A

ability to determine cause/effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Construct Validity

A

How well can you measure the construct you are interested in
* true score vs. measurement error (real value and fuzziness - errors)
* Observed score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Types of Constructs

A
  • Face validity
  • Divergent Validity (Discriminant)
  • Convergent Validity
  • Content Validity
  • Predictive Validity (criterion validity)
  • Concurrent Validity (criterion validity)
  • Logical Argument
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Face Validity

A

Does it seem to measure the construct?

Ex: Smith & Sons Welding Job Application

  1. Do you have any pets? (wrong)
  2. How many years have you been welding? (correct)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Divergent (Discriminant) Validity

A

Does it not correlate highly with a similar but different construct?
(tell apart one construct from another)

Ex: IQ Test ——–>Level of education

17
Q

Convergent Validity

A

Does it correlate with another measure of the same construct?

Ex: Stanford-Binet IQ Test—> WAIS IQ Test (comparison to another test)

18
Q

Content Validity

A

Do we sample from the universe of elements that compose the construct?

Ex: American History Test
(Not asking all the questions on only one subject)

19
Q

Predictive Validity

A

Does it predict a future construct?

Ex: SAT Scores ——–> College Success

20
Q

Concurrent Validity

A

Does it measure a current construct?

Ex: SAT Scores ——–> High School GPA

21
Q

Logical Argument

A

Not empirical based

Ex: Does purchasing behavior translate into customer preference?

Coke sales are People like
higher than Pepsi —–> Coke better

22
Q

External Validity

A

ability to generalize

23
Q

Internal Validity

A

ability to determine cause and effect

24
Q

construct validity

A

how well you can measure the construct you are interested in

25
Q

construct

A

true score vs measurement error
observed score

26
Q

Types of constructs

A
  • Face validity
  • Discriminant validity (divergent)
  • convergent validity
  • content validity
  • predictive validity > criterion validity
  • concurrent validity > criterion validity
  • logical argument
27
Q

Face Validity

A

Does it seem to measure our construct?
Example: Smith & Sons Welding Job Application
1. Do you have any pets?
2. How many years have you been welding? > correct
DEPENDS WHEN NEEDED*

28
Q

Divergent Validity (DIscriminant)

A

Does it correlate with another measure of the same construct?
(comparison to another test)
Example: Stanford Binet IQ test&raquo_space;»>WAIS IQ Test

29
Q

Content Validity

A

Do we sample from the universe of elements that compose the construct?
Example: School Exams (varying questions not focusing on one subject only.

30
Q

Predictive Validity

A

Does it measure a future construct?
Example: SAT Scores&raquo_space;»»College Success

31
Q

Concurrent Validity

A

Does it measure a current construct?
Example: SAT Scores&raquo_space;»»High School GPA

32
Q

Logical Argument

A

Example: Does purchasing behavior translate into customer preference?
Coke sales are People like
higher than Pepsi Coke better
NOT EMPIRICAL BASED*