Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

STATS > Psychological assessment > Flashcards

Psychological assessment Flashcards

1
Q

A test is VALID if…

A

it accurately measures what it says it measures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

A test is RELIABLE if…

A

it has the property of consistency in measurement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

A test must be VALID for it to be RELIABLE T/F

A

FALSE

It is is the other way around.

Test must be RELIABLE in order to be VALID (necessary but not sufficient)

But not all reliable tests are VALID

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Who is associated with classic test theory on reliability

A

Spearman (early 20th C)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

First fundamental equation of Classical Test Theory?

A

observed score = true score + error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

An example of an error that is endogenous to the test taker (to the test taker)

A

The person taking the test had a bad dream the night before

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

An example of an error that is exogenous to the test taker (to the test taker)

A

The psych recorded the wrong result

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Assumptions of Classical Test Theory (4)

A
  1. Expected value of error is 0
  2. Errors do not correlate with each other
  3. Errors do not correlate with true scores (true score is unrelated to the direction of the error)
  4. Expected value of test is qual to the true score
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

SECOND fundamental equation of classical test theory

A

variance of the observed test results = variance of true scores + variance of errors + 2(covariance of true scores and variance)

The latter score is always ZERO

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

THIRD fundamental equation of classic test theory

A

Reliability = theoretical reliability coefficient

OR

Reliability = variance of true scores/variance of observed scores

OR

Reliability = Signal/signal + noise

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the four ways of thinking of reliability?

A
  1. ratio of true score variance to observed score variance (MOST COMMON)
  2. Lack of error variance
  3. Squared correlation between observed scores and ten scores
  4. lack of correction between observed scores and error scores
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What were the three forms of reliability he talked about

T P S

A

T P S

  1. Test-retest reliability
  2. Parallel forms reliability
  3. Split-half reliability

T P S

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the problems for measuring test-retest reliability?

A
  1. Carryover affects
  2. True score may change between test and retest
  3. Participants might fail to return for the retest
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the problems for measuring test-retest reliability?

A
  1. Hard to know whether the two forms are really parallel

2. Might not really ix the problem of carryover effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What was Cronbach famous for?

A

The 1951 paper outlining a famous approach to reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What does Cronbach’s method provide?

A

A (conservative) lower bound estimate of reliability

17
Q

What is Cronbach’s method, loosely?

A

The mean of all possible split-half reliabilities, scaled to the full test instead of the half test.

18
Q

What is the standard error of measurement?

A

The standard deviation of the error

19
Q

What is the equation for the standard error of measurement?

A

SEm = Sx * the square root pf 1-Rxx

Sx = standard deviation of observed scores

20
Q

What did Kelley give us?

A

A way of predicting a true score

21
Q

How do we predict someone’s true score, using the Kelley regression formula?

A

predicted true score = reliability coefficient x observed score + (1-reliability coefficients) x population mean

22
Q

What do you use to calculate the standard error of estimation?

A

For determining CIs for predicted true scores

23
Q

What is the Spearman-Brown prophecy?

A

A formula that you can use to estimate the increased reliability of a test resulting from an expanded number of questions

24
Q

How do we improve reliability of tests

A

Increase

25
Q

What is the tripartite division of validity?

A
  1. Criterion
  2. Content
  3. Construct
26
Q

What is Criterion validity?

A

Compared favourably against a criterion

parallel or predictive

27
Q

What is Content validity ?

A

extent to which test contents reflect the full domain of the construct it is supposedly assessing.

28
Q

What is Lawshe about?

A

Approach for thinking about content validity

Content Validity Ratio

29
Q

What is Construct validity?

A

Reflects the construct it is meant to be reflecting

30
Q

What is sensitivity?

A

A test’s ability to correctly detect POSITIVE cases

Se = a/a+c

Where a is a test + criterion positive result and c is test negative and criterion positive

Correctly identifies sick people

31
Q

What is Specificity?

A

A test’s ability to correctly detect NEGATIVE cases

32
Q

What is positive predictive power? (PPP)

A

Probability a positive test result indicates a positive case

How worried you should be

33
Q

What is negative predictive power? (NPP)

A

Probability a negative test result indicates a negative case

How happy should you be (Nobel peace prise)

34
Q

Prevalence

A

What’s the probability a random person has the disease

35
Q

Who came up with Multitrait-multimethod matrices?

A

Campbell and Fiske (1955)

STATS (6 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2025 Bold Learning Solutions. Terms and Conditions