Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

Psychological Assessment > Reliability > Flashcards

Reliability Flashcards

1
Q

What is reliability in measurement?

A

Consistency in measurement.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What does a reliability coefficient represent?

A

It indicates the ratio between true score variance and total variance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What does a reliability coefficient of 0 indicate?

A

No reliability.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What does a reliability coefficient of 1 indicate?

A

Perfect reliability.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the formula for observed score?

A

Observed score = true score + error (X = T + E).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What does Cronbach’s Alpha indicate if it’s too high?

A

Redundancy in test items.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is measurement error?

A

Factors affecting the measurement process, aside from the variable being measured.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is a true score?

A

A score without measurement error, though it can’t be directly observed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

How can an approximation of a true score be obtained?

A

By averaging multiple measurements.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are two influences that interfere with measuring a true score?

A

Time between measurements and the act of measurement itself.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is a carry-over effect?

A

When the measurement process alters what is being measured.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

How can practice effects in testing be minimized?

A

By using different sets of tests measuring the same construct.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the fatigue effect in testing?

A

Reduced motivation or mental energy due to repeated testing.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How is a true score related to a construct score?

A

A true score is tied to the measurement tool, while a construct score is tied to a theoretical variable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is random error?

A

Unpredictable fluctuations and inconsistencies in the measurement process.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is systematic error?

A

Consistent or proportionate error related to the true value being measured.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

How is reliability related to variance in test scores?

A

Higher true score variance relative to total variance indicates higher reliability.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What does a reliability of 0.80 imply?

A

80% of score variance is due to true differences.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is total observed variance in terms of reliability?

A

True variance + error variance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What does item sampling refer to in test construction?

A

Variations within items to measure a specific construct, such as physical aggression.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What factors in test administration can cause measurement error?

A

Testing environment, test-taker conditions, and examiner behavior.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is test-retest reliability?

A

A reliability estimate based on the correlation between scores on two administrations of the same test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is parallel form reliability?

A

Two identical versions of a test designed to measure the same construct with equal statistical properties.

24
Q

What is internal consistency reliability?

A

The consistency of items within a test, often measured with split-half or Cronbach’s Alpha.

25
Q

What does the Spearman-Brown formula do?

A

Adjusts reliability for split-half testing.

26
Q

What does a reliability coefficient of 0.7 signify?

A

An acceptable level of reliability according to Kline (2015).

27
Q

What is the purpose of a reliability coefficient?

A

To provide an index of error from test construction, administration, or scoring.

28
Q

What is the Classical Test Theory formula for observed score?

A

X = E + T (error + true score).

29
Q

What is Domain Sampling Theory?

A

A method estimating reliability based on sampling of test items and inter-item consistency.

30
Q

What does Generalizability Theory aim to describe?

A

Specific sources of variation in test scores due to testing conditions.

31
Q

What does Item Response Theory (IRT) analyze?

A

Item difficulty and item discrimination in assessing construct measures.

32
Q

What is Cronbach’s Coefficient Alpha used for?

A

It is used to measure internal consistency for tests with interval or ratio data, especially in Likert-scale formats.

33
Q

What range do values of Cronbach’s Alpha typically fall within?

A

Values range from 0 to 1, with higher values indicating greater reliability.

34
Q

What does a Cronbach’s Alpha of 0.99 suggest?

A

Potential redundancy in test items.

35
Q

What does a reliability coefficient of 0.80 mean in terms of measurement error?

A

20% of score variability is due to measurement error.

36
Q

What is the coefficient of inter-rater reliability used for?

A

To provide information about scoring error between multiple raters.

37
Q

What does the coefficient of stability assess?

A

Error due to time intervals between test administrations.

38
Q

What does the coefficient of equivalence assess?

A

Error from the instrument (test items) itself.

39
Q

What is a true score according to Classical Test Theory (CTT)?

A

The score that reflects an individual’s actual ability or trait level as measured by the test.

40
Q

What does Domain Sampling Theory suggest about test items?

A

Reliability increases as the number of items sampled increases.

41
Q

What is the goal of Generalizability Theory?

A

To identify specific sources of variation in test scores within the testing environment.

42
Q

What does “facets” refer to in Generalizability Theory?

A

Variables such as test item number, scorer training, and test purpose that define a test’s “universe.”

43
Q

What does Item Response Theory (IRT) focus on in terms of test items?

A

The difficulty level and discrimination ability of test items.

44
Q

What is meant by “level of difficulty” in IRT?

A

The degree to which an item is challenging or easy for test-takers.

45
Q

What does “level of discrimination” refer to in IRT?

A

An item’s ability to differentiate between individuals with high or low levels of the measured trait.

46
Q

How is reliability in a test related to true score and error variance?

A

Higher true score variance relative to total variance indicates higher reliability.

47
Q

What does a test with low reliability suggest about observed scores?

A

They are mostly determined by measurement error rather than true scores.

48
Q

How does the Classical Test Theory (CTT) view measurement error?

A

CTT assumes measurement error is always present in any test score.

49
Q

What happens to test-retest reliability over long intervals?

A

It tends to decrease, especially over intervals longer than six months.

50
Q

What is the coefficient of stability in test-retest reliability?

A

The reliability estimate for intervals over six months.

51
Q

How does parallel form reliability differ from alternate form reliability?

A

Parallel forms have identical statistical properties; alternate forms are similar but may vary slightly in mean and variance.

52
Q

What is inter-item consistency?

A

The degree of relatedness among items within a test.

53
Q

What does the Spearman-Brown formula help estimate?

A

Internal consistency reliability for split-half tests.

54
Q

When is the Kuder-Richardson Formula 20 used?

A

For determining inter-item consistency in dichotomous (binary) items.

55
Q

What is the main aim of Item Response Theory (IRT)?

A

To analyze item properties and assess the construct’s ability being measured through item difficulty and discrimination.

Psychological Assessment (1 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions