Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

Research Psychology > Reliability MCQ > Flashcards

Reliability MCQ Flashcards

You may prefer our related Brainscape-certified flashcards:
Psychology 101 flashcards GRE® Psychology flashcards AP® Psychology flashcards
1
Q

Which one of the following represents the relationship between reliability and test length?

a. Spearman-Brown formula
b. Cohen’s kappa
c. Coefficient alpha
d. KR-20

A

A

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

The greatest danger in using the test-retest method of estimating reliability is that the test takers will score differently on the test because of:

a. practice effects.
b. alternate forms.
c. order effects.
d. parallel forms.

A

A

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

When a test developer gives the same test to the same group of test takers on two different occasions, he/she can measure

a. internal consistency.
b. test-retest reliability.
c. split-half reliability.
d. validity.

A

b

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

As a rule, adding more questions to a test that measures the same trait or attribute _________ the test’s reliability.

a. can decrease
b. can increase
c. does not affect
d. lowers

A

b

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Which one of the following provides a nonparametric index for scorer agreement when the scores are nominal or ordinal data?

a. Coefficient alpha.
b. Spearman-Brown formula.
c. Inter-rater agreement.
d. Cohen’s kappa.

A

d

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

In the formula, X = T + E, the E stands for:

a. equivalence.
b. random error.
c. systematic error.
d. equality.

A

b

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Which one of the following statistics is necessary to calculate a confidence interval around a test score?

a. Standard error of the mean.
b. Intraclass correlation coefficient.
c. Standard error of measurement.
d. Cohen’s kappa.

A

c

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

The greatest danger when using alternate/parallel forms is that the:

a. test takers will display practice effects.
b. test takers can be confused by order effects.
c. two forms will not be equivalent.
d. test will be reliable but not valid.

A

c

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Estimating reliability using methods of internal consistency is appropriate only for tests that are:

a. alternate forms.
b. parallel forms.
c. equivalent forms.
d. homogenous.

A

d

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the amount of consistency among scorers’ judgements called?

Internal reliability.
Interrater reliability.
Test-retest reliability.
Intrascorer reliability.

A

b

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

`Which one of the following provides an index of the strength and direction of the linear relationship between two variables?

Split-half reliability coefficient.
Spearman-Brown formula.
Correlation.
Interrater agreement.

A

c

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Cronbach’s alpha is a measure of:

Inter-item reliability
Inter-observer reliability
Split-half reliability
Test-retest reliability

A

Inter-item reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Which of the following is NOT one of the four types of validity?

Inter-rater
Test-retest
Predictive
Parallel forms

A

Predictive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Which of the following statements is NOT correct?

A test-retest reliability coefficient of zero indicates perfect test-retest reliability.

The test-retest reliability coefficient is the correlation between the first and second administration of the test.

The closer each respondent’s scores are on T1 and T2, the more reliable the test measure.

In order to measure the test-retest reliability, we have to give the same test to the same test respondents on two separate occasions.

A

A test-retest reliability coefficient of zero indicates perfect test-retest reliability.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

One way to assess the stability of measures is by computing a Pearson _________?

coefficient criterion.
linear coefficient.
correlation coefficient.
coefficient of determination.

A

correlation coefficient.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

When you read about reliability in an article, the correlation between two test scores will usually be referred to as the _________ coefficient.

score
internal
reliability
significance

A

reliability

17
Q

A group of students took a cognitive development test on Monday and then took the same test again the following week. Most likely, researchers were assessing the __________ reliability of the measure.

test-retest
split-half
odd-even
inter-item

A

test-retest

18
Q

Which of the following statements about test-retest reliability is FALSE?

The reliability coefficient of a measure should be at least .80 before the measure is accepted as reliable.

Sometimes test-retest reliability is artificially high because people remember how they answered the first time.

Test-retest reliability is the best form of reliability measurement.

Test-retest reliability is very useful if the variable being measured is expected to stay constant over time.

A

Test-retest reliability is the best form of reliability measurement.

19
Q

Which of the following is an indicator of the internal consistency reliability of a measure?

Split-half reliability
Cronbach’s alpha
Inter-rater reliability
Both A and B

A

Both A and B

20
Q

When two raters observe the same behaviours, the extent to which their observations are in agreement is called _________?

Cronbach’s alpha
Item-total correlations
Split-half reliability
Inter-rater reliability

A

Inter-rater reliability

21
Q

Internal consistency reliability is to Cronbach’s alpha as interrater reliability is to:

Spearman-Brown reliability coefficient
Pearson product-moment correlation coefficient
the item-total correlation
Cohen’s kappa

A

Cohen’s kappa

22
Q

With regard to test reliability:

There are different types of reliability
It is seldom an all-or-none matter.
Tests are reliable to different degrees.
All of the above.

A

All of the above.

23
Q

In the context of psychometrics, error refers to the component of the observed score on an ability test that:

does not have to do with the ability being measured.
was distorted as a result of examiner error.
may have been measured inaccurately for whatever reason.
was administered solely for experimental reasons.

A

does not have to do with the ability being measured.

24
Q

Which is source of error variance:

Test construction.
Test administration.
Test scoring.
All of the above.

A

All of the above.

25
Q

According to the true score theory, an individual’s score on a test of extraversion reflects a level of extraversion as defined by the test and that level is presumed to be…:

the test-taker’s “true” level of extraversion.
only an estimate of the test-taker’s true level of extraversion.
greater than the degree of error inherent in the score.
less than or equal to the degree of error inherent in the score.

A

only an estimate of the test-taker’s true level of extraversion.

26
Q

Coefficient alpha is conceptually:

the variance of all possible sources of error variance.
the mean of all possible split-half correlations.
the standard deviation of all possible sources of variation.
the estimate of inter-scorer reliability that is most robust.

A

the mean of all possible split-half correlations.

27
Q

The degree of correlation among all of the items on a scale:

is referred to as inter-item consistency
may be estimated by means of KR-20.
may be estimated by means of the Cronbach’s formula.
all of the above.

A

all of the above.

28
Q

The correlation between two scores on two different administrations of the same test is called:

coefficient of stability
coefficient of equivalence
internal consistency
Cronbach’s alpha

A

coefficient of stability

29
Q

Using split-half reliability to estimate consistency means we _________ reliability compared to the total test.

increase
reduce
halve
none of the above

A

reduce

30
Q

Which formula do we use to adjust or re-evaluate reliability obtained from the split-half method?

KR-20
Cronbach’s alpha
Pearson product-moment correlation
Spearman-Brown correction

A

Spearman-Brown correction

Research Psychology (6 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions