Chapter 4 - Reliability Flashcards
Definition please:
What is Cronbach’s alpha?
A measure of internal consistency reliability in testing and assessment
Values close to 1 indicate high reliability.
Definition please:
What does reliability in psychological testing refer to?
The consistency with which a test measures what it is intended to measure
It allows users to generalize conclusions from test scores.
Definition please:
Define true scores in the context of psychological assessment.
Hypothetical scores obtained if a test were perfectly reliable and free from measurement error.
Definition please:
What are estimated true scores?
Theoretical scores a test-taker would achieve without measurement errors influencing actual test results.
Definition please:
What do confidence intervals for test scores represent?
The range of scores within which the true scores of individuals are likely to fall.
Definition please:
What is the Standard error of measurement (SEM)?
An index of measurement error that indicates the precision or reliability of individual test scores.
Definition please:
What does unsystematic error variance mean?
Unpredictable factors contributing to errors in test scores.
Definition please:
Define systematic error variance (bias).
Predictable and consistent inaccuracies in measurement affecting test scores.
Definition please:
What is true score variance?
The proportion of observed score variance attributable to actual differences in the construct being measured.
Definition please:
What are observed scores?
The actual scores obtained by individuals on a test or assessment.
Definition please:
What does test-retest reliability assess?
The consistency of test results over time by correlating scores from multiple testing occasions.
Definition please:
What are parallel forms in psychological testing?
Multiple versions of a test that are equivalent in content and difficulty level.
Definition please:
Define split-half reliability.
An estimate of reliability obtained by correlating scores on two halves of a test.
Definition please:
What does internal consistency refer to?
The extent to which items in a test are interrelated and measure the same underlying construct.
Definition please:
What is content sampling (domain sampling)?
How test scores reflect a broader range of potential items, introducing measurement error.
Definition please:
What is time sampling in psychological tests?
Observing behavior during specific time intervals to assess consistency and variability in performance.
Definition please:
What is the Kuder-Richardson coefficient?
A type of internal consistency reliability measure assessing item correlation within a test.
Definition please:
Define the domain-sampling model.
A theoretical framework explaining how test scores are influenced by a range of potential items.
Definition please:
What does equivalent forms reliability refer to?
The consistency of a test when two alternate forms are administered to the same group.
Definition please:
What is** generalisability theory**?
A set of ideas and procedures emphasizing context in assessing the reliability of evaluations.
Definition please:
What is inter-rater reliability?
The extent to which different raters agree in their assessments of the same sample.
Definition please:
What is a reliability coefficient?
A measure used to assess the consistency and dependability of memory tests.
Definition please:
What does test-retest reliability measure?
The consistency of test scores when the same test is administered on different occasions.
Definition please:
Define Parallel forms reliability.
The consistency of test scores obtained from different but equivalent forms of the same test.
Definition please:
What is a true score estimate?
The confidence interval surrounding an individual’s actual score on a psychological test.
Definition please:
What does a 95% confidence interval for test scores indicate?
A range of values within which the true test scores are estimated to lie with 95% certainty.
Definition please:
What is the Spearman-Brown formula used for?
To estimate the reliability of a test when the test length is changed or extended.
Equation time:
What is Cronbach’s alphaequation?
α=(k÷[k−1])(1 −[Σσi^2÷σt^2 ])
- α= Cronbach’s alpha coefficient
- k= number of items in the test
- σ_i 2 = the sum of each test item’s variance
- σ_t 2= the variance in total scores on the test
Equation time:
What is Standard error of Measurement equation?
SEM=SD×√(1−r_XX)
- SEM = standard error of measurement
- SD = standard deviation of test
- r_xx = reliability coefficient of test
Equation time:
What is the True Score Estimate equation?
X_T= r_XX (X_0−X ̅ )+ X ̅
- X_T= individual’s estimated true score on measure
- r_XX= reliability coefficient of measure
- X_0= individual’s observed score on measure
- X ̅= mean score on measure
Equation time:
What is the equation for 95% confidence interval for test scores - upper limit?
Upper limit= X_0+ Z_95 (SEM)
- X_0= Individual’s observed test score (or estimated true score)
- SEM= standard error of measurement
- Z_95= Z value beyond which 2.5% of possible scores lie
Equation time:
What is the equation for 95% confidence interval for test scores - lower limit?
Lower limit= X_0+ Z_95 (SEM)
- X_0= Individual’s observed test score (or estimated true score)
- SEM= standard error of measurement
- Z_95= Z value beyond which 2.5% of possible scores lie
Equation time:
What is the Spearman-Brown formula relating reliability to test length?
k= (r_(yy ) (1 − r_xx))/(r_(xx ) (1 − r_yy))
- k= the factor (multiplier) by which test length is to change (e.g., if k=2, test length doubles; if k=0.5 test length halves)
- r_xx= reliability of original test
- r_yy = reliability of test after change to test length
