Psychometrics - SPSY 6334 Flashcards
What term describes the differences between two individuals, such as differences in intelligence or personality?
Interindividual differences
What term refers to variations within the same person over time, such as changes in cognitive ability due to aging?
Intraindividual differences
What statistical measure describes how much scores differ from the mean in a dataset?
Variance
What is the name of the statistical measure that quantifies the relationship between two variables and indicates whether they increase or decrease together?
Covariance
What type of graph visually represents the relationship between two variables and can show trends such as positive or negative associations?
Scatterplot
What is the ideal theoretical distribution in statistics where most scores cluster around the mean, forming a symmetrical bell curve?
Normal distribution
What term describes a distribution where scores are unevenly spread, with more scores clustering on one side of the mean?
Skewed distribution
What is the statistical measure that standardizes covariance, allowing comparisons across different datasets, and ranges from -1 to +1?
Correlation
What statistical transformation expresses how far a raw score is from the mean in standard deviation units, helping in score interpretation?
Z-score
What term refers to the process of converting raw scores into a format that is easier to interpret, such as percentile ranks or standardized scores?
Score normalization
What scoring method ranks individuals based on the percentage of people they outperformed in a given test?
Percentile rank
What term refers to a standardized sample used to establish test norms and interpret individual scores?
Reference sample
What sampling method ensures a representative selection of individuals for a test by using random selection techniques?
Probability sampling
What type of sampling method does not guarantee representativeness and may introduce bias, such as using a convenience sample?
Nonprobability sampling
What is the name of the statistical table that organizes variance and covariance values for multiple variables in a dataset?
Variance-covariance matrix
What is the name for test items with only two possible responses, such as ‘true/false’ or ‘yes/no’?
Binary items
What term refers to the process of computing a combined score from multiple test items to create an overall measurement?
Composite score
What is the statistical technique used to adjust scores when a test’s actual distribution does not match the assumed normal distribution?
Normalization
What is the term for an incorrect assumption that all variability in test scores is due to error, ignoring meaningful individual differences?
Common variance fallacy
Who is the author of Psychometrics: An Introduction, Fourth Edition, which discusses concepts such as individual differences and test variability?
Furr
What term describes the consistency and stability of a measurement tool over time, across raters, and within itself?
Reliability
What term refers to any deviation in a test score that does not accurately reflect the true ability or trait being measured?
Measurement Error
What is the primary goal of reliability in psychometrics?
Consistency
What is the name of the reliability measure that assesses the stability of test scores when the same test is administered at different points in time?
Test-Retest Reliability
What term describes the variation in test scores caused by factors like mood, fatigue, and test-taking conditions?
Situational Factors
What type of reliability is measured by administering a test to the same group of individuals on two separate occasions and comparing their scores?
Test-Retest Reliability
What type of reliability assesses the degree to which different observers or raters agree on their assessments?
Inter-Rater Reliability
What type of reliability examines whether two versions of the same test yield similar results?
Parallel-Forms Reliability
What type of reliability evaluates how well individual test items correlate with one another to measure the same construct?
Internal Consistency
What statistic is commonly used to measure internal consistency?
Cronbach’s Alpha
What statistical measure is often used to determine the relationship between two sets of scores in test-retest reliability?
Correlation Coefficient
What is the typical minimum acceptable value for Cronbach’s alpha in psychometric assessments?
0.70
What statistical measure accounts for agreement between raters while controlling for chance?
Kappa Statistic
What correlation coefficient value indicates a very high level of reliability?
0.80 or higher
What statistical method is used to assess the consistency of test items within a single administration?
Cronbach’s Alpha
What term refers to inconsistencies in how different raters evaluate test responses?
Scoring Inconsistencies
What environmental factor can affect test performance and lower reliability?
Distractions
What is one major cause of internal inconsistency in a test, leading to poor reliability?
Ambiguous Questions
What term refers to variations in test scores caused by differences in test administration conditions?
Environmental Changes
What factor, if not properly controlled, can lead to different test scores for the same person across different testing sessions?
Fatigue
What is one method for improving reliability that involves adding more questions measuring the same construct?
Increase the Number of Items
What is the best way to ensure raters apply consistent evaluation criteria in inter-rater reliability assessments?
Training
What technique involves ensuring that all test-takers experience the same testing conditions?
Standardization
What should be clearly written to reduce misunderstandings and improve test reliability?
Test Instructions
What type of reliability is most useful for tests designed to measure stable traits, such as personality?
Test-Retest Reliability
What type of reliability is most important in situations where different graders evaluate subjective responses, such as essay writing?
Inter-Rater Reliability
What measure should be used if researchers need to compare two different but equivalent versions of the same test?
Parallel-Forms Reliability
What is the main problem with a test that has low reliability?
Inconsistency
What kind of reliability would be used to evaluate the effectiveness of a diagnostic tool used in clinical psychology?
Inter-Rater Reliability
If an intelligence test produces widely different scores when taken at two different times, what type of reliability is likely low?
Test-Retest Reliability
What term describes differences between two people in psychometric analysis?
Interindividual
What term refers to differences in a single person over time?
Intraindividual
What statistical measure quantifies how much scores differ from one another in a dataset?
Variance
What statistical measure describes the average deviation of scores from the mean?
Standard deviation
What type of distribution is symmetrical, bell-shaped, and centered around the mean?
Normal
What term describes a distribution that is asymmetrical due to a concentration of scores on one side?
Skewed
What is the name of the theoretical framework that helps interpret raw test scores?
Interpretive frame of reference
What statistical measure shows the degree to which two variables vary together?
Covariance
What standardized statistical measure ranges from -1 to +1 and describes the strength of a relationship between two variables?
Correlation
What type of visual graph is used to display the relationship between two variables?
Scatterplot
What matrix is used to analyze sets of variances and covariances for multiple variables?
Variance-covariance matrix
What is the name of a score created by combining multiple test items into one measure?
Composite
What is the key downside of covariance as a measure of association?
Unstandardized
What does a correlation coefficient of 0 indicate about the relationship between two variables?
None
What type of correlation occurs when higher values of one variable are associated with lower values of another?
Negative
What is the direct score obtained from a test-taker’s responses?
Raw
What statistical transformation expresses scores in terms of standard deviation units?
z-score
What is the main advantage of z-scores in interpreting test results?
Standardization
What alternative scoring method expresses scores as the percentage of people who scored lower?
Percentile
What process adjusts raw scores to fit a theoretical normal distribution?
Normalization
What three-step process is used when scores deviate significantly from normality?
Normalization transformation
What are the two main ways to determine a percentile rank?
Direct and empirical
What type of score is computed when a raw score is converted into a more interpretable format?
Standardized
What type of test item has only two possible responses, such as ‘true/false’?
Binary
What is the mean of a binary item called when converted into a numerical format?
Proportion
What statistical measure is used to assess consistency in responses to binary items?
Variance
What is the name of the reference group used to establish standard test norms?
Sample
What term describes a sample that accurately represents the population being studied?
Representative
What sampling method ensures every member of a population has an equal chance of selection?
Probability
What is the term for a sampling method that does not guarantee a representative sample?
Nonprobability
