PSYC 549: Psychometrics Flashcards
Achievement Test
- Test which is designed to measure previous learning
- In comparison to an aptitude test, and achievement test assesses knowledge and skills that one already possesses
- These test rely heavily on content validation procedures
Ex:
Aptitude Test
- Test designed to measure an individual’s potential for learning a specific skill
- In comparison to an achievement test, an aptitude test assesses an individual’s ability to potentially acquire certain knowledge and skills
- These tests rely heavily on predictive criterion validation procedures
Ex:
Assessment Interview
- Process of collecting relevant info about a client and their history
- allows the clinician to begin forming conceptualization of the case
- clinician gathers information about the client’s history and presenting problem(s)
- interviews may be structured (follows set list of questions) or unstructured (more conversation based)
Ex:
Clinical vs Statistical Significance
- Clinical significance that refers to when the results of a study are judged to be meaningful in relation to the diagnosis or treatments of disorders
- Statistical significance refers to the actual results of the statistical analyses that aren’t attributed to the operation of chance or random factors
Ex:
Construct
- A characteristic that varies between individuals but is not directly observable
- Constructs are used to explain phenomena in human behavior
- Because constructs do not have a concrete existence in the physical world, they cannot be objectively defined and measured
Ex:
Correlation vs Causation
- Correlation describes the relationship (either positive or negative) between variable
- Causation refers to when changes in one variable bring about changes in the other variable(s) (i.e. cause and effect)
- A correlation is necessary to establish a causal relationship, but a correlation between variable DOES NOT assume that their is causation between the variables
- Only experimental studies can establish causal relationships
Ex:
Criterion-referenced Scoring/Tests
- Tests in which the test-taker is asked to demonstrate a specific skill or ability
- Performance is measured against a fixed set of predetermined criteria or standards
- The results are not compared to norms
Ex: John’s parents enter counseling concerned about his future. To move on to the fourth grade, John had to complete a 3rd grade math test to demonstrate his 3rd grade skills. John did not meet the predetermined standards to pass 3rd grade math. He is held back.
Criterion-related validity
- A type of validity in which a test or measure is assessed according to the extent to which it corresponds with a particular criterion or standard
- There are two types of criterion-related validity:
- concurrent (how well the test correlated currently with another measure/criterion
- predictive ( how well the test predicts future performance in relation to a criterion or measure
Ex:
Cross-validation
- Process of evaluating a test for a sample other than the one used in the original study
- Cross-validation allows the researcher to determine if a test is valid by using a different sample to see if similar results are found in the second sample
Ex:
Normal Curve
- Theoretical distribution in which values pile up in the center at the mean , median, and mode and falls off into “tails” at either end of the distribution
- Normal curve produces the familiar “bell-shape” when plotted
Ex:
Norm-referenced Scoring/Tests
- Tests in which the test-taker’s results are compared to norms
- Norms are not standards but are what a typical result should be based on a sample of other results
- Tests should be normed on a sample that is reflective of the population that’s tested
Ex:
Objective Tests
- A type of assessment instrument consisting of a set of items or questions
- Have specific correct answers, such that no interpretation, judgment, or personal impressions are involved in scoring
- lack ambiguity
Ex: A therapist uses an objective test to assess John’s personality. This test includes answers of yes/no or true/false. Statements to be answered may be similar to “I am happy.” The therapist scores this test without interpretations or judgment.
Projective Tests
- Tests in which test-taker is asked to provide a spontaneous response to ambiguous stimuli rather than choosing an answer from provided response options
- Theory behind that is that the test-taker will project their unconscious conflicts onto the stimuli
Ex:
Reliability (types of)
- Reliability is the extent to which a test or measure yields consistent results or is free of measurement error
- Test-Retest reliability provides a reliability coefficient for the correlation between one person’s scores on one measure taken at two separate times
- Parallel Forms reliability develops two separate but equal forms of a test and scores between them are correlated
- Split-Half reliability divides a test’s items into two halves and correlated them
- Interrater reliability refers to the correlation between two independent raters scores
Ex:
Standard Deviation
- Measures the variability within a set of scores or values
- Indicates how narrowly or broadly they deviate from the mean
- The larger the SD, the further a score is from the mean
- It is calculated by taking the square root of the sample’s variance
Ex: