PSYC 549: Psychometrics Flashcards

1
Q

Achievement Test

A
  • Test which is designed to measure previous learning
  • In comparison to an aptitude test, and achievement test assesses knowledge and skills that one already possesses
  • These test rely heavily on content validation procedures

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Aptitude Test

A
  • Test designed to measure an individual’s potential for learning a specific skill
  • In comparison to an achievement test, an aptitude test assesses an individual’s ability to potentially acquire certain knowledge and skills
  • These tests rely heavily on predictive criterion validation procedures

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Assessment Interview

A
  • Process of collecting relevant info about a client and their history
  • allows the clinician to begin forming conceptualization of the case
  • clinician gathers information about the client’s history and presenting problem(s)
  • interviews may be structured (follows set list of questions) or unstructured (more conversation based)

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Clinical vs Statistical Significance

A
  • Clinical significance that refers to when the results of a study are judged to be meaningful in relation to the diagnosis or treatments of disorders
  • Statistical significance refers to the actual results of the statistical analyses that aren’t attributed to the operation of chance or random factors

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Construct

A
  • A characteristic that varies between individuals but is not directly observable
  • Constructs are used to explain phenomena in human behavior
  • Because constructs do not have a concrete existence in the physical world, they cannot be objectively defined and measured

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Correlation vs Causation

A
  • Correlation describes the relationship (either positive or negative) between variable
  • Causation refers to when changes in one variable bring about changes in the other variable(s) (i.e. cause and effect)
  • A correlation is necessary to establish a causal relationship, but a correlation between variable DOES NOT assume that their is causation between the variables
  • Only experimental studies can establish causal relationships

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Criterion-referenced Scoring/Tests

A
  • Tests in which the test-taker is asked to demonstrate a specific skill or ability
  • Performance is measured against a fixed set of predetermined criteria or standards
  • The results are not compared to norms

Ex: John’s parents enter counseling concerned about his future. To move on to the fourth grade, John had to complete a 3rd grade math test to demonstrate his 3rd grade skills. John did not meet the predetermined standards to pass 3rd grade math. He is held back.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Criterion-related validity

A
  • A type of validity in which a test or measure is assessed according to the extent to which it corresponds with a particular criterion or standard
  • There are two types of criterion-related validity:
  • concurrent (how well the test correlated currently with another measure/criterion
  • predictive ( how well the test predicts future performance in relation to a criterion or measure

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Cross-validation

A
  • Process of evaluating a test for a sample other than the one used in the original study
  • Cross-validation allows the researcher to determine if a test is valid by using a different sample to see if similar results are found in the second sample

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Normal Curve

A
  • Theoretical distribution in which values pile up in the center at the mean , median, and mode and falls off into “tails” at either end of the distribution
  • Normal curve produces the familiar “bell-shape” when plotted

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Norm-referenced Scoring/Tests

A
  • Tests in which the test-taker’s results are compared to norms
  • Norms are not standards but are what a typical result should be based on a sample of other results
  • Tests should be normed on a sample that is reflective of the population that’s tested

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Objective Tests

A
  • A type of assessment instrument consisting of a set of items or questions
  • Have specific correct answers, such that no interpretation, judgment, or personal impressions are involved in scoring
  • lack ambiguity

Ex: A therapist uses an objective test to assess John’s personality. This test includes answers of yes/no or true/false. Statements to be answered may be similar to “I am happy.” The therapist scores this test without interpretations or judgment.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Projective Tests

A
  • Tests in which test-taker is asked to provide a spontaneous response to ambiguous stimuli rather than choosing an answer from provided response options
  • Theory behind that is that the test-taker will project their unconscious conflicts onto the stimuli

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Reliability (types of)

A
  • Reliability is the extent to which a test or measure yields consistent results or is free of measurement error
  • Test-Retest reliability provides a reliability coefficient for the correlation between one person’s scores on one measure taken at two separate times
  • Parallel Forms reliability develops two separate but equal forms of a test and scores between them are correlated
  • Split-Half reliability divides a test’s items into two halves and correlated them
  • Interrater reliability refers to the correlation between two independent raters scores

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Standard Deviation

A
  • Measures the variability within a set of scores or values
  • Indicates how narrowly or broadly they deviate from the mean
  • The larger the SD, the further a score is from the mean
  • It is calculated by taking the square root of the sample’s variance

Ex:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Standard Error of Measurement

A
  • Common tool in research and standardized testing
  • Provides an estimate of how much an individual’s score would be expected to change on re-testing with same/equivalent form of test
  • The scores over the infinite number of tests are averaged. This score is considered an estimate of the true ability/knowledge (T True score)
  • The smaller the standard error of measurement SEM, the more precise the measurement
  • Has in inverse relationship with the reliability coefficient

Ex:

17
Q

Standard Scores

A
  • Scores which have been standardized to have a fixed mean and standard deviation
  • Raw scores can be converted to standard scores in order to facilitate comparison and evaluation
  • Conversion to standard score allows for more objective comparison across samples/studies and accurate interpretation of said scores
  • test results from the standardization sample are the standard scores

Ex: IQ tests. results of person taking test are compared to the mean/SD of the standard scores

18
Q

Standardization Sample

A
  • Population of individuals who have previously well-documented intelligence and/or achievement levels
  • Used to standardize a new or revised instrument
  • This is to assure that the new or revised measure is reliably measuring what it is intended to measure

Ex:

19
Q

Test Bias

A
  • Tendency of scores on a test to systematically over- or underestimate the true performance of individuals to whom that test is administered, particularly because they are members of specific groups (sex, gender identity, race, etc.)
    -Tests are considered biased if a test design systematically disadvantages certain groups of people over others

Ex:

20
Q

Validity (types of)

A
  • Validity measures how well a particular measure fulfills the function for which its being used
  • Face validity refers to whether a measure appears valid
  • Content validity refers to how well a measure encompasses the full domain of what it’s trying to measure
  • Criterion-related validity refers to the extent to which a test corresponds with a particular criterion against which it’s compared - either concurrently or predictively

Ex:

21
Q

Variance

A
  • Measure of the spread of scores within a sample or populations
  • A small variance indicates highly similar scores, all close to the sample mean
  • A large variance indicates scores spread over a larger range

Ex: