Concepts in Psychometric Testing Flashcards
What are the 4 key methods of assessing behaviour?
- Self-report
- Other-report
- Observation
- Biological Measurement.
What is a common concern about projective tests?
There is a substantial lack of evidence of reliability and validity.
- What are maximal tests?
2. Where were they developed from?
- test of ability
2. From a perspective of making sure those assessed have required knowledge on a topic.
What are the steps to developing tests of topical performance/personality?
- Construct
- theory
- Item generation -Top down or bottom up?
- Exploration of factors
- Confirmation of factors
- Validation & reliability
- Norms and deployment.
What is internal reliability?
Within a study, how often do measures agree?
We want measures to be internally reliable - we wouldn’t want a thermometer that couldn’t consistently measure the temperature in the same place.
What is external reliability / replicability?
What is conceptual replication?
What is direct replication?
Across a study, how often do findings agree?
Same idea, different method, different sample/data
Same idea, same methods, different sample/data.
what is convergent validity?
The statistical relationship between 2 similar measures. i.e., measures of happiness and life satisfaction converge.
What is concurrent validity?
The statistical relationship with a similar assessment of the same construct. i.e., a new measure of happiness is concurrent with an old one.
What is face validity?
Does this have the appearance of good measurement? i.e., to what extent can overlapping circles represent community feeling.
What is content validity?
The value of the included/excluded content for representing a construct i.e., single item measures not fully representing all aspects of construct.
Why is having too high reliability bad?
Theres likely too narrow of a scope of measure, might not be enough space for participants to vary.
What can you use to make getting validity easy?
Using correlations.
- What is a Z score?
2. What do the different Z-scores mean?
- A ratio of a person’s distance from the mean in terms of the spread of data.
- Z = 0 is the mean response
- Z= between 0 and 1 indicates someone is above the mean but in a normal range.
- Z = between 0 and -1 indicates someone is below the mean but within the normal range.
A Z score more than +1 indicates an atypically high score and lower than -1 indicates an atypically low score.
What can we do to Z scores to make them clearer to interpret?
We can scale them.
What is the normal result scale for IQ scores?
Norm scored M=100, SD=15
Thus, norm range of IQ is 85-115. Abnormally low or high is above or below this range.