Midterm (Oct. 20, 2017) Flashcards

1
Q

What are the 3 defining characteristics of a psychological test?

A
  1. Sample of behaviour
  2. Obtained under standardized conditions
  3. Established rules for scoring/obtaining numeric info from sample of behaviour
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Ideally, psychological tests should be:

A

Standardized
Representative
Consistent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are some uses of psychological testing?

A
  • making important decisions about individuals
  • hiring decisions
  • clinical diagnosis
  • entrance scores
  • vocational placement
  • credentials, licensure
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are some drawbacks of psychological testing?

A
  • limited precision

- no method guarantees complete accuracy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are several categories of human behaviour that are hard to quantify?

A
  • social
  • physical
  • psychological
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the 6 assumptions of psychological testing?

A
  1. psychological tests measure what they are intended to
  2. individual’s behaviour and associated test scores will typically remain stable over time
  3. individuals will understand items in the same way
  4. individuals will report accurately about themselvs
  5. individuals will report honestly about their thoughts and feelings
  6. individual’s score is reflective of “true score” and error
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the 3 general types of tests in psychological testing?

A
  1. Task performance
  2. Behavioural observation
  3. Self-report measures
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Describe standardized tests

A
  • administered to a large group
  • representative of those for whom test as been designed
  • formal for multiple administrations
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Describe unstandardized tests

A
  • administered to small groups

- less formal for single administration

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Describe behavioural observation

A

Assesses typical behaviour or performance within a specific context, NOT maximal performance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Describe objective tests

A
  • participants choose response out of several options
  • predetermined “correct” response
  • objective scoring
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Describe projective tests

A
  • unstructured

- participants required to respond to ambiguous stimuli

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Describe objective scoring

A
  • same scoring rules apply for every individual
  • theoretically should arrive at the same final score
  • structured (ex. Big 5 personality test)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Describe subjective scoring

A
  • scores rely on judgment of examiner
  • used by highly trained experts
  • unstructured (ex. Rorschach inkblot test)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are some similarities between psychological tests?

A
  • measure individual behaviour
  • behaviour is used to measure a particular construct
  • may be used to make predictions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are some differences between psychological tests?

A
  • specific behaviour and construct being measured
  • how, when, where test was administered
  • scoring and interpretation
  • validity and reliability are unique to each test
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is the assumption/founding idea of psychological measurement?

A

People differ in discernable ways in terms of abilities/attitudes/beliefs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Define variability

A

measure of extent to which test scores vary

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Define standard deviation

A

the difference between individual’s score and mean (how much individuals deviate from the mean)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is variance

A

the measure of the extent to which test scores differ or vary

(the average of squared deviation scores)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What are Z scores

A

standardized scores to draw comparisons between deviation scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Define correlation

A

describes relationship between variables and scores

23
Q

What makes a positive correlation?

A

increase in one variable, increase in other variable

24
Q

What makes a negative correlation?

A

increase in one variable, decrease in other variable

25
Q

What is factor analysis?

A

statistical technique used to analyze patterns of correlation among different measures

26
Q

What does factor analysis accomplish?

A
  • simplifies data interpretation (reduces number of variables)
  • focus on research moves from specific tests to more general factors (have many of the same characteristics of construct)
27
Q

What is a correlation coefficient?

A

statistical measure of relationship between 2 sets of scores

28
Q

What is linear regression?

A

method for predicting scores on one measure on the basis of scores on some other measure

29
Q

What is reliability?

A

the consistency of test scores

30
Q

What is validity?

A

the degree to which inferences made on the basis of test scores are correct

31
Q

What are the 4 scales of measurement?

A
  • interval scale
  • nominal scale
  • ordinal scale
  • ratio scale
32
Q

Define interval scales:

A

size of differences between objects reflected by difference in numbers assigned

33
Q

Define nominal scales:

A

numbers identify objects, but size of numbers is meaningless

34
Q

Define ordinal scales:

A

rank order of numbers corresponds to rank order of objects measured

35
Q

Define ratio scales:

A

ordinal and interval properties found, true and meaningful zero point

36
Q

What are crucial components of evaluating psychological tests?

A

Reliability and validity

37
Q

What is validity of measurement?

A

inferences regarding attribute being measured

38
Q

What is validity for decisions?

A

inferences that will affect decisions made about test taker

39
Q

What are the 3 stages of test development?

A
  1. test construction (items writing, scale construction, response sets, selection of test format)
  2. New tests are standardized for use on target populations, norms developed, research to establish estimates of test’ reliability and validity
  3. tests revised to keep them contemporary, with respect to norms available and item content
40
Q

What are common issues in item writing?

A
  • item length (cause confusion, major point missed)
  • vocabulary (reading level, wording, double negative, ambiguous)
  • types of language (sexist, racist, offensive, gender-specific –> may promote negative feelings toward testing)
41
Q

What are the drawbacks to theoretical item writing?

A
  • transparent

- people respond how they would like to appear, not how they perceive themselves

42
Q

What are the advantages to atheoretical item writing?

A
  • generate large item pool with diverse content
  • create items that will differentiate responses of one group from another
  • generally less transparent
  • less subject to examinee distortion
43
Q

What are rational scales?

A

Implies underlying thought, belief, rationale as basis for selecting items, grouping them into a scale

44
Q

What are the advantages of a rational scale?

A
  • draw on theory to make predictions because scales are designed to measure theory’s concepts
45
Q

What are the disadvantages of a rational scale?

A
  • usefulness is tied to validity of theory used

- transparent nature of scales, not difficult to understand what item measures

46
Q

What are empirical scales?

A
  • scales that rely on criterion keying for validity

- only items that clearly separate one group from another would be used

47
Q

What are rational-empirical scales?

A
  • combine aspects of both rational and empirical approaches

- allows test developers to utilize advantages of each method

48
Q

What are factors that affect test scores?

A
  • lasting and general
  • lasting and specific
  • temporary and general
  • temporary and specific
  • testing situation
  • chance factors
49
Q

What is the goal of reliability?

A

to estimate errors in measurement, suggest ways of improving tests so errors are minimized

50
Q

How does test-retest estimate reliability?

A

directly assess degree to which test scores consistent from one administration to the next

51
Q

How does alternate forms method work?

A
  1. administer one form of test to group
  2. administer alternate form of same test to same group
  3. correlate scores of both tests to estimate reliability
52
Q

How does split-half method work?

A
  1. administer test to group
  2. split test in half
  3. correlate 2 halves to estimate reliability
53
Q

How does internal consistency method work?

A
  1. administer test to group
  2. compute correlations among all items and averages of inter-correlations
  3. using formula to estimate reliability