SSR exam 5 Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

testlets

A

multiple items that have the same context

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

facet method

A

item construction by conceptual analysis of the construct (using exising theory/knowledge) every aspect (facet) of the construct is measured in a systematic way

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

validity

A

degree to which a test measures what it is supposed to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

construct validity

A

the degree to which test cores can be interpreted as reflecting a particular psychological construct/ the extentto which relationships between observations are aligned with the nomoloigcal network

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

face validity

A

the degree to which a measure appears to be related to a specific construct, in the judgment of nonexperts such as testtakers and representatives of the legal system

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

content validity

A

degree to which the content of a measure truly reflects the full domain of the construct for which it is being used no more and no less

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

internal structure of a test

A

the way the parts of a test are related to each other

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

factors

A

items that are highly correlated with eachother form clusters of items

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

convergent evidence

A

the degree ot which test scores are correlated with tests of related constructs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

discriminant evidence

A

the degree to which test scores are uncorrelated with tests of unrelated constructs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

concurrent validity evidence

A

refers to the degree to whcih test scores are correlated with ther relevant variables that are measured at the same time as the primary test of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

predictive validity evidence

A

refers to the degree to which test scores are correlated with relevant variables that are measured at a future point in time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

criterion validity

A

extent to which a measure is related to an outcome

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

inductive approach

A

proceeds by examining the associations between test scores and a large set of potentially important and relevant psychological variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

deductive approach to validity

A

test evaluation proceeds by deducing a particular hypothesis from the theoretical basis of a construct and then empirical evaluating the accuracy of the hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

item writing guidelines

A

dont ask two questions in one, use independent item content (no dependency between questions), avoid items that deliberately deceive test takers, use three options unless it is easy to write plausible distractors, avoid negatives, use one option that is unambiguously the correct or best option, avoid giving clues in the correct answer(long answer),

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

construct validity steps to follow

A
  1. define a construct in terms of a network of relationships
  2. operationalize every cnstruct with a measurement
  3. see if the relationships between measurements are aligned with the theory
  4. if yes : there is support for a theory in question
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

interpretationist account redefine validity

A

as an assessment of evidence with regards to proposed interpreations of the test scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

causal account of validity

A

test X is valid for attribute Y when differenes in Y cause differences in X. we have to establish a causal relationship between construct and the test only then can we conclude that a test is valid

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

response processes

A

the match between the psychological process that respondents actually use when completing a measure and the process that they should use

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

test utility

A

refers to using a test as a tool

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

criterion

A

what we want to predict (good employees or good students)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

predictor

A

the test we use to predict

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

predictive validit

A

defined as the correlation between the predictor/test score and the criterion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

base rate

A

cut off for the criterion (when we truly know someone is competent).
percentage of correct conlcusions when not selecting TP+FN/N

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

selection ratio

A

cut off for the predictor (at what predictor score we want to select someone)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

hit rate

A

(percentage of correct conclusions) TP+TN/N

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

benefit

A

hit rate-base rate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

sensitivity

A

the percentage of eligible candidates that will be selected = TP/(FN+TP)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

specififcity

A

percentage of inapt candidates that will be rejected = TN/(TN+FP)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

two factors influencing the cell values “the proportion satisfactory among those selected”

A

predictive validity, selection ratio

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

increase validity

A

higher reliability(more items deleting bad items), use better predictor, less restriction of range

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

principle cmponent analysis

A

statistical procedure that uses an orthogonal transofmration to converta set of observations of posssibly correlated variables into a set of values of linearly uncorrelated variables called principle components

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

nomonoligical network

A

network of “meaning” surrouring a construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

validity generalization

A

process of evaluating a tests validity coefficients across a large set of studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

shared method variance

A

the correlatin is positive because it is based on two measures derived from the same source

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

heterotrait-heteromethod correlations

A

based on measures of different constrructs measured thorugh different methods

38
Q

heterotrait-monomethod correlations

A

based on measures of different constructs measure through the same method

39
Q

monotrait-heteromethod correlations

A

based on measures of the same construct measured through different methods

40
Q

monotrait-monomethod correlations

A

based on measures of the same construct measured through the same method

41
Q

factor analysis

A

attempts to achieve parsimony by explaining the maximum amount of common variance in a correaltion matrix using the smallest number of explanatory constructs.

42
Q

PCA

A

ties to explain the maximum amount of total variance (not just common variance) in a correlation matrix by transforming the originial variables that correlate highly with each other

43
Q

factor loading

A

the coordinate of a variable along a classification axis

44
Q

common factors

A

factors that explain the correlations between variables

45
Q

unique factors

A

factors that cannot explain the correlation between variables

46
Q

factor scores

A

sould be possible to estimate a person’s score on a factor, based on their scores for the constituent variables

47
Q

commn variance

A

some of it will be shared wiht other variables or measures

48
Q

unique variance

A

some of it will be specific to that measure

49
Q

random/error variance

A

variance that is specific to one measure but not reliably so

50
Q

communcality

A

the proportion of common variance present in a variable

51
Q

factor extraction

A

the process of deciding how many factors to keep

52
Q

scree plot

A

plotting each eigenvalue (y-axis) against the factor with which it is associated (x-axis)

53
Q

kaisers criterion

A

to retain factors with eigenvalues greater than 1

54
Q

factor rotation

A

rotates axis with variables that can be plotted and rotates them such that tvariables are loaded maximally to only one factor

55
Q

orthogonal rotation

A

we rotate factors while keeping the independent or uncorrelated

56
Q

oblique rotation

A

allows factors to correlate

57
Q

quartimax rotation

A

attempts t maximinze the spread of factor loadings for a variable across all factors

58
Q

varimax rotation

A

it attempts to maximize the dispersion of loadings within factors

59
Q

equamax

A

hybrid of the otehr two approaches

60
Q

direct oblimin

A

determines the degree to which factors are allowed to correlate by the value of a constant called delta

61
Q

factor transformation matrix

A

used to convert the unrotated factor loadings into the rotated ones

62
Q

KMO

A

varies between 0 and 1. 0 means that the sum of partial correlations is large relative to the sum of correlations indicating diffusion in the pattern of correlations. 1 means indicates that patterns of correlations are relatively compact and so factor analysis should yield distinct and reliable factors.

63
Q

multicollinearity

A

variables that are very high correlated

64
Q

singularity

A

variables that are perfectly correlated

65
Q

split-half reliability

A

splits the scale set into two randomly seleected sets of items

66
Q

utility analysis

A

a family of tehcniques that entail a cost-benefit analysis designed to yield information relevant to a decision about the usefulness and or practical value of a tool of assessment

67
Q

selection ratio

A

numerical value that reflects the relationship between the number of people to be hired and the number of peole available to be hired

68
Q

base rate

A

refers to the percentage of people hired under the existing system for a particular position

69
Q

top-down selection

A

process of awarding available positions to applicants whereby the higherst scoreri is awarded the first position, the next scorer get the next position

70
Q

hit

A

correct classification

71
Q

miss

A

incorrect classification; a mistake

72
Q

hit rate

A

prop of people that an assdssment tool accurately identifies as possessing or exhibiting a particular trait ability behaviour or attribute

73
Q

miss rate

A

prop of people that an assdssment tool inaccurately identifies as possessing or exhibiting a particular trait ability behaviour or attribute

74
Q

false positive

A

specifc type of miss whereby an assessment tool falsely indicates that the testtaker possesses or exhibits a particular trait ability behaviour or atribute

75
Q

false negative

A

specifc type of miss whereby an assessment tool falsely indicates that the testtaker does ot possesses or exhibits a particular trait ability behaviour or atribute

76
Q

true positive

A

the test leads test users to a correct identifiction of a test taker who truly has the disorder

77
Q

true negatvie

A

test leads test users to a correct identification of a test taker who truly does not have the disorder

78
Q

item response theory

A

provide a way to model the probability that a person with X ablity will b able to perform at a level of Y

79
Q

difficulty in a test item

A

refers to te attribute of not being easily accomplished, solved or comprehended

80
Q

discrimination

A

signifies the degree to which an item differentiates among people with higher or lower levels of the trait ability or whatever it is that is being measured.

81
Q

dichotomous test items

A

test items or questions with three or more alternative respones where only one is scored correct or scored as being consistent wiht a targeted trait or construct

82
Q

polytomous test items

A

test items or questions with three or more alternative responses where only one is scored correct or scored as being consistent with a targeted trait or other construct.

83
Q

unidimensionality assumption

A

the set of items measures a single continuous latent construct

84
Q

theta level

A

reference to the degree of the underlying ability or trait that the testtaker is presumed to bring to the test

85
Q

local independence

A

the latent trait explains all item correlations/ there is a systematic relationship between all of the test items and that relationship has to do with the theta level of the testtaker

86
Q

assumption of monotonicity

A

the higher the trait, te higher the expected score / means that the probability of endorsing or selecting an item response indictive of higher levels of theta should increase as the underlying level of theta increases

87
Q

item characteristic curve

A

the probalistic relationship between a testtaker’s response to a test item and that testtaker’s level on the latent construct being measured by the test is eexpressed in graphic form

88
Q

maximum performance test

A

responsees are partly correct or incorrect

89
Q

typical performance test

A

you respond in a way that s typical for you

90
Q

classical test theory

A

body of related sychometric theory that predict outcomes of psychological testing such as the difficulty of items or the ability of test takers

91
Q

psychometrics

A

measrement of phenomena like knowledge abilities attitudes emotions and personal characteristics