Module 1: Psychometric Properties and Principles Flashcards

1
Q

Psychological Testing

A

+ process of measuring psychology-related variables by means of devices or procedures designed to obtain a sample of behavior
+ numerical in nature
+ individual or by group
+ administrators can be interchangeable without affecting the evaluation
+ requires technician-like skills in terms of administration and scoring
+ yield a test score or series of test score
+ minutes to few hours

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Psychological Assessment

A

+ gathering and integration of psychology-related data for the purpose of making a psychological evaluation
+ answers referral questions through the use of different tools of evaluation
+ individual
+ assessor is the key to the process of selecting tests and/or other tools of the evaluation
+ requires an educated selection of tools of evaluation, skills in evaluation, and thoughtful organization, and integration of data
+ entails logical problem-solving that brings to bear many sources of data assigned to answer the referral question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the types of psychological assessment?

A
  1. Educational
  2. Retrospective
  3. Remote
  4. Ecological Momentary
  5. Collaborative
  6. Therapeutic
  7. Dynamic
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Educational Assessment

A

evaluate abilities and skills relevant in school context

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Retrospective

A

draw conclusions about psychological aspects of a person as they existed at some point in time prior to the assessment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Remote

A

subject is not in physical proximity to the person conducting the evaluation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Ecological Momentary

A

“in the moment” evaluation of specific problems and related cognitive and behavioral at the very time and place that they occur

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Collaborative

A

the assessor and assesee may work as “partners” from initial contact through final feedback

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Therapeutic

A

therapeutic self-discovery and new understanding are encouraged

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Dynamic

A

describe interactive approach to psychological assessment that usually follows the model: evaluation > intervention of some sort > evaluation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Psychological Test

A

device or procedure designed to measure variables related to psychology

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are the parts/components of the psychological test and other related terms?

A
  1. Content
  2. Format
  3. Item
  4. Administration Procedures
  5. Score
  6. Scoring
  7. Cut-Score
  8. Psychometric Soundness
  9. Psychometrics
  10. Psychometrist or Psychometrician
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Content

A

subject matter

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Format

A

form, plan, structure, arrangement, layout

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Item

A

a specific stimulus to which a person responds overtly and this response is being scored or evaluated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Administration Procedures

A

one-to-one basis for group administration

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Score

A

code or summary of statement, usually but not necessarily numerical in nature, but reflects an evaluation of performance on a test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Scoring

A

the process of assigning scores to performances

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Cut-Score

A

reference point derived by judgment and used to divide a set of data into two or more classification

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Psychometric Soundness

A

technical quality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Psychometrics

A

science of psychological measurement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Psychometrist or Psychometrician

A

refer to professional who uses, analyzes, and interprets psychological data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Ability or Maximal Performance Test

A

assess what a person can do

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What are the types of ability tests?

A
  1. Achievement
  2. Aptitude
  3. Intelligence
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Achievement Test

A

+ measurement of the previous learning
+ fact-based or conceptual

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What are achievement tests used for?

A

+ used to measure general knowledge in a specific period of time
+ used to assess mastery

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What do achievement tests rely on?

A

relies mostly on content validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Aptitude Test

A

refers to the potential for learning or acquiring a specific skill

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What do aptitude tests tend to focus on?

A

tends to focus on informal learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What do aptitude tests rely on?

A

rely mostly on predictive validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Intelligence Test

A

refers to a person’s general potential to solve problems, adapt to changing environments, abstract thinking, and profit from experience

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

Human Ability

A

considerable overlap of achievement, aptitude, and intelligence test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Typical Performance Test

A

+ measure usual or habitual thoughts, feelings, and behavior
+ indicate how test takers think and act on a daily basis
+ no right and wrong answers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

What kind of scale do typical performance tests use?

A

uses interval scales

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

Personality Test

A

+ measures individual dispositions and preferences
+ designed to identify characteristic
+ measured ideographically or nomothetically

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

What are the different types of personality tests?

A
  1. Structured Personality Tests
  2. Projective Personality Tests
  3. Attitude Tests
  4. Interest Inventories
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

Structured Personality Tests

A

provide statement, usually self-report, and require the subject to choose between two or more alternative responses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

Projective Personality Tests

A

unstructured, and the stimulus or response are ambiguous

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

Attitude Tests

A

elicit personal beliefs and opinions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

Interest Inventories

A

measures likes and dislikes as well as one’s personality orientation towards the world of work

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

Aside from the main four kinds of psychological tests, what are other kinds of psychological tests?

A
  1. Speed Tests
  2. Power Tests
  3. Values Inventory
  4. Trade Test
  5. Neuropsychological Test
  6. Norm-Referenced Test
  7. Criterion-Referenced Tests
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

Speed Tests

A

the interest is the number of times a test taker can answer correctly in a specific period

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

Power Tests

A

reflects the level of difficulty of items the test takers answer correctly

44
Q

Interview

A

method of gathering information through direct communication involving reciprocal exchange

45
Q

What are the types of interviews?

A
  1. Standardized/Structured
  2. Non-standardized/Unstructured
  3. Semi-Standardized/Focused
  4. Non-Directive
46
Q

Standardized/Structured

A

questions are prepared

47
Q

Non-standardized/Unstructured Interview

A

pursue relevant ideas in depth

48
Q

Semi-Standardized/Focused

A

may probe further on specific number of questions

49
Q

Non-Directive

A

subject is allowed to express his feelings without fear of disapproval

50
Q

What are examples of interviews?

A
  1. Mental Status Examination
  2. Intake Interview
  3. Social Case
  4. Employment Interview
  5. Panel Interview (Board Interview)
  6. Motivational Interview
51
Q

Mental Status Examination

A

determines the mental status of the patient

52
Q

Intake Interview

A

determine why the client came for assessment; chance to inform the client about the policies, fees, and process involved

53
Q

Social Case

A

biographical sketch of the client

54
Q

Employment Interview

A

determine whether the candidate is suitable for hiring

55
Q

Panel Interview (Board Interview)

A

more than one interviewer participates in the assessment

56
Q

Motivational Interview

A

used by counselors and clinicians to gather information about some problematic behavior, while simultaneously attempting to address it therapeutically

57
Q

Portfolio

A

samples of one’s ability and accomplishment

58
Q

Case History Data

A

refers to records, transcripts, and other accounts in written, pictorial, or other form that preserve archival information, official and informal accounts, and other data and items relevant to an assessee

59
Q

Case Study

A

a report or illustrative account concerning a person or an event that was compiled on the basis of case history data

60
Q

Groupthink

A

result of the varied forces that drive decision-makers to reach a consensus without critical reasoning or evaluation of the consequences or alternatives

61
Q

Behavioral Observation

A

monitoring of actions of others or oneself by visual or electronic means while recording quantitative and/or qualitative information regarding those actions

62
Q

Natural Observation

A

observe humans in natural setting

63
Q

SORC Model

A

Stimulus, Organismic Valuables, Actual Response, Consequence

64
Q

Role Play

A

defined as acting an improvised or partially improvised part in a stimulated situation

65
Q

Role Play Test

A

assesses are directed to act as if they are in a particular situation

66
Q

What are other tools used for psychological assessment?

A

Biofeedback devices (e.g. computers, physiological devices)

67
Q

Steps in the Psychological Assessment Process

A
  1. Determining the referral question
  2. Acquiring knowledge relating to the content of the problem
  3. Data collection
  4. Data interpretation
68
Q

Hit Rate

A

accurately predicts success or failure

69
Q

Profile

A

narrative description, graph, table. Or other representations of the extent to which a person has demonstrated certain targeted characteristics as a result of the administration or application of tools of assessment

70
Q

Actuarial Assessment

A

an approach to evaluation characterized by the application of empirically demonstrated statistical rules as determining factor in assessors’ judgement and actions

71
Q

Mechanical Prediction

A

application of computer algorithms together with statistical rules and probabilities to generate findings and recommendations

72
Q

How many levels of interpretation are there in psychological assessment?

A

There are 3 levels.

73
Q

Level 1 (levels of interpretation)

A

+ there is a minimal amount of any sort of
interpretation
+ minimal concern with intervening processes
+ data are primarily treated in a sampling or correlate way
+ no concern with underlying constructs
+ found in large-scale selection testing
+ for psychometric approaches

74
Q

Level 2 (level of interpretation)

A

a. Descriptive Generalizations
b. Hypothetical Construct

75
Q

Hypothetical Construct

A

the assumption of an inner state which goes logically beyond the description of visible behavior

76
Q

Level 3 (level of interpretation)

A

+ the effort to develop a coherent and inclusive theory of the individual life or a “working image” of the patient
+ the clinician attempts full scale exploration of the individual’s personality, psychosocial situation, and developmental history

77
Q

Extra-Test Behavior

A

observations made by an examiner regarding what the examinee does and how the examinee reacts during the course of testing that are indirectly related to the test’s specific content but of possible significance to interpretation

78
Q

What are the parties in psychological assessment?

A
  1. Test Author/Developer
  2. Test Publishers
  3. Test Reviewers
  4. Test Users
  5. Test Takers
  6. Test Sponsors
  7. Society
79
Q

Test Author/Developer

A

creates the tests or other methods of assessment

80
Q

Test Publishers

A

they publish, market, sell, and control the distribution of tests

81
Q

Test Reviewers

A

prepare evaluative critiques based on the technical and practical aspects of the tests

82
Q

Test Users

A

uses the test of assessment

83
Q

Test Takers

A

those who take the tests

84
Q

Test Sponsors

A

institutions or government who contract test developers for various testing services

85
Q

Test Battery

A

selection of tests and assessment procedures typically composed of tests designed to measure different variables but having a common objective

86
Q

Assumptions about Psychological Testing and Assessment

A

Assumption 1: Psychological Traits and States Exist
Assumption 2: Psychological Traits and States can be Quantified and Measured
Assumption 3: Test-Related Behavior Predicts Non-Test-Related Behavior
Assumption 4: Test and Other Measurement Techniques have strengths and weaknesses
Assumption 5: Various Sources of Error are part of the Assessment Process
Assumption 6: Testing and Assessment can be conducted in a Fair and Unbiased Manner
Assumption 7: Testing and Assessment Benefit Society

87
Q

Trait

A

+ any distinguishable, relatively enduring
way in which one individual varies from another
+ permits people to predict the present from the past
+ characteristic patterns of thinking, feeling, and behaving that generalize across similar situations, differ systematically between individuals, and remain rather stable across time

88
Q

Psychological Trait

A

+ intelligence, specific intellectual abilities, cognitive style, adjustment, interests, attitudes, sexual orientation and preferences, psychopathology, etc.
+ exists as a construct

89
Q

States

A

+ distinguish one person from another but are relatively less enduring
+ characteristic pattern of thinking, feeling, and behaving in a concrete situation at a specific moment in time

90
Q

Construct

A

an informed, scientific concept developed or constructed to explain a behavior, inferred from overt behavior

91
Q

Overt Behavior

A

an observable action or the product of an observable action

92
Q

Assumption 1: Psychological Traits and States Exist

A

+ Trait is not expected to be manifested in behavior 100% of the time
+ Whether a trait manifests itself in observable behavior, and to what degree it manifests, is presumed to depend not only on the strength of the trait in the individual but also on the nature of the action (situation-dependent)
+ Context within which behavior occurs also plays a role in helping us select appropriate trait terms for observed behaviors
+ Definition of trait and state also refer to a way in which one individual varies from another
+ Assessors may make comparisons among people who, because of their membership in some group or for any number of other reasons, are decidedly not average

93
Q

Do traits always manifest in behavior?

A

No. Trait is not expected to be manifested in behavior 100% of the time

94
Q

A trait being observable is dependent on what factors?

A

Whether a trait manifests itself in observable behavior, and to what degree it manifests, is presumed to depend not only on the strength of the trait in the individual but also on the nature of the action (situation-dependent)

95
Q

What is another factor that plays a role in helping professionals select appropriate trait terms for observed behaviors?

A

Context within which behavior occurs also plays a role in helping us select appropriate trait terms for observed behaviors

96
Q

What does the definition of trait and state refer to?

A

Definition of trait and state also refer to a way in which one individual varies from another

97
Q

What may assessors do in terms of traits and states?

A

Assessors may make comparisons among people who, because of their membership in some group or for any number of other reasons, are decidedly not average

98
Q

Assumption 2: Psychological Traits and States can be Quantified and Measured

A

+ Once the trait, state or other construct has been defined to be measured, a test developer consider the types of item content that would provide insight to it, to gauge the strength of that trait
+ Measuring traits and states means of a test entails developing not only appropriate tests items but also appropriate ways to score the test and interpret the results

99
Q

Cumulative Scoring

A

assumption that the more the testtaker responds in a particular direction keyed by the test manual as correct or consistent with a particular trait, the higher that testtaker is presumed to be on the targeted ability or trait

100
Q

Assumption 3: Test-Related Behavior Predicts Non-Test-Related Behavior

A

+ The tasks in some tests mimics the actual behaviors that the test user is attempting to understand
+ Such tests only yield a sample of the behavior that can be expected to be emitted under nontest conditions

101
Q

Assumption 4: Test and Other Measurement Techniques have strengths and weaknesses

A

Competent test users understand and appreciate the limitations of the test they use as well as how those limitations might be compensated for by data from other sources

102
Q

Error

A

+ refers to something that is more than expected; it is component of the measurement process
+ refers to a long-standing assumption that factors other than what a test attempts to measure will influence performance on the test

103
Q

Error Variance

A

the component of a test score attributable to sources other than the trait or ability measured

104
Q

What are the potential sources of error variance?

A
  1. Assessors
  2. Measuring Instruments
  3. Random errors such as luck
105
Q

Classical Test Theory

A

each testtaker has true score on a test that would be obtained but for the action of measurement error

106
Q

Assumption 6: Testing and Assessment can be conducted in a Fair and Unbiased Manner

A

+ Despite best efforts of many professionals, fairness-related questions and problems do occasionally rise
+ In all questions about tests with regards to fairness, it is important to keep in mind that tests are tools ꟷthey can be used properly or improperly

107
Q

Assumption 7: Testing and Assessment Benefit Society

A

Considering the many critical decisions that are based on testing and assessment procedures, we can readily appreciate the need for tests