Exam 1 Flashcards
1
Q
You can have _________ without _________ but the opposite is not true
A
Reliability &; validity
Reliability is a prerequisite to validity
2
Q
What an instrument measures and how well it does that task
A
Validity
3
Q
The degree to which the evidence indicated that the items, questions, or tasks adequately represent the intended behavior domain
A
Content-related Validity
4
Q
Concerns the extent to which the instrument may measure a theoretical or hypothetical construct or trait
A
Construct Validity
5
Q
The degree to which test scores are consistent, dependable, stable, and repeatable
A
Reliability
6
Q
a reliability coefficient is calculated simply by correlating the performance on the first administration with the performance on the second. It is expected that the variation in scores between the 1st and 2nd would relate to random error because everything else should be the same
A
Test-Retest
7
Q
Individuals are given one form of the instrument initially and then are assessed with a second alternate form of the instrument; scores are correlated
A
Parallel forms
8
Q
What was the original purpose for the MMPI? Were they successful?
A
To diagnose psychiatric illnesses; NO
9
Q
Who created the MMPI?
A
Hatheway & Mckenley
10
Q
4 Important Content areas to cover in an interview?
A
Identifying information, History of the problem, family background/history, Developmental history, age specific information, ethnic/cultural considerations
11
Q
What is the difference between the content-related procedure & empirical criterion keying?
A
the rational approach basically looks at content relevance of the items
Items are selected based on their relationship to some external criterion rather than on their content; MMPI items selected that separated people who were considered normal from those who were diagnosed with some form of psychopathology
12
Q
What does validity refer to in regards to MMPI?
A
Describes test taking attitude; whether or not they endorse the test in some distorted manner
13
Q
MMPI I content scales
A
hostility scales
Alcoholism Scale
14
Q
MMPI-2 content scales
A
ANX The anxiety Scale
DEP The Depression Scale
15
Q
What is the Code type?
A
The 1 or two highest clinical scales at or above a T score of 65 with the most elevated one first
Scale 3T=69; Scale 6T=65 (3-6)
Scale 3T=70; Scale 6T=70 (3-6)
90 possible code types
16
Q
Clinical Scale #1
A
Hs Hypochondriasis Scale: Indicates concern with physical symptoms and fear of bodily harm
17
Q
Clinical Scale #2
A
D Depression: measures depressive symptoms and psychic energy
18
Q
Clinical Scale #3
A
HY Hysteria: indicates awareness of problems and vulnerabilities, and social comfort
19
Q
Clinical Scale #4
A
Pd Psychopathic Deviate: measures conflict, struggle, respect for society’s rules, anger, social poise, and exploitation
20
Q
Clinical Scale #5
A
Mf Masculinity/Femininity: Male-Female, indicates interest in activities & behaviors that are stereo-typically masculine or feminine
21
Q
Clinical Scale #6
A
Pa Paranoia: Indicates level of trust, sensitivity, and suspiciousness
22
Q
Clinical Scale #7
A
Pt Psychasthenia: detects worry , anxiety, doubts, tension, discomfort, and obsessiveness
23
Q
Clinical Scale #8
A
Sc Schizophrenia: Measures odd thinking and social alienation
24
Q
Clinical Scale #9
A
Ma Hypomania: indicates level of excitability and psychic energy
25
Clinical Scale #0
Si Social Introversion: indicates people orientation
26
What are the general objectives of an interview?
* Gather information not otherwise easily obtained
* Establish a relationship conducive to obtaining the information
* Develop greater understanding in both the interviewer and interviewee of the specific problem behavior
* Provide direction and support in helping the interviewee deal with problem behaviors
27
What is Standard Deviation?
a measure of the variability or spread of scores in a group; it is the positive square root of the variance
```
variance = 25
SD= 5
```
28
In terms of correlation, what determines a strong relationship?
-/+ 1
29
What is a norm referenced instrument and what do you need to evaluate to determine if that instrument is appropriate?
what does norm refer to?
is the norm group appropriate?
size?
sample comparable in terms of sex, age, ethnic, SES, education level, and geographic representation
large samples are better
how did they select the norm group? (simple random sample/ stratified sample/ cluster sampling)
30
These forms of reliability examine the instrument "internally" to determine its consistency or lack of error
split-half reliability, spearman-brown formula, Kuder-Richardson formulas, coefficient alpha
31
______ instruments compare an individual's performance with a standard or criterion
criterion referenced
| need classification consistency for reliability evidence
32
refers to how consistently different raters evaluate the answers to the items on the instrument
INTERrater reliability
33
Provides an estimation of the range of scores that would be obtained if someone were to take an instrument over and over again
SEM Standard Error of Measurement
| Reliability is related to results and the degree of error in those results
34
concerns the degree to which the instrument is unable to capture significant aspects of the construct
construct under-representation
35
refers to the degree to which scores or results are affected by factors that are extraneous to instrument's intended purpose
construct irrelevance
36
concerned the extent to which an instrument was systematically related to an outcome criterion
Criterion-related validity
37
Validity evidence based on response processes
analyzing the cognitive processing of the clients while they are taking the assessment is important in some assessment situations
the goal; think out aloud; question examinees about their performance strategies; examine subgroup differences
38
Validity evidence based on internal structure
an instrument may be designed to measure one clearly defined construct or it may have subtests or scales withing the instrument
Factor analysis (a statistical technique used to analyze the interrelationships of a set or sets of data): exploratory (explore the factor structure of the instrument) & confirmatory (use existing structure of the instruments and examine whether the factor analysis matches or confirms that structure)
Differential Item Functioning (examines whether there are group differences in terms of the percentage of individuals who get the item correct
39
Validity evidence based on relations to other variables
Criterion-Related validity - correlate measure with a criterion measure known to be valid
- concurrent validity: when the criterion measure is collected at the same time as the measure being validated
- predictive validity: when the criterion is collected later. In order for a test to be a valid screening device for some future behavior, it must have predictive validity
40
The extent to which your items are tapping into the underlying theory or model of behavior. It's how well the items hang together (_______) or distinguish different people on certain traits or behaviors (________)
convergent validity; discriminant validity
41
Is closely related to correlation, is commonly used to determine the usefulness of a variable, or set of variables, in predicting another important or meaningful variable
regression
42
Another method that examines the relationship between an instrument and a criterion or predictor variable is ______ or _______. this approach is sometimes referred to as _________ because instruments are often used in decision making & this approach evaluates the accuracy of the decision making.
group separation; expectancy tables; decision theory
43
_______ occurs when the instrument predicts that individuals have "it" when in fact they do not
false positive
44
_______ occurs when the instrument predicts that test takers do not have it when in fact they do
false negative
45
The statistical procedure used to examine whether an instrument's validity can be generalized is meta-analysis
Validity Generalization
46
________ focuses on examining and evaluating each item within an assessment; examines the qualities of each item
Item analysis
47
______ is an index that reflects the proportion of people getting an item correct
item difficulty (.50 is optimum)
48
___________ provides an indication of the degree to which an item correctly differentiates among the examinees on the behavior domain of interest
Item discrimination
49
_________ builds on the concepts of item analysis; the focus is on arriving at one true score and our attempts to control error in the instrument
IRT Item Response Theory
50
a statistical technique used to analyze the INTERRELATIONSHIPS of a set or sets of data
Factor Analysis
51
What is intelligence influenced by?
Genes & Environment; we cant determine if one is more important than the other
52
What are the gender differences related to tasks on the intelligence test?
Male: better at visual/spatial tasks
Females: verbal fluency tasks
no general intellectual differences
53
What is the current thinking on ethnic differences between intellectual tests?
SES is a major determinant
54
What are the different types of achievement assessments?
screening tests and comprehensive tests; each type includes single subject tests and multiple subject tests
55
________ tests are brief tests containing one sub-test for each subject area covered; achievement
Screening
56
________ tests contain more than one sub-test per subject area and cover the subject area in depth; achievement
Comprehensive
57
Screening tests
* Usually simpler to administer and score
* Useful in determining whether a comprehensive test is necessary
* Results may be misleading; can overestimate or underestimate an individual's skills
* Do not measure other important achievement areas
Wide Range Achievement Test-4, Wechsler Individual Achievement Test - screener
58
Comprehensive Tests
* Must assess 3 or more subject areas typically taught in schools
* At least 2 different sub tests for each subject area
* Assess both lower and higher levels of cognitive skills within each subject area
Wechsler Individual Achievement Test-Comprehensive Test, Wookcock-Johnson III Tests of Achievement
59
_______ provide information about what an individual has learned or acquired.
Achievement Tests
60
________ predict future performance or ability to learn
Aptitude Tests
61
___________ is particularly critical because some researchers have found that it has more influence on est performance than either ethnicity or instrument bias
SES
62
An important concept to consider in interpreting assessment results with racially and ethnically diverse individual s is __________
acculturation
63
An instructor wants to know if an item is too difficulty or too easy on a test he should look at the ______
Item difficulty
64
Comprehensive Tests: the ______ the cognitive level assessed, the _____ reliable one can predict performance on higher levels; the ____ the level assessed, the more reliable the results
lower; less; higher
65
Many screening tests only assess ______ cognitive abilities; the lower the level assessed, ___ ability to predict overall achievement
lower; less
66
Categories of Achievement TESTS
- Survey Achievement Batteries
- Individual & Diagnostic Achievement Tests
- Criterion-referenced Tests & Minimum-level skills assessments
- Subject Area Tests
67
Scale 4-5-6 configuration; 4&6 above T score of 65
Scarlett O'Hara V
68
Scales 6-7-8 configuration; 6&8 high; all above 65
Psychotic "V" or Paranoid Valley
69
Validity scale Configuration
LFK
70
Scale 1-2-3
Neurotic Triad Configuration
71
What is the mean of an IQ test? SD?
100 &; 15
72
What happens to the SEM as the reliability coefficient increases?
less error; decreases
73
variance, SD, & Range are all measures of
dispersion/spread
74
Classical Test Theory
Observed score = True score + error
75
Scales of measurement
nominal, ordinal, ratio, equal interval
76
A scale in which the variable values are NAMES that have no inherent relationship among themselves, even if their names are numbers; all you can determine is frequency; no indication of amount or magnitude
NOMINAL! Order does not matter!
77
Provides a measure of magnitude; a scale that orders or ranks info on some kind of continuum (1st or last) but does not have an equal difference between the ranks
ORDINAL! ORDER MATTERS
78
The unites are in equal intervals; Scales without an absolute zero (such as temperature; have properties of ordinal data and interval between observations is expressed in terms of a fixed unit of measure; always numeric
Equal Interval scales; common IQ tests use this
79
The data have all the properties of interval data and the ratio of two values is meaningful; when ________ are used, all math operations can be used;
ratio scales; distance, height, weight, and time
| Scale must contain a zero value!
80
mean is skewed right in the tail
positive skew
81
mean is skewed left in the tail
negative skew
82
_______ or ________ indicate the percentage of people in the norming group who had a score at or below a given raw score
percentile scores or percentile ranks
83
Can an instrument be unreliable & valid?
NO
84
Who has the ultimate responsibility for using an instrument appropriately?
The clinician! ME!
85
Counselors use assessment as one component of the counseling process, taking into account the clients personal and cultural context
TRUE
86
Counselors must know the limits of their competencies in the area of assessment and that counselors only use the testing and assessment services for which they have been adequately trained and are competent to use
TRUE
87
counselors explain to clients the nature and purposes of the assessment and the specific use of results
TRUE
88
A counselor can only release assessment data in which a client's identity is revealed with the consent of the client or the client's legal representative
TRUE
89
Counselors are required to recognize that culture influences the manner in which clients' problems are defined and experienced
TRUE
90
Counselors need to carefully consider an instrument's reliability, validation evidence, psychometric limitation, and appropriate use within selecting assessment instruments
TRUE
91
Counselors administer assessments under the same conditions that were established in their standardization; ensure that technologically administered assessments function properly and provide clients with accurate results
TRUE
92
Consider assessment issues related to age, color, culture, disability, ethnic group, gender, race, language preference, religion, spirituality, sexual orientation, and socioeconomic status
TRUE
93
Consider the client's personal and cultural background when reporting assessment results & consider the level of the client's understanding of the results and the impact of the results on the client
TRUE
94
We have the responsibility in regards to maintaining the integrity and security of tests and assessments consistent with legal and contractual obligations
TRUE
95
It is not appropriate to use an outdated or obsolete version of an instrument
TRUE
96
Counselors do not provide therapeutic or counseling services to individuals for whom they are evaluating for forensic purposes
TRUE
97
Review 10 postulates
How counselors should use assessment
98
Is it appropriate to diagnose someone based on a elevations scale of the MMPI-2?
no
99
What was the contrasting group or the criterion group of the MMPI clinical scales?
patients with psychiatric diagnoses
100
Should the client report current or past feelings when answering question regarding the MMPI?
current; two weeks
101
Who created the MMPI?
Hathaway & McKinley
102
What are the four pillars of assessment?
Norm-referenced Tests
Interviews
Observations
Informal Assessment Procedures
103
Conversion V
Neurotic Triad Configuration: 1&2 above 65
104
How do we interpret assessment results of an individual from another culture or ethnicity?
* Comprehensive knowledge of the clients culture
* Acculturation
* Detailed info about the instrument's characteristics
105
What is the first step in identifying appropriate assessment strategies?
identify what info is needed; what are you trying to find out?
106
Laws
body of rules
107
Ethics
body of principles
108
What evidence is needed to translate an instrument in another language
reliability & validity
retains meaning
equivalent to original (difficulty level)
109
Sometimes the design of an instrument does not correspond to the purpose
TRUE
110
With a criterion referenced instrument, it is important that the clinician evaluates what?
The validity of the criterion for the assessment; the procedures the developers used to come up with the criterion
111
Sufficient knowledge about the specifics of an appraisal instrument can only be gained through.....
a thorough examination of the test, manual, and materials
112
Communication of he test/assessment results....
should be an intricate part of the counseling process
113
Clients prefer the interpretation of assessment results in group settings
FALSE
114
____ interpretations are reported to be more helpful than ______ interpretations
tentative; absolute
115
When sharing the assessment results with parents, counselors should keep the following in mind except:
parents only need to review results once
116
What is the core of the psychological report?
Interpretation
117
Initial intake interviews focus on:
relevant background info of current problems
pertinent details about current situation
range/scope of clients problems
(all of above)
118
An affective interview should gather information &
build repore
119
When assessing and defining different problems that a client is experiencing it is important to:
-identify previous methods client has used to solve problem
-problem intensity
-explore the problem from multiple prospective
(all of the above)
120
When interviewing the client, counselors need to attend to the process & content
TRUE
121
Clients who perceive their counselors as ________, _______, & ________ tend to have better outcomes
trustworthy, expert, attractive
122
What should you do if a client is being disruptive or has an outburst?
don't stop it right away, observe first
123
A _____ interview consists of an established set of questions that are asked the same manner and sequenced to each client
structured
124
One of the major advantages of a structured over unstructured interview is....
it is more reliable
125
Whats a major advantage to an unstructured interview?
you can modify and design it to respond to specific things (open ended Q)
126
When conducting an interview with a client from another culture, counselors should....
consider the degree in which self disclosure is encouraged in that culture
127
If an instrument is found to have CONTENT more familiar to one ethnic group than another it would have what kind of bias?
Content bias
128
The content may be more familiar or appropriate for one group as compared with another group
Content bias
129
A method for analyzing the relative difficulty of individual items for different racial or ethnic groups
Differential item Functioning
130
Another method for detecting possible instrument bias is to examine the instrument's ___________
Internal structure; can involve looking at factor structure
131
The analyses of possible bias should also include studies related to the relationship between the ________and the ________for different groups
instrument; criterion
132
With correlation, the _______ the sample, the larger the correlation coefficient needs to be in order to be significant
smaller
133
If an instrument yields validity coefficients that are significantly different for two or more groups, then this difference is described as ________
slope bias
134
Counselors can expect to be involved in either formal or informal assessment of clients from cultures other than their own.
TRUE
135
What does academic achievement refer to?
What the student has learned from direct intervention or instruction
136
What does an achievement test assess?
mastery of skills and abilities from direct intervention or instruction
137
What does an aptitude test assess?
future academic or vocational performance
138
Name 2 types of achievement tests
screening & comprehensive
139
Which type of test constitutes the largest # of achievement tests out there? (which are the most frequently occurring?)
single subject tests given by teachers
140
Screening basically tells you if you need to take a comprehensive test
TRUE
141
essentially nonverbal, relatively culture free mental efficiency; it includes adaptive and new learning capabilities and is related to mental operations and processes
Fluid intelligence
142
The knowledge and skill that one requires over time and increases throughout time. Vocab and general knowledge are ways to assess that; refers to acquired skills and knowledge that are developmentally dependent on exposure to culture. it involves over learned and well established cognitive functions and is related to mental products and achievements; it is highly influenced by formal and informal educational factors
Crystallized Intelligence
143
Many theorists have developed their own intelligence test to assess their definition of intelligence
TRUE
144
The WISC 4 & WAIS4 are instruments that assess a different age range
TRUE
WCIS: Weshler Intelligence Scale for Children
WAIS: Weshler Adult Intelligence Scale
145
Probably the most important means of data collection during a psychological evaluation is the __________
assessment interview
146
How a counselor ______ the counseling process has been found to be critical to the effectiveness of the counseling!
Begins
147
Whiston recommends using ______ _______ questions require a more elaborate answer
open ended
148
A major advantage to a structured interview is that it's __________
More Reliable
149
In a ________ ________ counselors ask an established set of questions in the same manner and sequence for each client
structured interview
150
In an _________ _______ counselors might have an idea about possible items to address but gear the interview in a unique manner, depending on the client's needs
unstructured interview
151
A _______ ________ is a combination of the structured and unstructured interviews; certain questions are always asked, but there is room for exploration & additional queries
semi-structured
152
The advantage of ____ ___________ is that they can be easily adapted to respond to the unique needs of the client; however they are less reliable and are prone to more error than structured interviews.
unstructured interviews
153
What is the million dollar question in the interviewing process?
Is there anything I should know about that I haven't asked? especially after a structured interview
154
Tests that are developed by teachers and are specific
subject area tests
155
Who is the primary user of assessment results?
Client
156
Who is responsible for proper use of assessment?
the Counselor
157
Why do we have ethical guidelines?
to protect the client
158
Any results of the evaluation must be sufficient to substantiate the findings
TRUE
159
The use of scientific procedures is sometimes not required in test equipment
FALSE
160
Psychologist should only perform evaluations within the context of a professional relationship
TRUE
161
Validity error implies that there will always be some sort of ________in our measurements
inaccuracy
162
______ attempts to evaluate the contribution of various sources of error; the counselor is interested in the dependability or the "generalization", of the scores
Generalization Theory (domain sampling theory)
163
No test is completely reliable
TRUE
164
Validity does not exist in the abstract but must be anchored to _______ purposes for which the test is given
specific
165
Whiston's counseling process steps:
* Assessing the client problem(s)
* Conceptualizing & defining the client problems
* Selecting and implementing effective treatments
* Evaluating the counseling
166
High error =
low reliability
167
Large SD =
large SEM (confidence intervals) = low reliability
168
Correlations are all about _________
prediction; no cause and effect
169
Misuse of tests are due to ______________
lack of information
170
"STANDARDS"
Standards for educational and psychological testing
171
As of yet, there is NO culture-free assessment device
TRUE
172
Researchers have found that differences on intelligence tests and on the MMPI dissipate when African Americans and European Americans of equal SES are compared
TRUE
173
What is the most common method in assessment?
observation
174
What is the most widely used and researched assessment instrument?
MMPI-2
175
Items are selected based on their relationship to some external criterion rather than on their content
empirical criterion keying
176
A response set exists when an individual answers one question a certain way and then falls into the habit of answering similar questions in the same way; focus is on content relevance of the items1
Content-related procedure
177
Why was the MMPI revised?
the original norming group was tested in 1930s and consisted primarily of white, middle-class individuals from Minnesota... there is still debate about racial bias
178
Probably the most important means of data collection during a psychological evaluation is the _______ ________
assessment interview
179
A term that is sometimes used instead of intelligence is......
(g) general ability
180
An instrument that has fixed directions for the administration and scoring...
standardized
181
We no longer use the name of the scales because ______________
elevation does not equal diagnosis
182
Knowing the ______ of any individual is important in selecting any diagnostic test
Acculturation
