Assessment Flashcards
What is Spearman’s “g” factor?
General intelligence and he proposes that intelligence tests should easier intelligence without becoming clouded by specific abilities.
What is the Raven’s Progressive Matricies?
Series of abstract patterns with one piece missing - u pick out the missing piece using a multiple choice format. It’s one of the best non verbal tests of intelligence. It is also a novel task.
A criterion based score describes what?
How a person did in relation to some external criterion. Like a percentage tells us exactly how the person did on the test or how much the criterion was mastered.
What is face validity?
Not technical validity bit what the test seems to superficially measure. Whether it “looks” valid to the untrained eye.
What does a norm based score tell us?
Tells us how they did relative to other test takers and say nothing about how much they mastered the material. Like percentiles, standard scores, an. iQ scores are all norm based scores standards scores, Z scores, T scores).
What is construct validity?
Looks at how well a test measures an underlying construct using methods such as factor analysis, or the multi trait, multi method matrix.
What is criterion related validity?
Looks at how well a test predicts criterion outcome by correlating scores on the predictor test with a measure of outcome.
Who is more likely to commit suicide middle to high SES or low SES?
Middle to high
What is frame of reference training used for?
Frame of reference training is used to improve the accuracy of performance ratings. Frame of reference training provides raters with common performance standards to help raters become clear on what constitutes good and bad behavior. While such training may in fact reduce Raytee-based sources of error, such as personal biases and the halo effect; it made to decrease the effect of biases that lead to unfair discrimination, but the goal for frame of reference training is broader than the amount then the elimination of anyone specific source of error.
The problem with the WISC-IV for assessing gifted children is what regarding to it’s ceiling?
It has a low ceiling with the maximum possible IQ score of about 150 which is three standard deviations above the mean that’s limiting its effectiveness in assessing giftedness and children.
The problem with the WISC-IV for assessing mental retardation in children is what regarding to it’s floor?
It has a high floor or a minimum possible scores about 50 or three standard deviations below the mean. As a result this test cannot provide an accurate assessment of the level of mental retardation and someone with this disorder.
What would be a better test for giftedness or mental retardation then why?
The Stanford-Binet
Because it has a high ceiling of 180 and a much lower floor then the WISC
What are the validity scales on the MMPI-2?
L F K
What is the L scale on the MMPI-2?
The L scale is the lie scale. Elevation on scale L indicates a naïve attempt to look good.
What does an elevation on the K scale suggest?
The K scale is the guardedness scale. High scores suggest that the person is making a more sophisticated attempt to present himself in a positive light or fake good. Alone score on K is suggestive of someone who is excessively open, has poor ego strength, and tends to openly reveal his or her negative aspects.
On the validity scales on the MMPI two what does a V-shaped pattern usually’s say?
Faking good
What do elevations on the F scale reflect?
They reflect pathology or an attempt to present in a negative light.
What would an inverted V shaped pattern on the MMPI-2 validity scales represent?
Someone trying to present in a negative light like claimant in a malpractice suit or patient with schizophrenia
When a behavior is not discrete and has no clear beginning or end because in such instances is not possible to measure the number of times that a child is on task for example what kind of recording would we use?
Interval recording- The time period of observation is divided into smaller interval intervals, for example an hours divided into 12 five-minute intervals.
During interval sampling what is called when the observer notes what is the behavior was present at the moment the interval ends?
Momentary time sampling
During interval sampling what is it called when the observer notes whether the behavior was present for the entire duration of the interval?
Whole interval sampling
What is the event recording and when is it used?
Event recording, the observer simply record the number of times the target behavior occurs for example how many times the child made his bed. It is used is also called frequency recording any use for discreet, easily measured behaviors
What is content sampling as a source if error?
Error due to content sampling occurs when a test, by chance, has items that tap into a testtakers knowledgebase, or item that don’t happen to a testtakers knowledge.
Content sampling is a source of error when assessing the reliability of a test, in particular, alternate forms reliability and split half reliability.
What is purposive sampling?
Is sampling procedure for selecting subjects. It involves selecting a particular sample because it is believed to be representative of the population. For example test marketing a new product in Los Angeles because it is believed that how Los Angeles people view the product will be similar to how people and the rest of the country will be at the product.
What disorder has the highest rate of comorbidity with Tourette’s syndrome?
ADHD
The lifetime prevalence ratio of depression among women and men is what?
Two to one
What is diagnostic overshadowing?
Diagnostic overshadowing is a bias that negatively affects clinicians diagnostic accuracy when diagnosing persons with mental retardation and other developmental disabilities. In essence, the intellectual deficits are such a notable feature and persons with developmental disabilities that any accompanying more minor psychiatric disturbance tends to be overshadowed and therefore not diagnosed.
What is another term for item response theory?
Latent trait model
What are latent trait models used to establish?
They are used to establish a uniform scale of measurement that can be applied to individuals of varying ability and to test content of varying difficulty.
What is the premise of classical test theory?
Total variability in testtakers scores can be explained by combination of the tests reliability and error variability.
What is the prevalence of OCD in men versus women?
Equally common
What is the prevalence of OCD in girls versus boys?
It is much more common in boys and girls
At what age is the boys generally develop OCD?
Between six and 15
At what age do girls usually develop OCD?
Between the ages of 20 and 29.
What is it called when an employer’s rates and employee on one dimension influences ratings on other dimensions of the employees performance weather in a positive or negative direction?
The halo effect
What is it called when ratings are based on the employee’s most recent performance rather than on performance during the entire rating.?
The recency effect
What is it called when employers ratings of an applicant is influenced by prior applicants?
The contrast effect
What is it called when a rater uniformly evaluates candidates favorably?
A leniency bias
Autistic disorder is characterized by what three things?
Impairment in social interactions
Impairment in communication
Restricted repertoire of behavior
How common is autistic disorder in boys and girls?
4 to 5 times more common in males
What is the age of onset for autism and is prognosis best with late or early onset?
Before age 3
Best with late onset
What is a functional analysis of behavior?
Functional analysis of behavior involves looking at the behavior, its antecedents and consequences, as well as the contingencies and the reinforcers that served to maintain the behavior.
It researchers enlisted to design it early detection program for schizophrenia is fine example of primary secondary or tertiary prevention?
Secondary
What is the most established test children’s intelligence?
WISC IV
What is the most empirically validated theory Of human intelligence?
catell-horn-caroll theory
catell-horn-caroll theory is the foundation of popular test of aptitude and intelligence?
Woodcock Johnson III
What is a three stratum model, with general intelligence at the top level, broad cognitive abilities in the middle, and narrow cognitive abilities at the bottom?
catell-horn-caroll theory
What do we know about bipolar disorder with psychotic features related to both the mood and psychotic features?
When the mood symptoms we met the person does not experience psychotic symptoms.
What do we know about the mood and psychotic symptoms with schizoaffective disorder?
Mood and psychotic symptoms are concurrent except for a two-week period when there are psychotic symptoms without mood symptoms.
What are we testing when we are measuring subject on the same test at two point in time?
Test retest reliability
What are we call when we are measuring subjects onto similar versions of the test at two different points in time?
Alternate forms reliability
What can we do to specifically increase test reliability?
More items on a test
Homogeneity of the items
An unrestricted range of scores that results from a more heterogeneous sample
Difficulty of guessing
The Kappa coefficient would be used to measure what?
Interrater reliability
What are other measures of interrater reliability?
Percent agreement between raters
Pearson r between scores given by the raters
yules Y
Test retest reliability is typically expressed by the coefficient of what?
Stability
Parallel forms of reliability is typically expressed by the coefficient of what?
Equivalence
kuder-Richardson and Cronbach’s alpha are measures of what?
Internal consistency reliability
What percentage of individuals diagnosed with schizophrenia will experience auditory hallucinations?
75%
Olfactory hallucinations are more often indicative of what?
And organic brain disorder such as a tumor
Someone diagnosed with intermittent explosive disorder, do they have remorse after their behavior?
Yes
Children with autism show relative strength on what test? Compared to their peers
The embedded figures tests or the EFT. The EFT measures cognitive functioning by having the examinee try to locate simple geometrical shapes that are hidden in more complex diagrams.
What is the TONI-3?
The test of nonverbal intelligence measures intelligence, aptitude, abstract reasoning, and problem-solving completely free of the use of language.
What is the TONI-3 Best used with?
It is particularly well-suited for individuals were known or believed to have disorders of communication are thinking that may result from mental retardation, deafness, development of developmental disabilities, autism, cerebral palsy, stroke, disease, head injury, or other neurological impairment.
What is the ravens progressive matrices and who is the best used with?
Generally thought to be one of the best nonverbal test of intelligence. It is also stated for individuals with severe motor impairments and speech limitations. Spearman himself considered Raven’s progressive matrices to be the best nonverbal measure of the G factor.
What is an example of a false alarm?
A false alarm is a false positive or it is a false alarm if you think someone has HIV but he doesn’t
What is the definition of “hit”?
A means true positive
What is a miss?
A Miss means false-negative or it is a miss if you think someone is HIV negative when she’s actually HIV-positive
What is the correct rejection?
A correct rejection means true negative in this example the subject has had nine true negatives and one false positive or 90% correct rejections and 10% false alarms.
What is a false negative?
For example attest that incorrectly classifies those with less severe eating disorders as not having the disorder would be a false negative
What can psychologists do to increase the sensitivity of a test? For example if you’re concerned with having too many false negatives?
You lower the predictor cut off. If the test is not sensitive, it may incorrectly classify those with less severe of the said disorder as not having the disorder and in order to remedy this, the psychologist can lower the predictor cut off.
Can the criterion cut off of the test be changed?
No
What is incremental validity?
It is the proportion of improvement in the success rate achieved by adding a predictor test over and above the starting base rate.
What is the base rate?
The base rate is the rate of selecting successful employees without a predictor test.
What is the selection ratio?
The selection ratio is the ratio of the number of openings to the number of applicants for example one opening for every 10 applicants is 1:10 or .1.
What are the Taylor Russell tables?
According to Taylor Russell tables, incremental validity is optimized when the base rate is moderate about .5 and the selection rate is low close to .1. In other words a good predictor test will make the biggest difference when there has been moderate success in choosing successful employees without the predictive text, and there is a large pool of applicants with a relatively few openings.
What and what are alternatives to classical test theory?
Latent trait model and item response theory
What is item response theory or latent trAit model?
It is assumed that item performance is related to the amount of the respondents late tree like statistics ability. Later trait models are used to establish a uniform scale of measurement that can be applied to individual the varying ability and to test content of varying difficulty.
What is classical test theory?
Total variability in testtakers scores can be explained by combination of the test reliability and error variability.
Children with autism show relative strength on the following test?
Embedded figures test
What is an embedded figures test or EFT?
The EFT measures cognitive functioning by having the examinee try to locate simple geometrical shapes that are hidden in more complex diagrams.
Spearman himself consider the following test to be the best nonverbal measure of the G factor.
Raven’s progressive matrices
This occurs when the criterion is subjectively scored, and the reader has knowledge of the employees predictor scores?
Criterion contamination
Criterion contamination results in a spuriously high blank validity coefficient?
Hi criterion related validity coefficient
What is something that could reduce the recency effect?
Quarterly appraisals or evaluations
This is a tendency bias that occurs when a rater tends to write all employees as about average?
The central tendency bias
On the MMPI – two, which validity scale also serves as a moderator variable? And what does the scale adjust for?
The K scale
Defensiveness
The following scales on the MMPI – to measure response inconsistency or random responding?
Vrin
TRIN
The standard errors of the mean, the standard errors of measurement, and standard error of the estimate express errors in terms of what?
Standard deviation units
Blank applies to the standard error of the mean only?
Sampling error
This source of error happens or is taken into account in the standard error of measurement only?
The testing situation is a source of error
When validity is high what happens to error in prediction?
When validities hi there should be little error in prediction and when validity is low, there should be a lot of Error in prediction
What kind of relationship is the standard error of estimate have with the standard deviation?
The standard error of estimate has a direct relationship with the standard deviation, the larger the standard deviation, the larger the standard error.
What is a forced choice or a forced response and what does it help control?
A forced response format in which the rater is forced to choose between two equally desirable or undesirable attributes. And it helps to reduce the halos
What is BARS and what might it help reduce?
Behaviorally anchored rating scales
Objective rating scales for work performance
The halo effect
What three things are known to help with the halo effect?
Training the Raters
Utilizing forced choice or a forced response format
Objective rating methods such as BARS
What is utilizing relative methods?
Relative methods involve comparing employees with one another and does not control for Halo effects
What is the range for reliability coefficients?
What is the range of the validity coefficient?
What is the range of the standard error of measurement?
What is the range of the standard error of estimate?
- 0 - 1.0 Reliability
- 1.0 to 1.0 validity
Standard error of measurement = 0-SDx (of the test)
Standard error of the estimate = 0- SDy (criterion)
The following reflects the degree of relationship between pairs of scores from the same group of people who were are administered an identical test at two points in time?
The test – retest reliability coefficient
The following indicates the strength of the relationship between a predictor test and a criterion outcomes such as how well SAT scores predict college GPA?
Criterion related validity coefficient
The following measures the degree to which a test is actually measuring the construct for the trade it is attempting to measure for example aggression?
Construct validity
The two following forms of validity are necessary to establish construct validity?
Convergent and divergent validity
What is diuresis?
Excessive urination
Blank is the rate of successful hiring without using a test.
Base rate