Psych Assessment Flashcards
assumption 1
psychological traits and state exists
assumption 2
psychological traits and states can be quantified and measure
is any distinguishable, relatively enduring way in which one individual varies from one another
trait
distinguishes one person from another but relatively less enduring
state
assumption 3
test behavior predicts non-test behavior
assumption 4
test and other measurements have strengths and weaknesses
assumption 5
sources of error are part of the assessment process
long standing assumption that factors other than what a test attempts to measure will influence performance on the test
error
refers to the component of test score attributable to sources other than the trait or ability measured
error variance
assumption 6
testing and assessment can be done in a fair and unbiased way
assumption 7
testing and assessment can benefit society
is the stability or consistency of the measurement
reliability
includes the notion that each individual measurement has an element of error such as observer’s error, environmental changes, participant’s changes, etc
reliability
- index of reliability
- a proportion that indicates the ratio between the true score variance on a test and the total
variance
reliability coefficient
defined as one on which test takers will fall in the same positions relative to each other
reliable test
Stable charcteristics of the individual
true characteristics
Chance features of the individual or the situation
random measurement of error
tools used to estimate or infer the extent to which an observed score deviates from a true score
standard error of estimates
used to evaluate the error associated with administering a test at two different times.
test-retest
- When interval between testing is greater than six months
- the estimate of test-retest reliability. obtained using pearson-r
coefficient of stability
compares two equivalent forms of a test that measure the same attribute
parallel/alternate forms
• a test is given some and divided into halves that are scored separately.
• The results of one half of the test are then compared with the results of the other.
• Use the odd-even system, whereby one subscore is obtained for the odd-number items in the test and another for the even -numbered items.
split-half method
- Refers to the degree of correlation among all the items on a scale.
- Useful in assessing the homogeneity of the test
inter-item consistency
Methods used to obtain estimates of internal consistency:
- KR 20
- Cronbach alpha
a formula that estimates the internal consistency of test in which the items are non-dichotomous or there is no right or wrong answer
cronbach alpha
• The degree of agreement or consistency between two or more scorers (or judges or raters) with regard to a particular measure.
• There is a judge to rate the examine answers
• For creativity or projective test
inter-scorer reliability
- is a judgment or estimate of how well a test measures what it purports to measure in a particular context.
- it is a judgment based on evidence about the appropriateness of inferences drawn from test scores.
validity
is the process of gathering and evaluating evidence about validity
validation
validation process if test users plans to alter format, instruction, language, or content of the test
local validation
• When the items look like they measure what they are supposed to measure.
• The judgement about the items appropriateness is made by the test taker rather than expert in the domain.
face validity
• It is important whenever a test is used to make inferences about the broader domain of knowledge and or skills represented by a sample of items.
• Is important in maximal performance test and typical performance test
content validity
Qualitative process in which test items are compared to a detailed description of the test domain.
content validity
• Is the ability of a test to predict performance on another measure.
• The test is referred to as the “predictor” labeled X and the validation measure as the criterion labeled Y.
criterion validity
is a judgment of how adequately a test score can be used to infer an individual’s most probable standing on some measure of interest - the measure of interest being the criterion.
criterion-related validity
is an index of the degree to which a test score predicts some criterion measure.
predictive validity
is an index of the degree to which a test score is related to some criterion measure obtained at the same time
concurrent validity
Whether a test measures what it is intended to measure. Referred to as personality dimensions of personality traits
construct validity
measure correlating the same construct
congruent validity
a validity coefficient sharing little or no relationship between two tests measuring unrelated constructs
discriminant or divergent validity
is an informed, scientific idea developed or hypothesized to describe or explain behavior
construct
Statistical bias (intercept bias, slope bias)
test bias
Is a judgement resulting from the intentional or unintentional misuse of rating scale
rating error
error in rating that arises from the tendency on the part of the rater to be lenient in scoring
leniency error
systematic reluctance to giving ratings at either positive or negative
central tendency error
tendency to give a particular ratee a higher rating than he or she objectively deserves because the rater’s failure to discriminate among conceptually distinct aspects of a ratee’s behavior
halo effect
The extent to which a test is used in an impartial, just and equitable way
fairness
• Refers to a group of statistics that can be calculated for individual test items.
• It helps in explaining why a test shows a certain level of reliability and validity.
• Particularly useful when test is unrealible or fail to demonstrate relationship with criterion measures.
item analysis
2 Commonly used technique of Item analysis:
- Item Difficulty
- Item Discrimination
• appropriate for maximal performance test- achievement and aptitude test.
• Requires that test items be scored as correct and incorrect.
item difficulty
percentage of the pupils who got the item right. It can also be interpreted as how easy or how difficult an item is
Difficulty Index / Item difficulty index
Operationally define as difficult item as one that few people answer correctly
item difficulty analysis
- appropriate for almost any type of test.
- Indicates the extent to which different types of people answer an item in different ways.
item discrimination
- separates the bright from the poor ones. Thus, a good test item separates the bright from the poor pupils.
- Measures of Item Discrimination
discrimination index
two approaches of discrimination index:
- Item-discrimination index
- Item-total Correlation
is the proportion obtained by comparing the performance of two subgroups of test-takers
extreme group method
Multifaceted capacity that manifest itself in different ways across all life span
intelligence
• Intelligence is inherited
• Believed that the most intelligent persons were those equipped with the best sensory abilities
• Abilities used in mental processes cannot be seperated because they interact together
Francis Galton
The degree of availability of one’s experiences for the solution of his present problems and the anticipation of future ones.
Henry Goddard
• Development of cognition in children
• Intelligent may be conceived of as a kind of evolving biological adaptation to the outside world.
jean piaget
refer to organized action or mental structure that when applied to the world leads to knowing or understanding
schema/schemata
Defined intelligence as the aggregate of global capacity of the individual to act purposefully, to think rationally and to deal effevtively with his environment.
david wechsler
• Believed that the intelligence quotient or IQ meant to quantify intellectual functioning to allow comparison among individuals
• IQ= mental age / chronological age x 100
lewis terman
Model of general mental ability or Two-factor-theory of intelligence
charles spearman
required for performance of mental test of all kinds; he called this kind of “mental energy” that underlies the specific factors
general ability
required for performance on just one kind of mental test
special abilities
• Identified seven (7) primary mental abilities:
- Verbal comprehension
- Word fluency
- Number
- Space
- Associative memory
- Perceptual Speed
- Induction or General Reasoning
louis leon thurstone
Believed that g’s has two related but distinct components: fluid intelligence & crystallized intelligence
raymond cattell
The ability to see relationships as in analogies and letter and number series. Also believed as the primary reasoning ability. This decreases as one ages
fluid intelligence
Acquired knowledge and skills or also know as Factual Knowledge. This increases
with age.
crystallized intelligence
- Proposed additional factors to Cattell’s types:
• Visual processing (Gv)
• Auditory processing (Ga)
• Quantitative processing (Gq)
• Speed processing (Gs)
• Reading and writing (Grw)
• Short-term memory (Gsm)
• Long term storage and retrieval (GIr) - Vulnerable abilities
- Maintained abilities
John L. Horn
Propose the THREE STRATUM THEORY
John B. Carrol
as “g”
third stratum
composed of 8 abilities and processes
second stratum
level/speed factor each different depending on the second stratum to which they are linked
first stratum
- proposed by Kevin McGrew
- Exclusion of G since it has little relevance to cross battery assessment and interpretation
- There is a higher order general factor and 9 broad stratum abilities and over 70 narrow abilities.
CHC model (catell-horn-carroll)
Integration of the two models
broad stratum
Proposed that intelligence comprise of 180 elementary abilities and these 180 elementary abilities are made up of combination of three dimension
joy paul guilford
what the person does
operation
the material on which operations are performed
content
the form in which the information is stored and processed
product
• Proposed the HIERARCHIAL THEORY OF INTELLIGENCE
• Addresses the gaps between Spearman’s Two Factory-theory in which intelligence is mainly about “g” and thurstone multiple factor theory in which the “s” takes a bigger role than “g”
• Defined intelligence as comprising of abilities of varying levels of generality”
philip e. vernon
- Believes that each mental activity requires an aggregate different set of abilities
- Abstract Intelligence has FOUR ATTRIBUTES: level, range, area, speed
edward lee thorndike
refers to the level of difficulty of a task that can be solved
level
refers to a number of tasks at any given degree or difficulty
range
means the total number of situations at each level to which the individual is able to respond
area
is the rapidity with which we can respond to the items
speed
Multiple Intelligence theory
howard gardner
• Russian neuropsychologist who developed the theory on INFORMATION-PROCESSING
• Studies the mechanism by which information is processed -how information is processed rather than what is processed.
aleksandra luria
refers to the process where information is integrated all at one time
simultaneous (parallel)
refers to process where information is individually processed in sequence.
successive (sequential)
reflect the general capacity for performing intellectual task, such as solving verbal and mathematical problems
IQ score
is an index that refers to the chronological age equivalent of one’s perfromance on a test or subtest. This index is typically derived by reference norms that indicate age at which most testtakers are able to pass to otherwise meet some criterion of performance
mental age
All living are preformed at birth: all organism structure, including intelligence are preformed at birth and therefore cannot be improved
preformationism
One’s abilties are predetermined by genetic inheritance and that no amount of learning or other intervention can enhance what has been genetically encoded to unfold in time
predeterminism
People inherit certain intellectual potential
inheritance
- People inherit certain intellectual potential. Exactly how much of the genetic potential is realized depends partially on the type of environment in which it was nurtured.
- “we are free who we want to be” using the environment to pust our genetic potential to the limit.
interactionism
He noticed that intelligence seems to rise on average, year by year starting in the year which the test was normed.
james r. flynn
- The concept of street efficacy
- Theorist and researcher believed that this concept lies in the crossroads of intelligence and personality-if not firmly within the bouds of each.
personality
is a person who knows his or her way on the street
streetwise
refers to the perceived ability to avoid violent confrontration and to be safe in one’s neighborhood
street efficacy
is defined as the extent to which a test has incorporated the vocabulary, concepts, traditions, knowledge, and feelings associated with a particular culture
culture loading
were designed to minimized the effects of culture loading
culture fair
The most adequate conceptualization of a person’s behavior in all its detail (mcclelland, 1951)
personality
Measurement and evaluation of psychological traits, states, values, interests attitudes, worldview, acculturation, sense of humor, cognitive and behavioral style and/or related individual characteristics.
personality assessment
Any distinguishable, relatively enduring way in which one individual varies from another
personality traits
A constellation of traits that is similar in pattern to one identified category of personality within a taxonomy of personalities
personality types
variety of favorable response bias
halo effect
to respond to a test item or interview question in some characteristic manner, regardless of the content of the item/question
response style
the selective exposure of some information or suppression of other information
impression management
subscale of a test designed to assist in judgments regarding how honestly the testtaker responded
validity scale
a person’s perception about the source of things that happen to him or her
locus of control
the assessor was attempting to learn something about the assessee by handwriting analysis
graphology
Defined as aspects of the focus of exploration such as the time frame as well as other contextual issues that involve people, places, and events
frame of reference
an assessment technique to sort a grp. of statements ranging from most descriptive to least descriptive
Q-sort technique
characterized by efforts to learn how a limited number of personality traits can be applied to all people
nomothetic approach
- characterized by efforts to learn about each individual’s unique constellation of personality traits
- No attempt to characterize each person according to any particular set of traits
idiographic approach
Logic and reason in the development of test items
content oriented approach
aid identification of the minimum number of variables or factors that account for the intercorrelations on observed phenomena
factor or cluster analysis
A standard on which a judgment or decision can be made
criterion
a reference group of testtakers who share specific characteristics and responses
criterion group
process of using criterion groups to develop test items
empirical criterion keying
an individual’s thoughts, behaviors, values, worldview, and identity develop in relation to the general thinking, behavior, customs, and values of a particular cultural group
acculturation
Instrument designed to evaluate testtakers’ likes, dislikes, leisure activities, curiosities, and involvements in various occupations and professions.
measures of interest
culminated the 420-item test in the 1920s which he called the Strong Vocational Interest Blank
edward strong jr
strong-campbell interest inventory
david p. campbell
provides a systematic assessment of emotional, interpersonal, experiential, attitudinal, and motivational styles
neo pi-r
developed neo pi-r
costa & mccrae
developed mbti
isabel briggs myers & katharine cook briggs
a test used to classify assessees by psychological type and to shed light on “basic differences in the ways human beings take in information and make decisions”
MBTI
developed 16 personality factor test
raymond cattell
self-report assessment instrument that measures the 16 normal adult personality dimensions
16PF
a measurement device or technique used to quantify behavior or aid in the understanding and prediction of behavior
test
uniformity in procedures
standardized
decision of a particular examiner but are based on objective criteria
objective
set of items that are designed to measure characteristics of human beings that pertain to behavior (overt or covert)
psychological test
are related to the overt and covert dispositions of the individual
personality tests
provide a statement, usually of the self-report variety, and require the subject to choose between two or more alternative responses such as “true or false”
structured personality tests
either the stimulus (test materials) or the required response or both are ambiguous
projective tests
used to screen for intellectual, emotional, and neurological deficits
mental status examination
may be defined as the adaptation of a test, procedure, or situation, or the substitution of one test for another, to make the assessment more suitable for an assessee with an exceptional needs
accommodation
assumes that each person has a true score (true ability) that would be obtained if there were no errors in measurement
classical test theory
type of error that cannot be predicted, may result to an increase or decrease of score
unsystematic (random) error
type of error in which its effects on scores can be predicted, a consistent type of error, does not affect variability of scores
systematic error
correlation between the scores obtained using the two forms
coefficient of equivalence
both forms have the same mean and sd
parallel forms
- consistency within the test
- it is the intercorrelations among the items
- if all the items on a test measure the same construct, then it has a good ___
internal consistency
measures one construct
homogenous (unidimensional)
multiple constructs
heterogenous (multidimensional)
- used in tests with no right or wrong answers
- average of all split-halves
- disadvantage: affected by the number of items
cronbach’s alpha
the formula for calculating the reliability of a test in which the items are dichotomous, scored 0 or 1 (usually for right or wrong)
KR-20
the degree of agreement or consistency between two or more scorers with regard to a particular measure
interrater reliability
used to know the agreement among 2 raters
cohen’s kappa
used to know the agreement among 3 or more raters
fleiss’ kappa
failure to capture important components of a construct
construct underrepresentation
happens when scores are influenced by factors irrelevant to the construct
construct-irrelevance variance
known as umbrella validity
construct validity
the test is correlated to another test that measures the same/similar constructs
convergent validity evidence
assessment of business leadership ability
leaderless group technique
simulates the way a manager or an executive deals with an in-basket
in-basket technique
standardized procedure for evaluation involving multiple assessment techniques
assessment center
measurement that entails evaluation of one’s somatic health and intactness, and observable sensory and motor abilities
physical tests
evaluation undertaken to determine the presence, if any, of alcohol or other psychotropic substances by means of laboratory analysis
drug testing
assess abilities involved in thinking
measures of cognitive ability
output or value yielded relative to work effort made
productivity
involves distributing a predetermined number or percentage of assessees into various categories that describe performance
forced distribution technique
supervisor recording positive and negative employee behaviors
critical incidents technique
employees expend energy in ways designed to achieve the outcome they want
expectancy theory of motivation
expectancy theory of motivation
vroom
hierarchy of needs
maslow
alternative need theory of motivation
adler
achievement motivation
McClelland
scale designed to assess aspects of intrinsic and extrinsic motivation
work preference inventory
challenge of work tasks and enjoyment of work
intrinsic motivation
compensation for work and external influences
extrinsic motivation
a psychological syndrome of emotional exhaustion, depersonalization, and reduced personal accomplishment that can occur among individuals who work with other people in some capacity
burnout
22 items divided into 3 subscales: emotional exhaustion, depersonalization, personal accomplishment
maslach burnout inventory
developed MBI (maslach burnout inventory)
christina maslach
a pleasurable or positive emotional state resulting from the appraisal of one’s job or job experiences
job satisfaction
strength of an individual’s identification with and involvement in a particular organization
organizational commitment
15-item likert scale wherein respondents express their commitment-related attitudes towards an organization
organizational commitment questionnaire
totality of socially transmitted behavior patterns characteristic of a particular organization or company
organizational culture
interview and discussion guide designed for administration by a trained interviewer or focus group moderator which explore various aspects of organizational culture
discussion of organizational culture
stigmatize those pseudo successful clinical procedures in which personality descriptions from the test are made to fit the place largely by virtue of their triviality
the barnum effect
refers to the analysis of data of an entire population merely using numbers to describe a known data set
descriptive statistics
value in a group of values which is the most typical for the group, or the score which all other scores are evenly clustered around
measures of central tendency
- average/arithmetic mean
- sum of a set of measurements in the set
mean
central value of a set value such that the half the observations fall above it and half below it
median
modal value of a set most frequently occurring value; for grouped data, it is the midpoint of the class interval with the largest frequency
mode
measure of how much or how little the rest of the values tend to vary around the central or typical value
measures of variability/dispersion
square root of variance; shows the distribution of measurement
standard deviation
(sd)2
variance
simplest measure of variation difference between the largest and smallest measurement
range
multiple choice types of test that assess cognitive ability and problem-solving aptitude of prospective employees
wonderlic personnel test (WPT)
involve classification or categorization based on one or more distinguishing characteristics
nominal
rank ordering on some characteristics is also
permissible
ordinal
contains equal intervals, has no absolute zero point (even negative values have interpretation to it)
interval
- has true zero point (if the score is zero, it means
none/null) - Easiest to manipulate
ratio
relatively flat
platykurtic
relatively peaked
leptokurtic
somewhere in the middle
mesokurtic
- the degree of agreement or consistency between two
or more scorers with regard to a particular measure
interscorer reliability
