ACES Flashcards
The gathering and integration of psychology-related data for the purpose of making a psychological evaluation that is accomplished through the use of tools such as tests, interviews, case studies, behavioral observation, and specially designed apparatuses and measurement procedures
Psychological Assessment
the process of measuring psychology-related variables by means of devices or procedures designed to obtain a sample of behavior.
Psychological testing
the use of evaluative tools to draw conclusions about psychological aspects of a person as they existed at some point in time prior to the assessment.
retrospective assessment
the use of tools of psychological evaluation to gather data and draw conclusions about a subject who is not in physical proximity to the person or people conducting the evaluation
Remote assessment
a measuring device or procedure.
Test
a device or procedure designed to measure variables related to psychology (such as intelligence, personality, aptitude, interests, attitudes, or values).
Psychological Test
the subject matter
Content
a code or summary statement, usually but not necessarily numerical in nature, that reflects an evaluation of performance on a test, task, interview, or some other sample of behavior
Score
the process of assigning such evaluative codes or statements to performance on tests, tasks, interviews, or other behavior samples
Scoring
a reference point, usually numerical, derived by judgment and used to divide a set of data into two or more classifications.
Cut score
the science of psychological measurement
Psychometrics
a method of gathering information through direct communication involving reciprocal exchange
Interview
more than one interviewer participates in the assessment.
Panel interview
a multifaceted method for systematically collecting, documenting, and evaluating evidence of a student’s learning, growth, and achievements over time
Portfolio
refers to records, transcripts, and other accounts in written, pictorial, or other form that preserve archival information, official and informal accounts, and other data and items relevant to an assessee.
Case history data
a report or illustrative account concerning a person or an event that was compiled on the basis of case history data
Case study
monitoring the actions of others or oneself by visual or electronic means while recording quantitative and/or qualitative information regarding those actions.
Behavioral Observation
Sometimes researchers venture outside of the confines of clinics, classrooms, workplaces, and research laboratories in order to observe behavior of humans in a natural setting
naturalistic observation
Acting an improvised or partially improvised part in a simulated situation.
Role play test
The acronym CAPA refers to:
Computer-Assisted psychological assessment
the assistance computers provide to the test user
computer-assisted psychological assessment
create tests or other methods of assessment. The American Psychological Association (APA)
Test Developers
Scoring may be done on-site
Local processing
Scoring conducted at some central location
Central processing
Any Authorized personal who an administer the Psychological Test
Test user
a reconstruction of a deceased individual’s psychological profile on the basis of archival records, artifacts, and interviews previously conducted with the deceased assessee or people who knew him or her.
Psychological Autopsy
a tool of assessment used to help narrow down and identify areas of deficit to be targeted for intervention.
Diagnostic test
a description or conclusion reached on the basis of evidence and opinion.
Diagnosis
Evaluates the accomplishment of individuals or the degree of learning that has taken place.
Achievement test
Achievement test, Aptitude test belong to which setting?
Educational settings
a typically nonsystematic assessment that leads to the formation of an opinion or attitude.
Informal Evaluation
Intelligence tests, personality tests, neuropsychological tests, or other specialized instruments belong to which setting?
Clinical setting
many such assessments is the extent to which assessees are enjoying as good a quality of life as possible.
Geriatric setting
a loss of cognitive functioning (which may affect memory, thinking, reasoning, psychomotor speed, attention, and related abilities, as well as personality) that occurs as the result of damage to or loss of brain cells
Dementia
an evaluative or diagnostic procedure or process that varies from the usual, customary, or standardized way a measurement is derived, either by virtue of some special accommodation made to the assessee or by means of alternative methods designed to measure the same variable(s).
Alternate Assessment
Detailed information concerning the development of a particular test and technical information relating to it should be found in the ________, which usually can be purchased from the test publisher.
test Manual
Many books written for an audience of assessment professionals are available to supplement, re-organize, or enhance the information typically found in the manual of a very widely used psychological test
professional books
It is believed that tests and testing programs first came into being in:
China
It is believed that tests and testing programs first came into being in the said country as early as:
2200 B.C.E.
aspired to classify people “according to their natural gifts”
Francis Galton
The psychologist who is credited with coining the term “mental test”
James Cattell
developed the product-moment correlation technique
Karl Pearson
Ways to Classify Psychological test
Test-user Qualification
Variable Measured
no. of test used
focused on how people were similar.
Wilhelm Wundt
the century where it saw the emergence of Intelligence testing as a focus of Psychological Assessment
20th Century
The two researchers who advanced theories and methods for measuring personality traits and abilities
Raymond Cattell & L.L. Thurstone
a clinical psychologist at Bellevue Hospital in New York City who introduced a test designed to measure adult intelligence.
David Wechsler
Th meaning of the Acronym WAIS is:
Wechsler Adult Intelligence Scale
a process whereby assessees themselves supply assessment-related information by responding to questions, keeping a diary, or self-monitoring thoughts or behaviors
Self report
WISC is an acronym for:
Wechsler Intelligence Scale for Children
the means by which information is communicated, is a key yet sometimes overlooked variable in the assessment process
Verbal Communication
characterized by value being placed on traits such as self-reliance, autonomy, independence, uniqueness, and competitiveness.
Individualist Culture
value is placed on traits such as conformity, cooperation, interdependence, and striving toward group goals.
Collectivist Culture
a specific stimulus to which a person responds overtly; this response can be scored or evaluated.
Item
Implies uniformity of procedures in administering and scoring the test.
Standarization
rules that individuals must obey for the good of the society as a whole—or rules thought to be for the good of society as a whole.
Laws
An individual’s test score is interpreted by comparing it with the scores obtained by others on the same test.
Norming
can be administered to more than one person at a time by a single examiner.
Group test
general potential to solve problems, adapt
to changing circumstances, think abstractly, and profit from experience
Intelligence Test
the middle score in a distribution, is another commonly used measure of central tendency.
Mean
a raw score that has been converted from one scale to another scale
Standard score
a bell-shaped, smooth, mathematically defined curve that is highest at its center.
Normal curve
term used for relatively flat Center of the Bell-shaped Curve.
Platykurtic
when relatively few of the scores fall at the
high end of the distribution, indicating as the test was difficult.
Positively skewed
relatively few of the scores fall at the low end of the distribution, indicating that the test is easy
Negatively skewed
the nature and extent to which symmetry is absent.
Skwenes
a measure of variability equal to the square root of the average squared deviations about the mean.
Standard deviation
the difference between the highest and the lowest scores.
Range
an indication of how scores in a distribution are scattered or dispersed.
Variability
Happens when there are two scores that occur with the highest frequency (of two).
Bimodal Distribution
The most frequently occurring score in a distribution of scores
Mode
the middle score in a distribution
Median
a straightforward, unmodified accounting of performance that is usually numerical.
Raw score
results from the conversion of a raw score into a number indicating how many standard deviation units the raw score is below or above the mean of the distribution.
Z-score
mean: 0 SD: 1
Z-score
the collective influence of all of the factors on a test score or measurement beyond those specifically measured by the test or measurement.
Errors
These scales involve classification or
categorization based on one or more distinguishing characteristics, where all things measured must be placed into mutually exclusive and exhaustive categories.
Nominal Scale
a scale with the property of magnitude but not equal intervals or an absolute 0.
Ordinal Scale
when a scale has the properties of magnitude and equal intervals but not absolute 0.
Interval Scale
specific scores or points within a distribution, it divides the total frequency for a set of observation into hundredths
Percentiles
average squared deviation around the mean.
Variance
a diagram or chart composed of lines, points, bars, or other symbols that describe and illustrate data.
Graph
any distinguishable, relatively enduring way in which one individual varies from another
Trait
distinguish one person from another but are relatively less enduring
State
an informed, scientific concept developed or constructed to describe or explain behavior
Construct
refers to an observable action or the product of an observable action.
Overt
assumption that the more the testtaker responds in a particular direction keyed by the test manual as correct or consistent with a particular trait, the higher that testtaker is presumed to be on the targeted ability or trait
Cumulative Scoring
Test-Related Behavior Predicts Non Test-Related Behavior
Assumption 3
Psychological Traits and States Exist
Assumption 1
Test and Other Measurement Techniques have strengths and weaknesses
Assumption 4
Each test taker has true score on a test that would be obtained but for the action of measurement error
Classical Test Theory
consistency of the instrument or scores obtained by the same person when re-examined with the same test on different occasions, or with different sets of equivalent items
Reliability
All of the factors associated with the process of measuring some variable, other than the variable being measured - difference between the observed score and the true score
Measurement Error
Source of error in measuring a targeted variable caused by unpredictable fluctuations and inconsistencies of other variables in measurement process
Random Error
an estimate of reliability obtained by correlating pairs of scores from the same people on two different administrations of the same test.
Test-Retest Reliability
derived from a normative sample that was nationally representative of the population at the time the norming study was conducted.
National Norms
a method of evaluation and a way of deriving meaning from test scores by evaluating an individual’s score with reference to a set standard
Criterion-Referenced
This model considers the problems created by using a limited number of items to represent a larger and more complicated construct.
Domain Sampling Model
an estimate of the extent to which item sampling and other errors have affected test scores on versions of the same test when, for each form of the test, the means and variances of observed test scores are equal
Alternate/ Parallel Forms Reliability
allows a test developer or user to estimate internal consistency reliability from a correlation of two halves of a test.
Spearman-Brown Formula
it the the mean of all possible split-half correlations, corrected by the Spearman Brown formula
Coefficient Alpha
refers to the degree of correlation among all the items on a scale.
Inter-Item Consistency
the degree to which a test measures a single factor.
Homogeneity
the degree of agreement or consistency between two or more scorers
Inter-scorer Reliability
a judgment or estimate of how well a test measures what it purports to measure in a particular context.
Validity
a logical result or deduction.
Inferences
the process of gathering and evaluating evidence about validity.
Validation
a judgment concerning how relevant the test items appear to be.
Face Validity
a judgment of how adequately a test samples behavior representative
Content Validity
a plan regarding the types of information
to be covered by the items, the number of items tapping each area of coverage, the organization of the items in the test, and so forth
Test Blueprint
a judgment of how adequately a test score can be used to infer an individual’s most probable standing on some measure of interest ( the criterion. )
Criterion-related Validity
the extent to which a particular trait, behavior,
characteristic, or attribute exists in the population
Base Rate
a correlation coefficient that provides a measure of the relationship between test scores and scores on the criterion measure.
Validity Coefficient
A miss wherein the test predicted that the test taker did possess the particular characteristic or attribute being measured when in fact the test taker did not.
False Positive
the degree to which an additional predictor explains something about the criterion measure that is not explained by predictors already in use.
Incremental Validity
a factor inherent in a test that systematically prevents accurate, impartial measurement.
Bias
A judgment resulting from the intentional or
unintentional misuse of a rating scale.
Rating Error
a procedure that requires the rater to measure individuals against one another instead of against an absolute scale.
Ranking
describes the fact that, for some raters, some ratees can do no wrong.
Halo Effect
Can tell us something about the practical value of the information derived from scores on the test
Index of Utility
The Usefulness or practical value of testing to improve efficiency
Utility
Proportion of people that an assessment inaccurately identifies particular trait.
Miss Rate
Proportion of people that an assessment tool accurately identifies as possessing a particular trait
Hit rate
The method of contrasting groups, entails collection of data of interest from groups known to possess and not to possess a trait or ability of interest
The Known Groups Method
Profits, gains, or advantages
Benefits
Specific type of miss whereby an assessment tool falsely indicates that the test-taker DOES NOT possess a particular trait
False Negative
A correct classification
Hits
Method for setting fixed cut scores can be applied to personnel selection tasks as well as to questions regarding the presence or absence of a particular trait
The Angoff Method
An incorrect classification
Miss
The validity coefficient for the given predictor and criterion
rxy
The standard deviation of performance of employees
Sdy
Used to calculate the dollar of a utility gain resulting from the use of a particular selection instrument under specified conditions.
BCG formula
the mean score on the test for selected applicants
Zm
it means the average length of time in the position
T
A cost benefit analysis designed to yield information relevant to a decision about the usefulness or practical value of a tool of assessment
Utility analysis
The value assigned for the test’s validity
Computed validity coefficient
An alternative table that is likely to have an average increase in criterion performance.
Naylor-Shine Tables
refers to the percentage of people hired under the existing system for a particular position
Base rate
Cut scores are typically set based in test takers performance across all the items on the test
IRT-Based Methods
Disadvantages, losses, or expenses in both economic and non-economic terms
Costs
Converts a scatterplot of test data an ______
Expectancy table
Specific type of miss whereby an assessment tool falsely indicates that the test taker possesses a particular trait
False positive
refers to an estimate of the benefit
Utility Gain
It provides an estimate of the extent to which inclusion of a particular test in the selection system will improve selection
Taylor Russel tables
Guides the setting of optimal cutoff scores, considering the seriousness of false positive and false-negative outcomes
Decision Theory
Numerical value that reflects the relationship between the number of people to be hired and the number of people available to be hired
Selection Rate