Psychometric Properties essential in Constructing, Selecting, Interpreting tests Flashcards
process of measuring psychology-related variables by means of devices or procedures designed to obtain a sample of behavior
- numerical in nature
- individual or by group
- administrators can be interchangeable without affecting the evaluation
- requires technician-like skills in terms of administration and scoring
- yield a test score or series of test score
- minutes to few hours
Psychological Testing
gathering and integration of psychology-related data for the purpose of making psychological evaluation
- answers referral question thru the use of different tools of evaluation
- individual
- assessor is the key to the process of selecting tests and/or other tools of evaluation
- requires an educated selection of tools of evaluation, skill in evaluation, and thoughtful organization and integration of data
- entails logical problem-solving that brings to bear many sources of data assigned to answer the referral question
Psychological Assessment
evaluate abilities and skills relevant in school context
Educational
draw conclusions about psychological aspects of a person as they existed at some point in time prior to the assessment
Retrospective
subject is not in physical proximity to the person conducting the evaluation
Remote
“in the moment” evaluation of specific problems and related cognitive and behavioral variables at the very time and place that they occur
Ecological Momentary
the assessor and assesee may work as “partners” from initial contact through final feedback
Collaborative
therapeutic self-discovery and new understanding are encouraged
Therapeutic
describe interactive approach to psychological assessment that usually follows the model: evaluation > intervention of some sort > evaluation
Dynamic
device or procedure designed to measure variables related to psychology
Psychological Test
subject matter
Content
form, plan, structure, arrangement, layout
Format
a specific stimulus to which a person responds overtly and this response is being scored or evaluated
Item
one-to-one basis or group administration
Administration Procedures
code or summary of statement, usually but not necessarily numerical in nature, but reflects an evaluation of performance on a test
Score
the process of assigning scores to performances
Scoring
reference point derived by judgement and used to divide a set of data into two or more classification
Cut-Score
technical quality
Psychometric Soundness
science of psychological measurement
Psychometrics
refer to professional who uses, analyzes, and interprets psychological data
Psychometrist or Psychometrician
assess what a person can do
Ability or Maximal Performance Test
measurement of the previous learning
- used to measure general knowledge in a specific period of time
Achievement Test
test that rely mostly on content validity
- fact-based or conceptual
Achievement Test
refers to the potential for learning or acquiring a specific skill
- tends to focus on informal learning
Aptitude
test that rely mostly on predictive validity
Aptitude
refers to a person’s general potential to solve problems, adapt to changing environments, abstract thinking, and profit from experience
Intelligence
considerable overlap of achievement, aptitude, and intelligence test
Human Ability
measure usual or habitual thoughts, feelings, and behavior
- indicate how test takers think and act on a daily basis
- use interval scales
- no right and wrong answers
Typical Performance Test
measures individual dispositions and preferences
- designed to identify characteristic
- measured ideographically or nomothetically
Personality Test
provide statement, usually self-report, and require the subject to choose between two or more alternative responses
Structured Personality tests
unstructured, and the stimulus or response are ambiguous
Projective Personality Tests
elicit personal beliefs and opinions
Attitude Test
measures likes and dislikes as well as one’s personality orientation towards the world of work
Interest Inventories
the interest is the number of times a test taker can answer correctly in a specific period
Speed Tests
reflects the level of difficulty of items the test takers answer correctly
Power Tests
method of gathering information through direct communication involving reciprocal exchange
Interview
type of interview where questions are prepared
Standardized/Structured
type of interview where pursue relevant ideas in depth
Non-standardized/Unstructured
type of interview where may probe further on specific number of questions
Semi-Standardized/Focused
type of interview where subject is allowed to express his feelings without fear of disapproval
Non-Directive
determines the mental status of the patient
Mental Status Examination
determine why the client came for assessment; chance to inform the client about the policies, fees, and process involved
Intake Interview
biographical sketch of the client
Social Case
determine whether the candidate is suitable for hiring
Employment Interview
more than one interviewer participates in the assessment
Panel Interview (Board Interview):
used by counselors and clinicians to gather information about some problematic behavior, while simultaneously attempting to address it therapeutically
Motivational Interview
samples of one’s ability and accomplishment
Portfolio
refers to records, transcripts, and other accounts in written, pictorial, or other form that preserve archival information, official and informal accounts, and other data and items relevant to an assessee
Case History Data
a report or illustrative account concerning a person or an event that was compiled on the basis of case history data
Case study
result of the varied forces that drive decision-makers to reach a consensus
Groupthink:
monitoring of actions of others or oneself by visual or electronic means while recording quantitative and/or qualitative information regarding those actions
Behavioral Observation
observe humans in natural setting
Naturalistic Observation
Stimulus, Organismic Valuables, Actual Response, Consequence
SORC Model
defined as acting an improvised or partially improvised part in a stimulated situation
Role Play
assesses are directed to act as if they are in a particular situation
Role Play Test
Psychological Assessment Process
RAKDACOIN
1. Determining the Referral Question
2. Acquiring Knowledge relating to the content of the problem
3. Data collection
4. Data Interpretation
accurately predicts success or failure
Hit Rate
narrative description, graph, table. Or other representations of the extent to which a person has demonstrated certain targeted characteristics as a result of the administration or application of tools of assessment
Profile
an approach to evaluation characterized by the application of empirically demonstrated statistical rules as determining factor in assessors’ judgement and actions
Actuarial Assessment
application of computer algorithms together with statistical rules and probabilities to generate findings and recommendations
Mechanical Prediction
observations made by an examiner regarding what the examinee does and how the examinee reacts during the course of testing that are indirectly related to the test’s specific content but of possible significance to interpretation
Extra-Test Behavior
Parties in Psychological Assessment creates the tests or other methods of assessment
Test Author/Developer
Parties in Psychological Assessment
they publish, market, sell, and control the distribution of tests
Test Publishers
Parties in Psychological Assessment
prepare evaluative critiques based on the technical and practical aspects of the tests
Test Reviewers
Parties in Psychological Assessment
uses the test of assessment
Test Users
Parties in Psychological Assessment
those who take the tests
Test Takers
Parties in Psychological Assessment
institutions or government who contract test developers for various testing services
Test Sponsors
selection of tests and assessment procedures typically composed of tests designed to measure different variables but having a common objective
Test Battery
