Appraisal Techniques Flashcards
The appraisal processes fans a wide of variety of specific activities including:
Clinical interviewing, behavior observations , neuropsychological testing, career interest and ability measurements, occupational assessments, academic evaluation.
Reliability coefficients
Range from 0.0 to +1.0 with Scores of .75 higher considered strong in most situations.
Reliability coefficient of 1.00 indicates a perfect score which has no error.
Reliability
Is commonly defined as the consistency of a test or the degree to which yields the same results.
Reliable test is not always valid.
Test retest reliability
Same subject are given the same test twice to see if the scores are consistent.
Measures temporal effects
If test is used to influence performance, test retest may be less accurately estimated.
Split half procedures
Examiner can artificially create parallel forms of test by splitting the items in half and measuring the consistency of the test halves.
Spearman brown formula is used to calculate a general estimate based on split half procedures.
Sometimes you inflated estimate of the reliability
Standard error of measurement (SEM)
Is alternative method to check reliability.
68% of the time, an examines true score would fall within +1 and -1 SEM.
A test with a small SEM has a higher reliability coefficient (.75 to 1.0)
A test with a large SEM has a low reliability coefficient ( 0.0 to .24)
Factors that affect reliability
Test length
Homogeneity- A greater number of similar item yield increase reliability estimates.
Test retest interval
Range constriction
Other systematic such as guessing and unsystematic uncontrolled factors.
Validity
Is generally defined as the degree to which a test measures what it is supposed too.
A valid test is always reliable
Face validity
A simple form validity where you apply a superficial and a subjective assessment of whether or not you study or test measures what it is supposed to measure
Example: IQ test
Looks or appears to measure the intended attribute
Content validity
Refers to the degree to which a sample of test items adequately represent or cover the content area the test is supposed to measure.
Example: achievement test
Criterion related validity
Determine the extent to which a test can predict,diagnosed, or classify an individuals behavior in specific situations
There are three types: predictive, diagnostic, and concurrent
Example: applicant takes a performance test or GRE or SAT
Three types of criterion validity
Predictive validity
- predicts future outcome
- such as ACT/SAT/GRE
Diagnostic validity
- try to diagnose or identify an existing state.
- examples: test for adult memories of childhood
Concurrent validity
-written drivers license is replace in person test
Construct validity
Is the extent to which a test measures a concept, construct, or traits of interest.
Example of measurements of the human brain such as, intelligence ,level of emotion ,proficiency or ability
Compare and contrast. Example ego strength
Criterion referenced versus normative reference tests
Criterion reference assessments compares group or individual performance with predetermined set of criteria believed to be important or essential.
Normative referenced assessments compares individuals with each other and\or groups who took the same test previously.
Example: Most current standardized test
A client who takes a normative test can
Legitimately be compared to others who have taken the test