Analysis/Interpretation Flashcards
Rasch methodology
A hierarchal design used to develop a linear measurement scale within a standardized assessment
Test-taker variables
Factors that may impact the performance results of a client during the evaluation process (motivation, energy level, stress)
Environment bias
A type of testing bias that involves the degree to which the testing context is similar to the natural setting in which the task is typically performed
Item bias
A. type of testing bias that involves clients of similar performance abilities scoring differently when the same evaluation instrument or subtext is administered
Test-taker bias
A type of testing bias that must be controlled during standardized and non-standardized testing and involves actions of the client that influence the outcome of an evaluation or the test results (a client who influences test results by providing false information)
Likert scale
A psychometric method, typically used in a questionnaire or survey, that includes response option that progress in a linear direction
Evaluator bias
A type of testing bias that must be controlled during standardized and non-standardized testing and involves actions of the evaluator that influence the outcome of an evaluation or the test results
Floor effect
A situation in which an assessment instrument is not able to measure any additional performance differences at the bottom of the rating scale
Ceiling effect
A situation in which an assessment instrument is not able to measure any additional performance differences at the top of the rating scale
Assessment responsiveness: specificity
A test’s ability to accurately detect functional and performance abilities (true negative)
Assessment responsiveness: sensitivity
A test’s ability to accurately detect impairments or decreased performance abilities (true positive)
Corrrelation
A statistical term that refers to the measurement of the proximity or two distinct variables
Criterion validity
The degree to which the results of an assessment predict performance ability on other assessments that measure similar constructs
Two types:
- predictive validity
- concurrent validity
Content validity
The degree to which items in an assessment are an accurate representation of all aspects of the domain being tested
Construct validity
The degree to which an assessment tool measure specific constructs (FM skills) consistent to what it claims it measures
Reliability
The degree to which an assessment tool produces consistent results when the same client i retested on separate occasions while external factors remain constant
Validity
The degree to which an assessment tool measures what is claims to be measuring
Mastery monitoring
A multistep method of using data to track progress on a chart when skills are not achieved or absent; involves ID the skill and subskills and establishing a decision-making plan
Descriptive statistics
Provides insight into the general characteristics of data collected during a study
Types include:
- central tendency
- variability
Scales of measurement
Classification system used for quantifiable data
Types include:
- nominal scale
- ordinal scale
- interval scale
- ratio scale
Standard score
A score used in standardized testing, also referred to as z-scores, that is used to make comparisons across variable and populations
Disadvantages of standardized testing
Must be combined with qualitative and other assessment methods to complete a comprehensive evaluation
Multiple internal and external variables can impact performance on test and affect results
Rigidity of administration may negatively influence the results
Advantages of standardized testing
Scores can be understood by interprofessional team
Tools are often widely available
Uniform administration, scoring, and interpretation of results
Can help monitor progress over time
Can contribute to quality improvement and EBP
Measures of variability
The statistical value that represents how much the group varies from the mean and degree to which the data spreads across the distribution
Types include:
- variance
- standard deviation
Standard deviation
Measures the distribution and variation of data points around the mean
Grade equivalent
A score that compares a student’s performance to a normative group of students at the same academic level
Deviation IQ score
Score used for measurement of intelligence with the following features:
- mean score is 100
- intellectual disability is considered 2 SD below the mean
Developmental index score
Score used in developmental testing with the following features:
- mean score is 100
- SD iof 15 or 16
- intervention often beneficial if scores are 2 SD below the mean
Error variance
Factors or variable that cause a difference in standardized test scores (environmental conditions, motivation, fatigue)
SWOT analysis
An acronym used in business planning that outlines a process for understanding the internal and external environments of an organization or business
S - strengths
W - weaknesses
O - opportunities
T - threats
