Module 3 - Standardised Assessments Flashcards
Which stage in the clinical reasoning cycle will you use standardised assessment?
Process information stage
Standardised test:
Features (5)
Formal tests
Tested on normative sample
Correlational research (compare research to other things)
Valid & reliable
Strict administration & scoring procedures
Standardised tests:
2 types
Norm-referenced tests
Criterion referenced test
Standardised tests:
3 positives
Funding
Provides a baseline to assess progress
Psychometrically reliable & valid = consistency
Standardised tests:
4 negatives
- Valid for only population tested
- Expensive (takes time to administer)
- Anxiety provoking for some clients (because they are so strict)
- Reliability & validity may be vulnerable to operational measurement error
Non-standardised test:
2 features
Flexible to individual & contextual need
Naturalistic, functional
Non-standardised test:
4 types
Observations, language sampling
Authentic Assessments (Communication samples)
Dynamic Assessment
Some criterion-referenced tests
Non-standardised test:
3 Positives
Provides information of client in context
Descriptive approach = individualised
Can use measures to compare behaviours to known norms
Non-standardised test:
2 Negatives
Not sufficient for funding without standardised testing
Normative measures depend on clinician analysis & knowledge
What is best? Standardised or non-standardised tests?
Use a combination of both, backed by clinical reasoning
How to choose between standardised & non-standardised assessments:
6 questions to ask
Who are they for? (who are the tests designed for?)
Which aspects of language are assessed?
How are aspects assessed?
Test Limitations?
Impact of cultural bias?
Developmental level essential for accessibility?
Psychometrics
Psycho:
Metrics:
Psycho: Homan traits
Metrics: Measurement
Psychometric Properties:
standardised tests:
Reliability (Are the results replicable?)
Validity (Does it measure what it says it measures?)
Reliability:
3 Types
Test-Retest reliability
Inter-rater reliability
Intra-rater relability
Test-retest reliability:
Results are consistent when the same group is tested multiple times
Inter-rater reliability
Results are consistent when multiple raters (examiners) rate the same item
Intra-rater reliability
Results are consistent when the same person rates (examines) the test on more than one occasion
Validity: 2 Types
Content Validity
Construct Validity
Content Validity:
Test items represent all the possible test items that could be used to measure the construct that we want to measure
(tests have appropriate content that matches test purpose)
Construct Validity:
Test measures the construct that it is mean to be measuring
Reported as correlation co-efficient of the relationship between the test and the construct of interest
If the test correlates with other established tests that tests the same thing
(test vs existing tests)
Correlation coefficient:
0.1-0.25
Weak relationship
small correlation
Correlation coefficient: 0.3 - 0.49
Moderate relationship
medium correlation
Correlation coefficient: 0.5 - 1.0
Strong relationship
large correlation
Which correlation coefficient should you look for?
r= >0.5