Measurement Flashcards
What is validity?
The degree to which the test measures what it is designed to measure.
What is reliability?
The consistency or repeatability of test scores from trial to trial or day to day.
What is objectivity?
The consistency of scores obtained by MORE THAN ONE TESTER
What is another name for objectivity?
Rater reliability
What does it mean if a test has HIGH objectivity? Give an example.
It should not matter who scores the test (the results would be the same). Ex: Multiple Choice
What does it mean if a test has LOW objectivity? Give an example.
The score depends on who is scoring. Ex: Any sport where you are GIVEN a score… you do not make your score.
True or False?
For a test to be valid, it must also be reliable.
False. For a test to be valid, it must also be reliable and objective.
True or False?
A reliable test is not always valid.
True.
What are the types of validity?
- Logical Validity
- Content Validity
- Criterion Validity
- Construct Validity
What is logical/face validity?
Does the test look like it measures what it is supposed to measure on the SURFACE
What are the problems with logical/face validity?
- Not enough evidence to say a test is valid
- Not statistical
What is content validity?
Knowledge Test: The content must match what was covered in class to the proportions covered in class.
Psychological Test: The content must match the intent of the test
What types of tests are usually used for content validity?
Paper/pencil tests (knowledge and psychological tests)
What is the problem with content validity?
Typically, not statistical
What are the two types of criterion validity?
- Concurrent
- Predictive
Describe concurrent validity.
Comparing your test to a known valid test/the gold standard.
How is concurrent validity usually done? How do you know if your test is good?
With a correlation.
A good correlation is close to 1 or -1.
What has a strong correlation to the mile-run field test?
The CV test and VO2max
What has a strong correlation to the skinfold field test?
DEXA
Describe predictive validity.
How well a test can predict achievement in the future. Usually a set of measures, not a single measure.
Give 2 examples of predictive validity.
- Admission to upper education - likelihood of graduating
- NFL Draft - physical/psychological/cognitive tests
What is construct validity?
How well does the test measure the underlying construct you want to measure?
True or False?
Constructs are always visible.
False. Constructs may or may not be observable.
What is the MAIN idea of construct validity?
We are trying to validate something that is not observable.
When is construct validity usually seen?
In psychological tests.
True or False?
Construct validity is statistical.
True. They are statistical in nature.
What are the two common methods of construct validity?
- Correlational methods
- Known Groups method (two groups should differ)
How do you measure reliability?
By using an intraclass correlation coefficient.(ICC)
What is the difference between ICC and Pearson’s correlation?
Pearson: A correlation between two separate variables
ICC: A correlation between multiple administrations of the same variable
True or False?
Every test given may not have an error.
False. Every test we give has an error.
How are reliability and error related?
Reliability is concerned with eliminating the error
What are the sources of measurement error?
- Lack of agreement among scorers
- Lack of consistent performance from participants
- Failure of the instrument to measure consistently
- Failure of the tester to follow standardized procedures
What are the types of reliability?
- Stability
- Internal Consistency
How do you measure stability reliability?
Through test-retest
How do you measure internal consistency reliability?
Through Cronbach’s alpha… found from ICC which is scored from 0-1.
How are objectivity and reliability related?
Objectivity is a special kind of reliability (instead of multiple days/trials, there are multiple testers)
What is the key to objectivity?
Training the scorers so they know what they are looking for.
What are sensitivity and specificity used for?
To evaluate the performance of a diagnostic or screening test
What does sensitivity do?
Tells you the ability of a test to CORRECTLY IDENTIFY individuals who HAVE a condition (true positives)
What does specificity do?
Tells you the ability of a test to CORRECTLY IDENTIFY individuals who DO NOT HAVE a condition (true negatives)
What is the golden standard for measuring physical activity?
Accelerometers
What are the pros and cons of self-reported questionnaires?
Pros - Cheap, easy, good for intense activity
Cons - affected by recall and social desirability
What are the pros and cons of activity logs?
Pros - cheap, easy, better for recall and social desirability
Cons - more difficult for participants
What are the pros and cons of heart rate monitors?
Pros - Good for categorizing, low effort
Cons - validity affected by the type
What are the pros and cons of pedometers?
Pros - records steps, good for running and walking, low cost
Cons - not good for upper body or twisting
What are the pros and cons of accelerometers?
Pros - measure acceleration in real-time and detect movements in multiple planes
Cons - expensive, need hard/soft ware and expertise for data
What is the golden standard for measuring cardiovascular endurance?
Lab Tests (Vo2max)
What are the pros and cons of Times/distanced runs/walks?
Good reliability
What are the pros and cons of shuttle runs?
Good reliability after a practice round, better for adults than children
What are the pros and cons of step tests?
Good for test-retest
What are the pros and cons of Treadmill/bicycle tests?
Pro - accurate
Con - uncomfortable for patron
What is the difference between maximal and submaximal?
Maximal - go until you quit
Submaximal - Someone tells you to stop at 85%
What are the pros and cons of Lab Tests?
Pros - Very accurate
Cons - uncomfortable for patron, require equipment and expertise
What are the cons of the muscular strength and endurance tests?
1RM - Must follow standardized rules and potential safety concerns
Handgrip Strength - Only upper body
Push up/Pull up/Sit up - Questionable validity
Isokinetic Dynamometers - expensive and need equipment
What is the golden standard for measuring muscular strength and endurance tests?
Isokinetic Dynamometers
What are the cons of the power tests?
Vertical Jump - Need standardized protocols
Medicine Ball Throw - N/A
Wingate Test - Uncomfortable for patron
What is the golden standard for measuring power tests?
Wingate Test - Meausres anaerobic power, 30 sec, maximal effort, resistance based on body mass
What are the cons of body composition tests?
BMI - Questionable Validity (does not count muscle)
Skinfolds - depends on tester and test sites
BIA - Depends on device and hydration
Bod Pod - expensive, affected by clothing and hydration
Hydrostatic Weighing - need expertise and special equipment
Dual Energy X-ray Absorptiometry - expensive
What is the golden standard for measuring body composition?
Dual Energy X-ray Absorptiometry
What are the cons of flexibility tests?
Trunk Lift - Questionable validity
Goniometry - needs expertise and training
What is the golden standard for measuring flexibility?
Goniometry - Looks like a protractor, and measures any joint
How do you measure psychological variables?
- Self-Report Measures
- Behavioral Measures
- Physiological Measures
What are other things you can measure and how do you do that?
- Skill
- Velocity (throwing, bat speed)
- Agility (short shuttle run)
- Speed (40-yard dash)
- Functional Movements (dummy carry/drag)
