Measurement Flashcards

1
Q

What is validity?

A

The degree to which the test measures what it is designed to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is reliability?

A

The consistency or repeatability of test scores from trial to trial or day to day.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is objectivity?

A

The consistency of scores obtained by MORE THAN ONE TESTER

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is another name for objectivity?

A

Rater reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What does it mean if a test has HIGH objectivity? Give an example.

A

It should not matter who scores the test (the results would be the same). Ex: Multiple Choice

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What does it mean if a test has LOW objectivity? Give an example.

A

The score depends on who is scoring. Ex: Any sport where you are GIVEN a score… you do not make your score.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

True or False?
For a test to be valid, it must also be reliable.

A

False. For a test to be valid, it must also be reliable and objective.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

True or False?
A reliable test is not always valid.

A

True.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the types of validity?

A
  1. Logical Validity
  2. Content Validity
  3. Criterion Validity
  4. Construct Validity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is logical/face validity?

A

Does the test look like it measures what it is supposed to measure on the SURFACE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the problems with logical/face validity?

A
  1. Not enough evidence to say a test is valid
  2. Not statistical
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is content validity?

A

Knowledge Test: The content must match what was covered in class to the proportions covered in class.
Psychological Test: The content must match the intent of the test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What types of tests are usually used for content validity?

A

Paper/pencil tests (knowledge and psychological tests)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the problem with content validity?

A

Typically, not statistical

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the two types of criterion validity?

A
  1. Concurrent
  2. Predictive
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Describe concurrent validity.

A

Comparing your test to a known valid test/the gold standard.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

How is concurrent validity usually done? How do you know if your test is good?

A

With a correlation.
A good correlation is close to 1 or -1.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What has a strong correlation to the mile-run field test?

A

The CV test and VO2max

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What has a strong correlation to the skinfold field test?

A

DEXA

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Describe predictive validity.

A

How well a test can predict achievement in the future. Usually a set of measures, not a single measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Give 2 examples of predictive validity.

A
  1. Admission to upper education - likelihood of graduating
  2. NFL Draft - physical/psychological/cognitive tests
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is construct validity?

A

How well does the test measure the underlying construct you want to measure?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

True or False?
Constructs are always visible.

A

False. Constructs may or may not be observable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is the MAIN idea of construct validity?

A

We are trying to validate something that is not observable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
When is construct validity usually seen?
In psychological tests.
26
True or False? Construct validity is statistical.
True. They are statistical in nature.
27
What are the two common methods of construct validity?
1. Correlational methods 2. Known Groups method (two groups should differ)
28
How do you measure reliability?
By using an intraclass correlation coefficient.(ICC)
29
What is the difference between ICC and Pearson's correlation?
Pearson: A correlation between two separate variables ICC: A correlation between multiple administrations of the same variable
30
True or False? Every test given may not have an error.
False. Every test we give has an error.
31
How are reliability and error related?
Reliability is concerned with eliminating the error
32
What are the sources of measurement error?
1. Lack of agreement among scorers 2. Lack of consistent performance from participants 3. Failure of the instrument to measure consistently 4. Failure of the tester to follow standardized procedures
33
What are the types of reliability?
1. Stability 2. Internal Consistency
34
How do you measure stability reliability?
Through test-retest
35
How do you measure internal consistency reliability?
Through Cronbach's alpha... found from ICC which is scored from 0-1.
36
How are objectivity and reliability related?
Objectivity is a special kind of reliability (instead of multiple days/trials, there are multiple testers)
37
What is the key to objectivity?
Training the scorers so they know what they are looking for.
38
What are sensitivity and specificity used for?
To evaluate the performance of a diagnostic or screening test
39
What does sensitivity do?
Tells you the ability of a test to CORRECTLY IDENTIFY individuals who HAVE a condition (true positives)
40
What does specificity do?
Tells you the ability of a test to CORRECTLY IDENTIFY individuals who DO NOT HAVE a condition (true negatives)
41
What is the golden standard for measuring physical activity?
Accelerometers
42
What are the pros and cons of self-reported questionnaires?
Pros - Cheap, easy, good for intense activity Cons - affected by recall and social desirability
43
What are the pros and cons of activity logs?
Pros - cheap, easy, better for recall and social desirability Cons - more difficult for participants
44
What are the pros and cons of heart rate monitors?
Pros - Good for categorizing, low effort Cons - validity affected by the type
45
What are the pros and cons of pedometers?
Pros - records steps, good for running and walking, low cost Cons - not good for upper body or twisting
46
What are the pros and cons of accelerometers?
Pros - measure acceleration in real-time and detect movements in multiple planes Cons - expensive, need hard/soft ware and expertise for data
47
What is the golden standard for measuring cardiovascular endurance?
Lab Tests (Vo2max)
48
What are the pros and cons of Times/distanced runs/walks?
Good reliability
48
What are the pros and cons of shuttle runs?
Good reliability after a practice round, better for adults than children
49
What are the pros and cons of step tests?
Good for test-retest
50
What are the pros and cons of Treadmill/bicycle tests?
Pro - accurate Con - uncomfortable for patron
51
What is the difference between maximal and submaximal?
Maximal - go until you quit Submaximal - Someone tells you to stop at 85%
52
What are the pros and cons of Lab Tests?
Pros - Very accurate Cons - uncomfortable for patron, require equipment and expertise
53
What are the cons of the muscular strength and endurance tests?
1RM - Must follow standardized rules and potential safety concerns Handgrip Strength - Only upper body Push up/Pull up/Sit up - Questionable validity Isokinetic Dynamometers - expensive and need equipment
54
What is the golden standard for measuring muscular strength and endurance tests?
Isokinetic Dynamometers
55
What are the cons of the power tests?
Vertical Jump - Need standardized protocols Medicine Ball Throw - N/A Wingate Test - Uncomfortable for patron
56
What is the golden standard for measuring power tests?
Wingate Test - Meausres anaerobic power, 30 sec, maximal effort, resistance based on body mass
57
What are the cons of body composition tests?
BMI - Questionable Validity (does not count muscle) Skinfolds - depends on tester and test sites BIA - Depends on device and hydration Bod Pod - expensive, affected by clothing and hydration Hydrostatic Weighing - need expertise and special equipment Dual Energy X-ray Absorptiometry - expensive
58
What is the golden standard for measuring body composition?
Dual Energy X-ray Absorptiometry
59
What are the cons of flexibility tests?
Trunk Lift - Questionable validity Goniometry - needs expertise and training
60
What is the golden standard for measuring flexibility?
Goniometry - Looks like a protractor, and measures any joint
61
How do you measure psychological variables?
1. Self-Report Measures 2. Behavioral Measures 3. Physiological Measures
62
What are other things you can measure and how do you do that?
1. Skill 2. Velocity (throwing, bat speed) 3. Agility (short shuttle run) 4. Speed (40-yard dash) 5. Functional Movements (dummy carry/drag)