Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

Research Methods Test 2 > Measurement > Flashcards

Measurement Flashcards

1
Q

What is validity?

A

The degree to which the test measures what it is designed to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is reliability?

A

The consistency or repeatability of test scores from trial to trial or day to day.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is objectivity?

A

The consistency of scores obtained by MORE THAN ONE TESTER

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is another name for objectivity?

A

Rater reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What does it mean if a test has HIGH objectivity? Give an example.

A

It should not matter who scores the test (the results would be the same). Ex: Multiple Choice

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What does it mean if a test has LOW objectivity? Give an example.

A

The score depends on who is scoring. Ex: Any sport where you are GIVEN a score… you do not make your score.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

True or False?
For a test to be valid, it must also be reliable.

A

False. For a test to be valid, it must also be reliable and objective.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

True or False?
A reliable test is not always valid.

A

True.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the types of validity?

A
  1. Logical Validity
  2. Content Validity
  3. Criterion Validity
  4. Construct Validity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is logical/face validity?

A

Does the test look like it measures what it is supposed to measure on the SURFACE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the problems with logical/face validity?

A
  1. Not enough evidence to say a test is valid
  2. Not statistical
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is content validity?

A

Knowledge Test: The content must match what was covered in class to the proportions covered in class.
Psychological Test: The content must match the intent of the test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What types of tests are usually used for content validity?

A

Paper/pencil tests (knowledge and psychological tests)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the problem with content validity?

A

Typically, not statistical

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the two types of criterion validity?

A
  1. Concurrent
  2. Predictive
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Describe concurrent validity.

A

Comparing your test to a known valid test/the gold standard.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

How is concurrent validity usually done? How do you know if your test is good?

A

With a correlation.
A good correlation is close to 1 or -1.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What has a strong correlation to the mile-run field test?

A

The CV test and VO2max

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What has a strong correlation to the skinfold field test?

A

DEXA

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Describe predictive validity.

A

How well a test can predict achievement in the future. Usually a set of measures, not a single measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Give 2 examples of predictive validity.

A
  1. Admission to upper education - likelihood of graduating
  2. NFL Draft - physical/psychological/cognitive tests
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is construct validity?

A

How well does the test measure the underlying construct you want to measure?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

True or False?
Constructs are always visible.

A

False. Constructs may or may not be observable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is the MAIN idea of construct validity?

A

We are trying to validate something that is not observable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

When is construct validity usually seen?

A

In psychological tests.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

True or False?
Construct validity is statistical.

A

True. They are statistical in nature.

27
Q

What are the two common methods of construct validity?

A
  1. Correlational methods
  2. Known Groups method (two groups should differ)
28
Q

How do you measure reliability?

A

By using an intraclass correlation coefficient.(ICC)

29
Q

What is the difference between ICC and Pearson’s correlation?

A

Pearson: A correlation between two separate variables
ICC: A correlation between multiple administrations of the same variable

30
Q

True or False?
Every test given may not have an error.

A

False. Every test we give has an error.

31
Q

How are reliability and error related?

A

Reliability is concerned with eliminating the error

32
Q

What are the sources of measurement error?

A
  1. Lack of agreement among scorers
  2. Lack of consistent performance from participants
  3. Failure of the instrument to measure consistently
  4. Failure of the tester to follow standardized procedures
33
Q

What are the types of reliability?

A
  1. Stability
  2. Internal Consistency
34
Q

How do you measure stability reliability?

A

Through test-retest

35
Q

How do you measure internal consistency reliability?

A

Through Cronbach’s alpha… found from ICC which is scored from 0-1.

36
Q

How are objectivity and reliability related?

A

Objectivity is a special kind of reliability (instead of multiple days/trials, there are multiple testers)

37
Q

What is the key to objectivity?

A

Training the scorers so they know what they are looking for.

38
Q

What are sensitivity and specificity used for?

A

To evaluate the performance of a diagnostic or screening test

39
Q

What does sensitivity do?

A

Tells you the ability of a test to CORRECTLY IDENTIFY individuals who HAVE a condition (true positives)

40
Q

What does specificity do?

A

Tells you the ability of a test to CORRECTLY IDENTIFY individuals who DO NOT HAVE a condition (true negatives)

41
Q

What is the golden standard for measuring physical activity?

A

Accelerometers

42
Q

What are the pros and cons of self-reported questionnaires?

A

Pros - Cheap, easy, good for intense activity
Cons - affected by recall and social desirability

43
Q

What are the pros and cons of activity logs?

A

Pros - cheap, easy, better for recall and social desirability
Cons - more difficult for participants

44
Q

What are the pros and cons of heart rate monitors?

A

Pros - Good for categorizing, low effort
Cons - validity affected by the type

45
Q

What are the pros and cons of pedometers?

A

Pros - records steps, good for running and walking, low cost
Cons - not good for upper body or twisting

46
Q

What are the pros and cons of accelerometers?

A

Pros - measure acceleration in real-time and detect movements in multiple planes
Cons - expensive, need hard/soft ware and expertise for data

47
Q

What is the golden standard for measuring cardiovascular endurance?

A

Lab Tests (Vo2max)

48
Q

What are the pros and cons of Times/distanced runs/walks?

A

Good reliability

48
Q

What are the pros and cons of shuttle runs?

A

Good reliability after a practice round, better for adults than children

49
Q

What are the pros and cons of step tests?

A

Good for test-retest

50
Q

What are the pros and cons of Treadmill/bicycle tests?

A

Pro - accurate
Con - uncomfortable for patron

51
Q

What is the difference between maximal and submaximal?

A

Maximal - go until you quit
Submaximal - Someone tells you to stop at 85%

52
Q

What are the pros and cons of Lab Tests?

A

Pros - Very accurate
Cons - uncomfortable for patron, require equipment and expertise

53
Q

What are the cons of the muscular strength and endurance tests?

A

1RM - Must follow standardized rules and potential safety concerns

Handgrip Strength - Only upper body

Push up/Pull up/Sit up - Questionable validity

Isokinetic Dynamometers - expensive and need equipment

54
Q

What is the golden standard for measuring muscular strength and endurance tests?

A

Isokinetic Dynamometers

55
Q

What are the cons of the power tests?

A

Vertical Jump - Need standardized protocols

Medicine Ball Throw - N/A

Wingate Test - Uncomfortable for patron

56
Q

What is the golden standard for measuring power tests?

A

Wingate Test - Meausres anaerobic power, 30 sec, maximal effort, resistance based on body mass

57
Q

What are the cons of body composition tests?

A

BMI - Questionable Validity (does not count muscle)

Skinfolds - depends on tester and test sites

BIA - Depends on device and hydration

Bod Pod - expensive, affected by clothing and hydration

Hydrostatic Weighing - need expertise and special equipment

Dual Energy X-ray Absorptiometry - expensive

58
Q

What is the golden standard for measuring body composition?

A

Dual Energy X-ray Absorptiometry

59
Q

What are the cons of flexibility tests?

A

Trunk Lift - Questionable validity

Goniometry - needs expertise and training

60
Q

What is the golden standard for measuring flexibility?

A

Goniometry - Looks like a protractor, and measures any joint

61
Q

How do you measure psychological variables?

A
  1. Self-Report Measures
  2. Behavioral Measures
  3. Physiological Measures
62
Q

What are other things you can measure and how do you do that?

A
  1. Skill
  2. Velocity (throwing, bat speed)
  3. Agility (short shuttle run)
  4. Speed (40-yard dash)
  5. Functional Movements (dummy carry/drag)

Research Methods Test 2 (8 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions