Lecture 7 Flashcards

Validity, accuracy, sensitivity and friends

1
Q

There will always be error in dietary assessments. The challenge is to …..

A

understand and estimate the error structure during analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is validity

A

The extent to which a method gives you the “correct” answer ie measures what you want it to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

P1 and P2 of validity

A

P1- Analysing anthropometric data
P2- Anthropometry assignment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is absolute validity

A

reference method requires surreptitious measurement of intake

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what is relative validity

A

reference method is another indirect method of assessing intake

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what is repeatability

A

the extent to which a method gives you the same answer each time you use it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what is repeatability also known as

A

reproducibility, reliability and precision

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what are the issues to consider in a FFQ validation study

A

appropriate reference method = that does not require memory
study sample = needs to be accurate of what you are wanting to asses
timeframe = reference and FFQ should be over same timeframe
methods of statistical analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Accuracy

A

accuracy is best used in a restricted statistical sense to describe the extent to which the measurement is close to the true value,

it has an important effect on the validity of the study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what is measurement error

A

difference between the measured value and the true value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

observed intake is equal to

A

true intake + measurement error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what are the two types of measurement error

A

random error and systematic error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

measurement error leads to

A

attenuation of relationships
bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

random error is due to

A

chance or normal variation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

does random error change the mean

A

no it doesnt

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

random error increases….., therefore

A

variability around the mean, therefore decreased repeatability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

what are the main sources of random error

A
  • daily variation in consumption
  • inaccurate portion size estimation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

can random error be removed

A

not totally

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

systematic error is far more

A

concerning than random error

20
Q

systematic error causes

A

results to depart from the true value in constant direction (bias)

21
Q

systematic error changes ……, therefore

A

changes the mean, therefore decreased validity

22
Q

what are the main types of systematic error

A
  • selection bias (non-representative sample)
  • measurement bias (incorrect calibration)
23
Q

can systematic error be removed

A

can’t be removed by statistical analysis

24
Q

what is non response bias

A

people dont volunteer to participate

people dont adhere to intervention

people drop out

25
in non response bias, a non representative sample may
may under or over estimate effects
26
what are the strategies to minimise non response bias
- minimise response burden - mail or phone reminders - offer material rewards - train interviewers so warm and trusted - identify non responders and characterise - over sample groups at risk of non-responding
27
what is respondent bias
bias introduced by the respondent
28
what are the three main types of respondent bias
- low energy reporting - over reporting - social desirability and approval bias
29
what are the strategies to minimise respondent bias
- pre test methods - interviewer training - private interviews - identify flawed data - identify participants at risk
30
what is interviewer bias
bias introduced by the interviewer
31
interviewer bias may be caused by
incorrect recording intentional omissions poor cultural sensitivity
32
what are the strategies to minimise interviewer bias
standardised computer interviews train interviewers identify problem interviewers
33
what are the two forms of respondent memory lapses
errors of omission errors of commision
34
what are errors of omission
like when you forget something you ate
35
what are errors of comission
can’t remember but will fill it in with something else
36
respondent memory lapses may be more likely …
- longer time period to be recalled - men - age extremes - distracting environments
37
what are strategies to avoid respondent memory lapses
multiple pass interviewing techniques - like when they have uninterrupted recall and then probing questions minimise time between intake and recall work with information retrieval
38
incorrect portion estimate is probably
the largest source or error
39
incorrect portion estimation is when they fail to
accurately quantify amount eaten
40
incorrect portion estimation impacts
all ages, BMI, SES and genders
41
what are the strategies to minmising incorrect portion estimation
- measurement aids - train interviewers - train respondents
42
what is the definition of supplements
there is no uniform definition of supplements
43
omission of supplements leads to
- systematic underestimation of nutrient intake - overestimation of prevalence inadequacy
44
what are the strategies to minimising omission of supplements
structured questionnaire on long term intake closed ended questions on : brand, amount per unit, frequency of use, duration of use interviewer sights supplement
45
what is sensitivity
how good the test / method is at correctly identifying people who have the disease / low status
46
what is specificity
how good the test / method is at correctly identifying people who are well / have adequate status