anatomy and physiology of clinical research part 4

Question 1

Learning objectives

Answer 1

At the end of this lecture, you should be able to:

Understand the different types of variables in a clinical study / trial.

Understand the concept of hypothesis testing and sample size effects and how they are applied in a clinical study / trial.

Distinguish between accuracy and precision, and ways to improve accuracy and precision respectively.

Understand how statistical issues are encountered in a clinical study / trial.

Distinguish statistical significance from biological significance.

Appreciate and understand the applications of the abovementioned points to real-world scenarios.

Question 2

2 types of variables

Answer 2

continuous variable and categorical variable

Question 3

Continuous variable

Answer 3

quantitative variable which are interval and ratio

Question 4

Categorical variable

Answer 4

qualitative variable which are nominal, dichotomous and ordinal

Question 5

Interval (example of continuous variable)

Answer 5

Quantified on infinite scale & have a numerical value.

E.g. temperature scale

Question 6

Ratio (example of continuous variable)

Answer 6

Interval variables but with added condition that zero of the measurement indicates that there is none of the variable
E.g. Height, weight, distance, number of cigarettes.

Question 7

What is interval

Answer 7

These are variables which are able to be quantified on an infinite scale and which have a numerical value e.g. temperature, Fahrenheit

The scale can take on both positive and negative values

It is assumed that the intervals keep the same importance throughout the scale

This allows us not only to rank order the items that are measured but also to quantify and compare the magnitudes of differences between them

Question 8

What is ratio

Answer 8

These are interval variables, but with the added condition that 0 of the measurement indicates that there is none of the variable. Hence temperature is not a ratio variable as 0 does not indicate that there is no temperature.

The name ratio reflects that you can use the ratio of measurements e.g. distance of 10 m is twice the distance of 5 m

Examples of ratio variables include height, weight, distance, number of cigarettes

Question 9

What is nominal variable

Answer 9

These are variables that have 2 or more categories, but which do not have an intrinsic order
E.g. Blood type for human, there are 4 distinct groups, A, B, AB and O. So blood type is a nominal variable with 4 categories

They tend to have a qualitative and absolute character that makes them very straight forward to measure e.g. 35 people have blood type O

Question 10

What is dichotomous variable

Answer 10

These are nominal variables which have only TWO categories or levels
E.g. gender, we would most likely categorize someone as “male” or “female”
E.g. “Dead” or “Alive”
E.g. do you own a mobile phone? Or do you have blood type O? the answer would be either a “Yes” or “No”

Question 11

What is ordinal variable

Answer 11

These are variables that have two or more categories just like nominal variables only that the categories can also be ordered or ranked.

E.g. how often do you consume soya milk? The answer could be “not at all”, “occasionally”, “very frequently”
E.g. how severe is the pain associated with a heart attack? The answer could be “mild”, “moderate” or “severe”

In both examples, you have 3 categories and able to rank them from in the first case, least positive to the most positive and in the second example from the most positive to the least positive

Although we can rank the levels or categories, which gives ordinal variables an advantage over the nominal variables, they do not specify a numerical or uniform difference between one category and the next

Question 12

Example of ordinal variable : Temperature in DC or F

Answer 12

Zero is an arbitrary point on the scale – it has a value or form of any degree

Zero on the scale does not mean there is no temperature

The difference between -1 and 1 is the same as the difference between 2 and 4 or the difference between 50 – 60 is the same as the difference between 77 – 78

Temperature in Kelvin where zero is an absolute zero – zero is meaningful.

Question 13

what kind of variable is temperature

Answer 13

continuous variable (interval)

Question 14

what kind of variable is weight

Answer 14

continuous variable (weight)

Question 15

what kind of variable is gender

Answer 15

categorical variable (dichotomous)

Question 16

what kind of variable is stage of cancer

Answer 16

continuous variable (ordinal)

Question 17

what kind of variable is eye color

Answer 17

continuous variable (nominal)

Question 18

what kind of variable is blood type

Answer 18

continuous variable (nominal)

Question 19

what kind of variable is education level

Answer 19

continuous variable (ordinal)

Question 20

what kind of variable is satisfaction level

Answer 20

continuous variable (ordinal)

Question 21

what kind of variable is birth weight

Answer 21

continuous variable (dichotomous)

Question 22

what kind of variable is bubble tea consumption

Answer 22

continuous variable (ordinal)

Question 23

BP in mmHG

Answer 23

continuous

Question 24

normotensive vs hypertensive

Answer 24

categorical - dichotomous

Question 25

low, normotensive, moderately hypertensive, severely hypertensive

Answer 25

ordinal

Question 26

Advantages of using continuous (ordinal variables)

Answer 26

A good general rule is to prefer continuous variables, because the additional information they contain improves statistical efficiency

The continuous variable contains more information and the result is a study with more power and might result in the need of a smaller sample size.

Even when categorical data is more meaningful, however it is still better to collect data as continuous variables as this would leave the analytical option open

Question 27

what is precision

Answer 27

The precision of a variable is the degree to which it is reproducible, with nearly the same value each time it is measured.

Precision has a very important influence on the power of a study (the ability of a study to detect a difference that is real), the more precise the measurement, the greater the statistical power at a given sample size to estimate mean values and to test hypothesis (proposed explanation for a phenomenon)

This is a function of random error, the greater the error, the less precise the measurement

//

Precision represents how close different sample measurements you take are to one another, and accuracy represents how close those sample measurements are to the true measurement

//

Precision has a very important influence on the power of a study (the ability of a study to detect a difference that is real)

The more precise the measurement, the greater the statistical power at a given sample size to estimate mean values and to test hypothesis (proposed explanation for a phenomenon)

This is a function of random error, the greater the error, the less precise the measurement

Question 28

what is accuracy

Answer 28

The accuracy of a variable is the degree to which it actually represents what it is intended to represent.

This has an important influence on the validity of the study (the degree to which the observed findings lead to the correct inferences about phenomena taking place in the study sample and in the universe)

Accuracy is a function of systematic error (bias), the greater the error, the less accurate the variable. The three main classes of measurement error noted for precision each have their counterparts here.

//

Accuracy is a function of systematic error (bias), the greater the error, the less accurate the variable. The three main classes of measurement error noted for precision each have their counterparts here.
Observer bias – is a distortion, conscious or unconscious, in the perception or reporting of the measurement by the observer. It may represent systematic errors in the way an instrument is operated e.g. the tendency to round down measurements, or in the way an interview is carried out e.g. the use of leading questions etc.
Instrument bias – this can result from a faulty function of a mechanical instrument. A scale that is not calibrated recently may have drifted downward, producing consistently low BW readings
Subject bias – is a distortion of the measurement by the study subject, e.g. reporting an event. Patients with lung cancer who believe that the number of cigarettes smoked per day is the cause of the disease would exaggerate the number of cigarettes they smoke per day
The accuracy of a measurement is best assessed by comparing it, when possible to a “gold standard”. This is a reference technique that is considered to be accurate.

Question 29

Illustration of accuracy

Answer 29

Accuracy can be illustrated by throwing the darts onto the centre of the target (the true value).

Question 30

illustration of precision

Answer 30

Precision can be illustrated by throwing the darts closer to each other.

Question 31

the 3 sources of random errors

Answer 31

Observer variability – variability in the measurement that is due to the observer and includes aspects such as skill in using a mechanical instrument, methods of asking questions and conducting interviews etc.

Instrument variability – variability in the measurement due to changing environmental factors e.g. temperature, aging mechanical components, different reagent, different brand etc.

Subject variability – intrinsic biologic variability in the study subjects due things such as mood, time of last medication, food intake etc.

Question 32

what are random errors

Answer 32

Random errors are errors that affect the precision of a measurement. Random errors are two-sided errors, because, in the absence of other types of errors, repeated measurements yield results that fluctuate above and below the true or accepted value.

Measurements subject to random errors differ from each other due to random, unpredictable variations in the measurement process.

Question 33

5 ways to improve precision

Answer 33

1. standardizing measurement methods - written directions and guidelines, creating SOP,
2. training and certifying observers - improve the consistency of measurements technique
3. refining instruments - mechanical and electronical instruments
4. automating instrument - the influence of random error is reduced by repeating the measurements and using the mean of 2 or more readings

Question 34

Standardizing the measurement methods

Answer 34

All the study protocols should include operational definitions (specific instructions for making the measurements)

This includes written directions on how to prepare the environment and the subject, how to carry out and record the interview etc.

The operational manual is essential for large and complex studies and recommended for smaller ones.
Specific written guidelines for making each measurement will help the observer’s performance and ensure uniformity over the duration of the study.
This will also serve as the basis for describing the methods when the results are published

Question 35

Training and Certifying the Observers

Answer 35

Training will improve the consistency of measurement techniques especially when several observers are involved.

It is often desirable to design a formal test of the mastery of techniques specified in the operations manual and to certify that observers have achieved the prescribed level of performance

Question 36

Refining the instruments

Answer 36

Mechanical and electronic instruments can be engineered to reduce variability

Questionnaires and interviews can also be written in a certain style/manner to avoid potential ambiguities and to increase clarity

Question 37

Automating the instruments

Answer 37

The use of automated mechanical devices and self-response questionnaires can reduce observer variability by eliminating variations in the way human observers make measurements

Question 38

Repetition

Answer 38

The influence of random error from any source is reduced by repeating the measurement and using the mean of the two or more readings.

Precision will be substantially increased by this strategy

The limitation being the added cost and practical difficulties of repeating the measurements

Question 39

Making Unobtrusive Measurements

Answer 39

It is sometimes possible to design measurements that the subjects are not aware of, thereby eliminating the possibility that they will consciously bias the variable.

Example: A study on healthy eating patterns for school children, could measure the number of candy bar wrappers in the trash rather than questioning each child on the number of candy he or she consumes

Question 40

Calibrating the instruments

Answer 40

The accuracy of many instruments, especially those that are mechanical or electrical can be increased by periodic calibration using a gold standard

Question 41

Blinding

Answer 41

This is intended to ensure that subjective assessments and decisions are not affected by knowledge of treatment assigned.

Different groups should be treated and observed in the same way during a trial

Clinical trials are often “double blinded” to ensure that subject and investigators (as well as investigator staff) involved in the treatment or clinical evaluation of subjects are unaware of the subject’s assigned treatment.

Blinding is intended to minimize the potential biases resulting from differences in management, treatment or assessment of patients or interpretation of results that could arise as a result of subject or investigator knowledge of assigned treatment

Examples include
Subjects on active drug might report more favorable outcomes, because they expect a benefit or might be more likely to stay in a study if they knew they were on active drug

Observers might be less likely to identify and report treatment responses in a non-treatment group or might be more sensitive to a favorable outcome or adverse event in patients receiving active drug

Question 42

Hypothesis testing

Answer 42

Research hypothesis is a specific version of the research question that summarizes the main elements of the study

Hypothesis testing is needed for studies that will use test of statistical significance to compare findings among groups
Most observational studies
ALL experimental research questions involved in making comparisons

Stating the hypothesis in advance would help the researcher and research efforts focused on the primary objective

Question 43

Null hypothesis

Answer 43

States that there is NO association between the predictor and outcome variables in the population

Question 44

Alternative hypothesis

Answer 44

The proposition that there is an association between predictor and outcome variable

Question 45

Statistical significance

Answer 45

Statistical significance means that there is a good chance that we are right in finding that a relationship exists between two variables.

But statistical significance is not the same as practical significance. We can have a statistically significant finding, but the implications of that finding may have no practical application. The researcher must always examine both the statistical and the practical significance of any research finding.

Question 46

A one-sided hypothesis

Answer 46

Specifies the direction of the association between the predictor and outcome variable.

A one sided hypothesis may be appropriate when there is a very strong evidence from prior studies that an association is unlikely to occur in one of the two directions

Question 47

A two-sided hypothesis

Answer 47

States only that an association exists and does not specify the direction.

This is usually the case as both sides of the alternate hypothesis (i.e. greater or lesser) are interesting and investigators would want to publish results no matter which direction is observed