Lesson 8: Reliability, Validity and Control of Extraneous Variables

Question 1

What is reliability

Answer 1

Reliability refers to the consistency of a research study especially when a study is repeated again and the same results are gained on both occasions.

Question 2

What are the 2 types of reliability

Answer 2

External and internal

Question 3

What is external reliability

Answer 3

External Reliability:
This is whether a test and the results gained are consistent over time.
The test-retest method can be used to assess external validity. A research study is conducted once, and then it is conducted again in the future. If the results gained from the both tests are similar then the study can be said to be reliable.

Question 4

What is internal reliability

Answer 4

this is whether a test and the results gained are consistent within itself
the split half technique assesses the internal reliability of questionnaires
the questionnaire is split in half and if pps score similarly on both halves of the questionnaire then the questions are measuring the same factors and the questionnaire has internal reliability

Question 5

What is validity

Answer 5

Validity:
Validity means that a study is measuring what it intends to measure when referring to the aim of the study.

Question 6

Different types of validity

Answer 6

Participant
Temporal
Interval
External, ecological

Question 7

What is ecological validity

Answer 7

this is the extent to which the findings of a study can be generalised to other settings

Question 8

What is participant validity

Answer 8

The results from the participants used in the study can be generalised to the target population

Question 9

What is temporal validity

Answer 9

Temporal validity:
The results from the study can be generalised to people in today’s contemporary setting

Question 10

What is internal validity

Answer 10

This is when the outcome of the study is a direct result of the manipulation of the independent variable (IV) upon the dependent variable (DV) and has not been affected by extraneous variables (EV).

Question 11

What are the 3 categories of extraneous variables

Answer 11

Participants variables
Situational variables
Experimenter variables

Question 12

What are participant variables

Answer 12

These are characteristics of the participants which may affect the DV (e.g. intelligence, age, gender, personality etc.). Choosing an appropriate experimental design can help to try and overcome these type of extraneous variables. Matched pairs and repeated measures design can help to avoid participant variables.
However, repeated measures can lead to order effects, so counterbalancing should be used to avoid this. Random allocation of participants to conditions (e.g. by drawing names out of a hat) should also ensure that groups are not biased.

Question 13

Why must extraneous variables be controlled

Answer 13

To ensure study has internal validity

Question 14

What are situational variables

Answer 14

These are factors in the environment where the experiment is conducted that could affect the dependent variable (e.g. temperature, time of day, lighting, noise etc.).
A way to resolve this issue is to use standardisation (i.e. making sure that all the conditions, materials, and instructions are the same for all participants).

Question 15

What are experimenter variables

Answer 15

These are factors to do with the experimenter which can affect the dependent variable, for example personality, appearance, and conduct of the experimenter. Standardised instructions should ensure that the experimenter acts in a similar way with all participants and follows a script and speaks to everyone in the same manner and tone.

Question 16

What are investigator effects and how can it be overcome

Answer 16

Investigators may inadvertently influence the results of their research. Certain physical characteristics of the investigator, such as age, gender. and ethnicity can influence the behaviour of participants which therefore affects the data that is collected from the research.

If investigators know the hypothesis they may also inadvertently be biased in their interpretation of the results. Observer bias and interviewer effects are a type of investigator effects.

Investigator effects can be overcome by the double blind technique. This is when neither the participants nor the investigator knows the aim of the study and hopefully this will mean the data collected will be more valid.

Question 17

What are demand characteristics and how can they be overcome

Answer 17

There are many features of research studies that may enable participants to guess the main aim of the research and what is expected of them. This can lead to the participant trying to please the experimenter by giving the results they think the experimenter wants. Or participants might try to annoy the researcher by giving incorrect results, acting unnaturally out of nervousness, or acting unnaturally out of social desirability.

Demand characteristics can be overcome by the single blind technique. This involves making sure pps do not know what the aim of the study is so that hopefully this will not influence their behaviour unduly. This is more difficult to accomplish in a repeated measures design.