RM L4: Reliability + Validity -

Question 1

Define the term ‘validity’

Lesson 4

Answer 1

• Whether the study measured what it was supposed to measure
• Extent to which the finidngs can be generalised to ppl being studied
• Whether the experiment represents the real life situation (mundane reaisim)

Question 2

Define the term ‘subjectivity’

Lesson 4

Answer 2

• When personal thoughts, opinions, feelings affect how a researcher interprets the data
• Qualitative data has more risk of subjectivity than quantitative

Question 3

Define the term ‘objectivity’

Lesson 4

Answer 3

• When researcher interprets data without any personal bias
• Results will be more reliable / valid
• Quantitative data makes it easier to be objective

Question 4

What is internal validity?

Lesson 4

Answer 4

• How much the findings of a test / method are due to the manipulation the independent variable rather than another factor

Question 5

What is external validity?

Lesson 4

Answer 5

• How much the findings of a test / method can be generalised to different settings
• How much the findings can be generalised to real life situations and the target population

Question 6

What can affect the internal validity of an experiment?

Lesson 4

Answer 6

• Demand charecteristics can affect the internal validity as ppts acting in a certain way as they know the aim of the experiment

Question 7

What is ecological validity?

Lesson 4

Answer 7

• The extent to which the behaviour of the ppts shown in research relates to how they would react in real life
• Research conducted in normal real life settings -> field experiment -> high ecological validity
• Research conducted in fake unreal settings -> labratory experiment -> low ecological validity

Question 8

What is generalisability?

Lesson 4

Answer 8

• The extent to which the findings from a study can be applied to a population
• Depends on sample size, sample selection, experiment set up

Question 9

What is reliability?

Lesson 4

Answer 9

• focus on the consistency of study
• If test the ppts again would we get the same results - are they reliable?

Question 10

What is replicability?

Lesson 4

Answer 10

• Can other psychologists repeat the study and get consistent results?
• Can we replicate the experiment and get the same / similar findings -> if yes then study is reliable

Question 11

What is inter rater observer reliability?

Lesson 4

Answer 11

• test of consistency between observers when watching same behaviour / action by participant
• Observation may be continual or record at 10,20,30,40 secs
• After task compare records for consistency -> did you see what I saw?
• Can train observers by having them watch pre recorded sequences so they can replay an event and agree if behaviour was shown or not
• The extent of how much 2 ppl agree
• Judge at the olympics

Question 12

What is test retest reliability and how do we do it?

Lesson 4

Answer 12

• Test of consistency in questionnaire based manner
• When we make a questionnaire that gives quantitative data we can do test retest reliability analysis to see if the questionnaire is a reliable measure

1. Create a questionnaire that produces quantitative data
2. Allow group of ppts to complete questionnaire
3. After set time frame (2weeks+) get same ppts to do same questionnaire again
4. Calculate overall scores for 2 times to see if positive correlation

If strong positive correlation -> questionnaire is a reliable measure