Reliability and validity

Question 1

What is internal reliability?

Answer 1

Describes the extent to which a measure is consistent within itself

Question 2

What is used to demonstrate and test internal reliability?

Answer 2

Split-half method

Item analysis

Question 3

What is the split-half method?

Answer 3

Th test is randomly divided into two so that each half is equivalent. Internal reliability is demonstrated if the participants scores are similar on both halves

Question 4

What is item analysis?

Answer 4

Performance on each item is compared with the overall score. A good positive correlation suggests high internal reliability

Question 5

What is external reliability?

Answer 5

Describes the extent to which a measure varies from one use to another.

Question 6

How can external reliability be tested and demonstrated?

Answer 6

Test re-test
Inter-observer reliability
Inter-interviewer reliability
Replication

Question 7

What is test re-test?

Answer 7

The same person is tested twice over a period of time. Similar scores demonstrate high external validity

Question 8

What is inter-observer reliability?

Answer 8

The ratings from more than one person are correlated to check for agreement. If correlation is low, it may be due to poorly designed behavioural characteristics

Question 9

What is inter-interviewer reliability?

Answer 9

Different interviewers should produce the same result when interviewing the same person, or the same interviewer should produce the same result when interviewing the same person on 2 different occasions. If the results are not the same, the interviewer may need some more careful training

Question 10

What is replication?

Answer 10

Any research study should produce similar findings if repeated

Question 11

What is internal validity?

Answer 11

Describes the extent to which a study measures what it intends to measure.
About how other variables are controlled and extent that we can be certain that any changes in the DV were a result of the manipulation of the IV rather than the extraneous variables

Question 12

The higher the control in an experiment…

Answer 12

The higher the internal validity

Question 13

What is experimental realism?

Answer 13

A factor affecting internal validity
Refers to when a participants does not believe in the experimental set up and they may simply act so the results are meaningless.
The higher the experimental realism, the more a participant is involved with the task as if it were real

Question 14

What is mundane realism?

Answer 14

A factor affecting internal validity

Refers to things that are similar to everyday activities

Question 15

How can internal validity be measured?

Answer 15

Face validity
Criterion validity
Predicative validity

Question 16

What is face validity?

Answer 16

The items look like they measure what the test says it measures

Question 17

What is criterion validity?

Answer 17

Whether people who do well on the test do well on related things

Question 18

What is predicative validity?

Answer 18

Whether people who perform well on the test go on to be good at things you would expect them to be good at

Question 19

What is external validity?

Answer 19

Describes the extent to which the findings from a study can be generalised to everyday life and situations other than the context of the study

Question 20

What is ecological validity?

Answer 20

Described the extent to which the findings of a study can be generalised from the setting it was conducted to other settings

Question 21

What is population validity?

Answer 21

The study may use a restricted group of participants limiting how much the findings can be generalised