Research Methods : Validity and Reliability

Question 1

What is reliability?

Answer 1

How consistent results are
• reliable methodologies produce the same/ similar results each time

Question 2

What is test-retest reliability?

Answer 2

Measures test consistency/ reliability power time
• two tests get correlation 0.8+, results are reliable

Question 3

What is inter-rater reliability?

Answer 3

The degree of agreement among raters
• height correlation (0.8+) = reliable

Question 4

What is validity?

Answer 4

The extent to which something is measuring what it is claiming to measure (valid methodologies measure what they claim to)

Question 5

What is internal validity?

Answer 5

The extent to which a study establishes a cause-and-effect relationship between IV and DV

Question 6

What is external validity?

Answer 6

The extent to which a study can be generalised yo other settings (real life)

Question 7

What is ecological validity?

Answer 7

Whether data is generalised to the real world

Question 8

What is population validity?

Answer 8

How well the sample used can be generalised to a population as a whole

Question 9

What is temporal validity?

Answer 9

Whether the results are still valid today

Question 10

What is constrict validity?

Answer 10

Whether a test measures the intended theoretical construct

Question 11

What is concurrent validity?

Answer 11

A test correlating well with other measures of the same construct

Question 12

What is a predictive validity?

Answer 12

A test accurately predicting outcomes it should theoretically predict

Question 13

What is face validity?

Answer 13

Whether a test measures what it clams to measure

Question 14

Androcentric bias

Answer 14

When only male participants are used

Question 15

Gynocentric bias

Answer 15

When only female participants are used

Question 16

Nomothetic approach

Answer 16

Focusing on common, shared features

Question 17

Idiographic approach

Answer 17

Focusing on what makes us unique

Question 18

Ethnocentric

Answer 18

Cultural bias

Question 19

Methodologies

Answer 19

specific procedures, techniques and processes researchers use

Question 20

Generalisability

Answer 20

The extent to which results apply outside the specific study conditions

Question 21

Improving reliability: Observations

Answer 21

Improve training given to raters to increase accuracy

Question 22

Improving reliability: Interviews

Answer 22

Use structured rather than unstructed interviews

Question 23

Improving reliability: Experiments

Answer 23

Use standards procedures/ established tests rather than new ones

Question 24

Improving reliability: Questionnaires

Answer 24

Use closed rather than open questions

Question 25

What is internal reliability?

Answer 25

The extent to which different parts of a measure are consistent with itself

Question 26

What is external validity?

Answer 26

The extent to which a measure is reliable when repeated