Validity and Reliability Flashcards

1
Q

What is a pilot study?

(Why do we do this?)

A

A pilot study is a small scale version of an investigation that takes place before the real investigation is conducted. The aim is to check that the procedures, materials, measuring scales, etc, work and to allow the researcher to make changes or modifications if necisarry

(The whole thing is the definition)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is a case study?

A

An in depth study, using a range of methods, on 1 person or a small group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the advantages of using case studies?

A

Rich data - researchers get the ability to study rare phenomena in a lot of detail
Unique cases cases challenge the existing ideas and theories and make suggestions for future research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the disadvantages of using case studies?

A

With casual relationships cause and effect can’t be determined
Generalisability is limited
Ethics - informed consent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Give an example of a famous case study

A

Little Hans (Freud)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Are case studies usually reliable?

A

Yes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Why aren’t Freud’s case studies reliable?

A

They aren’t scientific

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Why are case studies reliable?

A

Increases reliability by the process of repetability
Often case studies are done to see if further research is merited

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Define reliability?

A

The overall consistency of a measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is internal reliability?

A

The extent to which a test is consistent within itself (the test is testing what it is ment to be testing)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is external reliability?

A

The ability for a test to have a consistent measure from one use to another. (Give the same results)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

For an experiment to be reliable what needs to be the case?

A

It gives similar results whenever it is done
The study must have standardised procedures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the different methods used to assess reliability?

A

Inter rater reliability
Split half method
Test retest method
Inter observer reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Explain the method of assessing reliability: Inter rater reliability?

A

This is when 2 or more researchers do the observation and they get the same outcome on 80% or more of the behaviours

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Explain the method of assessing reliability: split half method?

A

You have 2 questions that are similar. You check to see if the participants answers match up or not. This helps see if there is social desirability bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Explain the method of assessing reliability: test retest method

A

This is when someone repeats the experiment a month or so after the initial experiment

17
Q

What is internal validity?

A

A study is high in internal validity when the study measures what it claims to measure

18
Q

What is external validity?

A

The extent the results the study can be generalised to others (aka ecological validity)

19
Q

In 1 word describe reliability and then validity?

A

Reliability = Consistency
Validity = Accuracy

20
Q

What are the different ways of assessing validity?

How should they be thought of?

A

In the form x validity
Face
Concurrent
Predictive
Temporal
Content

They should be thought as: a study has face validity

21
Q

Explain face validity?

A

A test is valid if it has produced predicted results

22
Q

Explain concurrent validity?

A

A test is valid when results from a new test can be compared to a preciously well established test

23
Q

What is predictive validity?

A

The degree to which a test scores accurately predicting scores on a criteria
Eg if a diagnosis is valid if it leads to successful treatment

24
Q

What is temporal validity?

A

This assess if past data is still relevant today

25
Q

What is content validity?

A

A study has content validity if experts in the field have checked the content of the case study

26
Q

What is population validity?

A

A study has population validity if you can reasonably generalise your samples to the general population

27
Q

How can you increase the reliability of questionnaires?

A

Use the test - retest method

The studies should have a correlation that exceeds +.80

28
Q

How do you increase the reliability of interviews

A

Making sure the interviewer doesn’t ask leading questions and that the questions are clear

Using a structured interview

29
Q

How do you increase the reliability of experiments

A

Precise replication of a particular method

30
Q

How do you increase the reliability of observations?

A

Making sure the categories are properly operalisationalised
Measurable and self evident
Categories should not overlap

31
Q

Explain the method of testing reliability: inter observer reliability

A

An observation should give similar results when done by two or more reserchers to be reliable

32
Q

What is the difference between inter rater and inter observer reliability?

A

One is for observations the other is for everything else