Reliability

Question 1

Reliability definition?

Answer 1

the extent to which a measurement of behav is consistent

Question 2

internal reliability definition?

Answer 2

consistency within a study or measure (tool and/or researcher)

Question 3

across researchers def?

Answer 3

more than 1 researcher - is there consistency in how they are interpreting behav or carrying out the study

Question 4

inter-rater reliability def ?

Answer 4

• internal reliability
• 2+ observers watching same behaviour should have same data
• both can agree on
• mainly used in observations

Question 5

across measures reliability def?

Answer 5

• MORE THAN 1 MEASURE - if there is more than 1 test (such as used in a repeated measures design) then is there consistency of challenge in each test?

Question 6

split-half reliability def ?

Answer 6

• used to test IR
• answers to test are halved and compared - should be similar
• questionnaire/ test of behav
• ppts/ measures ect..

Question 7

External reliability definition def?

Answer 7

consistency across time (different occassions)

Question 8

across time or different occasions def?

Answer 8

• Behaviour is only measured once - the test may not measure behav consistenly at other times e.g. a personality test may only indicate ppt’s personality traits at the time the study was carried out

Question 9

test - retest reliability def?

Answer 9

• assess ER
• test scorers compared, should be same
• retested again (after a while)

Question 10

Dealing w issues of IR - more than one researcher?

Answer 10

More than 1 researcher: 
      - clearly operationalise variable so less room for 
        interpretation 
      - standardise procedures
      - detailed training of researchers

Question 11

Dealing w issues of IR - multiple measures?

Answer 11

multiple measures:

- standardize measures - make sure they are the same

Question 12

Dealing w issues of IR - within a measure?

Answer 12

within a measure:

- standardise each question or item

Question 13

method: Lab environment, reliability:?

Answer 13

High R - high control of the envir - control over EVs

Question 14

Method: field experiment, Reliability:?

Answer 14

Low R - experiment in real life conditions - low control over EVs

Question 15

Method: quasi experiment - Natural, R:?

Answer 15

Low R - naturally occurring IV -low control over EVs

Question 16

Questionnaires - Reliability?

Answer 16

High R - ppts can repeat questions ro check for consistent results

Question 17

Interview - unstructured: R?

Answer 17

Low reliability as each ppt is asked diiff questions - diff to repeat

Question 18

Interview structured: R?

Answer 18

High R - each ppt is asked the same questions so it can be repeated to check for consistent results

Question 19

Observation - controlled: R?

Answer 19

High R - behav is observed in a controlled envir - control over EVs

Question 20

Observation - naturalistic: R?

Answer 20

Low R - behav is observed in real life envir - low control over EVs

Question 21

Case study: R?

Answer 21

Low R - unique cases - impossible to repeat in same conditions

Question 22

Content analysis: R?

Answer 22

High R - behaviour categories - can be repeated/ checked by other researchers

Question 23

Assessing IR: Inter- rater reliability?

Answer 23

• all of the researchers carry out a pilot on the same ppts, if they are 80% or higher in agreement then they are reliable
• Pilot the different measures on the same ppts w/o changing the conditions and then compare their scores to ensure consistency

Question 24

Assessing IR: Split half?

Answer 24

Measure behaviour using 1st half of the test and then the second half of the test using same ppts, if scores are similar, then the test is consistent throughout

Question 25

Assessing ER?

Answer 25

• Test - retest

- The same ppts repeat the same test at another time e.g. 4 weeks later, to show a consistency over time

Question 26

How to deal with ER?

Answer 26

Ensure tests ect. Are designed in relation to measuring behaviours, attitudes ect beyond one setting or time

Question 27

What is assessing reliability?

Answer 27

Measures used to check the consistency of a set of results

Question 28

DEFINITION FOR EXAM - inter rater reliability?

Answer 28

• Method of assessing IR
• Where 2 or more psychologists in the same study produce consistent results by using a standardised procedure , agreed coding system, or correlation of their data.
• This can be checked for by comparing each psychologists results if there is 80% + agreement then = IR

Question 29

DEFINITION FOR EXAM - split half?

Answer 29

• Method of assessing IR
• Involves splitting a pp’s test answers in half and seeing whether s/he got the same or similar scores on the 2 halves. If so, IR is high

Question 30

DEFINITION FOR EXAM - test re-test?

Answer 30

• Method of assessing external R
• Involves testing and retesting the same ppts over time, with the same test, and comparing their scorers. If the scores are the same, the test has ER

Question 31

What are the issues of internal reliability?

Answer 31

1- more than 1 researcher
2 - more than 1 measure
3 - within a measure

Question 32

What are the issues of external reliability?

Answer 32

Behaviour is only measured once

Question 33

How to deal with issues of IR?

Answer 33

1- inter rater reliability

2 - split half

Question 34

How to deal w issues of ER?

Answer 34

1- test retest