Reliability And Validity Of Observations

Question 1

What does reliability mean?

Answer 1

Ability to repeat an obsv in similar conditions to gain consistent results

Question 2

Does a controlled obsv have high or low reliability?

Answer 2

• high reliability
• as its a controlled env
• same conditions each time
• so control over extraneous variables

Question 3

Does a naturalistic obsv have high or low reliability?

Answer 3

• low reliability
• real life env
• not same conditions each time
• low control over extraneous variables

Question 4

What are the 2 ways to observe reliability of observations?

Answer 4

Inter - observer reliability
Test re-test

Question 5

How is inter - observer reliability carried out?

Answer 5

• 2 observers create bhv categories + be trained how to use them (context of categories)
• both then do obsv independently by watching same bhv (context) for same amount of time + tally
• tallies should be compared + correlated using a stats test
• pos correlation of +0.08 = high reliability

Question 6

How is test - retest carried out?

Question 7

How can reliability of observations be increased?

Answer 7

Operationalising = means to be specific + clear when defining coding categories to make codes easier to measure
- this is important as if bhv categories are vague, isnt possible for 2 or more observers to conduct same obsv check for consistent results as they may not be looking for same bhvs
- however operationalisatin inc reliability as… vice versa

Question 8

Besides from operationalisation, which other ways can reliability of obsv be improved?

Answer 8

• provide training to observers on how to use categories appropiately
• filming obsv so observers can practice categorising bhvs accurately + consistently
• having 2 observers can increase rel as consistency of obsv can be checked bw observers

Question 9

What are two ways to assess validity of observations?

Answer 9

Face validity
Concurrent validity

Question 10

How is face validity carried out?

Answer 10

Quickest + most superficial way to assess val

• independent psychologist in the same field
• looks at the bhv categories, (example)
• to see if it measures what it intends to, (scenario)
• at first sight
• if they say yes, obsv is valid

Question 11

How is concurrent val carried out?

Answer 11

• comparing results of new obsv and similar old obsv (context)
• that has already been been established for val
• compare + correlate both obsv results using a stats test
• pos correlation of + 0.8 = results are similar + valid

Question 12

How can validity of observations be increased?

Answer 12

• operationalise bhv categories
• train observers on how to use bhv categories
• use covert obsv as ppts bhv is more likely to be natural