Observational design Flashcards
What is inter-observer reliability?
It is recommended that researchers do not conduct observational studies alone as they may miss important details or may only notice events that confirm their opinions or hypothesis which introduces bias. Inter-observer reliability measures the degree of agreement between different people observing or assessing the same thing. The data from the two observers is compared to check for: consistency and reliability and this is called inter-observer reliability
How is inter-observer reliability done ?
- Observers should familiarise themselves with the behavioural categories to be used
- They then observe the same behaviour at the same time, perhaps as part of a small scale-pilot study
- Observers should compare the data they have recorded and discuss any differences in interpretations
- Finally, observers should analyse the data from the study. Inter-observer reliability is calculated by correlating each pair of observations made and an overall figure is produced
What are the two types of ways to record data?
- unstructured observation
- structured observation
What is an unstructured observation?
- Writing down everything they see (qualitative data)
- Producing accounts of behaviour that is rich in detail
- This type of observation may be appropriate when observations are small in scale and evolve few participants
however there is to much going on in a single observation so instead….
What is a structured observation?
When the target behaviour is broken down into a set of behavioural categories (behaviour checklist)
For example, if the target behaviour was affection it could be broken down into hugging, kissing, holding hands etc…
- Behaviours are categorised
- Quantitative data is used
- Easier to compare and analyse
- Good for larger studies with lots of participants
What are behavioural categories?
A behavioural category is a specific type of behaviour which is defined before the study takes place. It allows researchers to focus their investigation on a specific behaviour in order to gather the most valid and reliable data.
What is a behaviour checklist/coding system?
This is the method used to develop behaviour categories. Using a coding system means that a code is invented to represent easy categories of behaviour
How do structured observations and sampling link?
For a structured observation a researcher must used a systematic way of sampling their observations
What are the two types of sampling for a structured observation?
- Event sampling
- Time sampling
What is event sampling?
Involves counting the number of times a particular behaviour (the event) occurs in an individual or group
What is time sampling?
Involves recording behaviour within a pre-established time frame. The observer decides in advance that observation will take place only during specified time periods (e.g. 10 minutes every hour, 3 hours per days) and records the occurrence of the specified behaviour during that period only.
Adv and disadv of event sampling?
+ Good for infrequent behaviours
- Observer may overlook important details in complex events
Adv and disadv of time sampling?
+ Reducing the number of observations needed to be made
- May miss behaviours in-between times
- May be unrepresentative
Adv and disadv of structured observations?
+ Makes the recording of data easier and more systematic.
+ Likely to produce quantitative data which makes it easier to analyse and compare.
+ Smaller risk of observer bias.
- Results aren’t as in depth and detailed.
- Some behaviours the researcher records may not be important.
Adv and disadv of unstructured observations?
+ More detailed results.
- There may be a greater risk of observer bias (no behavioural categories)
- Produces qualitative data which is more difficult to analyse.
