Qualitative and Quantitative methods Flashcards
1
Q
why use observational methods
A
questionnaires limited applicability
- apparatus limits generalisability
- context-dependent behaviour infeasible in controlled environments
2
Q
steps of observational research
A
observe informally ask questions choose measures choose recording method design experiment run experiment analyse publish ask more questions
3
Q
choosing measures in observation
A
operational hypothesis or ostensive definitions
events or states
4
Q
what is a ostensive definition
A
provide examples through pictures or diagrams along with descriptions of behaviour of interest
5
Q
what is an ethogram
A
- full list of behavioural repertoire
- sometimes denotes quantitative description of time animal spends doing activity
- refer to complete repertoires and coding schemes in specialised studies of subset of species’ or groups behaviour
6
Q
types of measures in observation
A
- latency
- frequency
- rate
- duration
- proportion
7
Q
scales of measurement
A
nominal
ordinal
interval
ratio-interval
8
Q
recording methods, sampling rules
A
ad libitum
focal sampling
scan sampling
behaviour sampling
9
Q
what is ad libitum sampling
A
- record what ever want, for as long as want
- potential bias: miss rare events of short duration and underestimate contribution to smaller, less conspicuous subjects
10
Q
what is focal sampling
A
specific individual isolated
potential bias: can be large if focal subject seeks privacy for specific behaviours
11
Q
what is scan sampling
A
number of individuals observed
potential bias: rare events of short duration underestimated, while common events overestimated
12
Q
what is behaviour sampling
A
all-occurrences sampling
potential bias: overestimation of conspicuous events
13
Q
recording methods, recording rules
A
time sampling: instantaneous, one-zero
continuous recording
14
Q
potential biases of recording rules
A
time sampling: underestimate rare behaviours of short duration
continuous: high fidelity records, fewer categories coded, underestimate long duration behaviours as more likely truncated by end of session
15
Q
coding schemes
A
applied to observations to produce data
data isn’t standardised so can refer to videos or numerical data
16
Q
coding schemes: principles measurement
A
perfect doesn’t exist
measurements more/less accurate
measurements more/less precise
17
Q
what does accurate refer to (coding schemes)
A
correct and valid measurement
18
Q
what does precise refer to (coding schemes)
A
exactitude: reliable and replicable
19
Q
coding schemes: principle design
A
mutually exclusive
exhaustive
use category ‘other’ for behaviours not interested in
20
Q
reliability; coding scheme
A
- precision of coding scheme NOT precision of observer
- sloppy observer show low reliability but ambiguous from reliability estimate
- reliability only attributable to specific coding scheme applied by specific observer in specific spatiotemporal contexts
21
Q
intra observer reliability
A
same observer codes same behavioural record at diff times
how consistent observer is
22
Q
inter observer reliability
A
different observers independently code same behavioural record at same/different times
-how similar different observers code
23
Q
consensus measures of inter observer reliability
A
- assumption that two or more coders can come to exact agreement
- percentage agreement: not correct for random choice
- cohens kappa: proportion of agreement after correct fro random choice
24
Q
consistency measures of inter observer reliability
A
assumption that it’s unnecessary for identical interpretation
- correlation coefficient: doesn’t take into accoutn variance between coders
- cronbachs a: corrects for variance, estimates reliability for two+ coders
25
equation for percentage agreement
A / A + D
A is agreed
D is disagreed
26
equation for cohen's kappa
Pa - Pc / 1 - Pc
Pc = P(yes) + P(no)
Pa is proportion of observed agreement
Pc is expected agreement
must be 0.6+ to be good enough
27
advantage of self report
own opinions
gather large amount of data
economic
time effective
28
sources of bias in self report
social desirability
acquiescent response styles
careless responding
29
how can you avoid bias in self report
- avoid presenting options as more desirable
- use indirect items
- confidentiality and anonymity
- change between positive and negative items
- reverse phrased items
- antonymic expression
- direct negation
30
what is a nomothetic or idiographic research question
nomothetic: relating to discovery of general laws, quantitative
idiographic: relating to study of particular facts or processes, qualitative
31
what are structured, semi-structured and unstructured interviews
structured: exact same for everyone, could be written
semi: set topics and some basic items for everyone
unstructured: general themes and issues that want to discuss
32
some principles for interviews
```
funnelling
express ignorance and ask fro concrete examples
avoid double barrelled
no assumptions
no complex/jargon words
no double negatives
```
33
why should you conduct a pilot interview
helps identify problems in wording
34
what is a rapport and why is it need in interview
informal conversation to enhance disclosure
relaxed atmosphere of openness
giving space to allow unanticipated material to be brought up
35
analysis issues of interview
transcription: words? meaning? non verbal communication? what happens with transcript?
coding: complete line by line, top down or bottom up
36
what is top down and bottom up coding
top down: know what looking for
bottom up: no preconceptions, looking at concepts/categories/language
37
why do interviews
- function theoretical orientation
- exploration of topic
- give participants voice; own language, concepts, categories
- higher in validity
- subjective experiences
38
problems with interviews
over reliant on self report
need observational and behavioural measures to verify what they say is true
unstandardised questions limit comparability
interviewer effects
39
what are interviewer effects
impact of interviewer gender, ethnicity, appearance
actions of interviewer; response biases
inhibiting some answers but not others
inconsistent training
40
Types of qualitative analysis
```
thematic
IPA
grounded theory
discourse analysis
conversation analysis
```
41
what is thematic analysis
approach which identifies themes in textual material
| underpins many forms of quali analysis
42
what is a theme
pattern of meaning
| captures something important about material
43
6 steps of thematic analysis (Braun and Clarke 2006)
- familiarise self with material
- initial coding: codes = basic units of meaning
- searching for themes: play with grouping codes
- review themes: use judgement, drop, split or merge themes
- define and name themes; add narrative to explain what is interesting and why
44
problem of thematic analysis
- analyst sees five or six themes and looks for examples of it
- no justification or explanation
- no criteria
45
advantage of thematic analyssi
can be used on any quali data-set
46
what is IPA
form of qualitative analysis that makes number of psychological assumptions
analysis of subjective experiences of people's lifeworlds
47
IPA- assumptions about knowledge
people interpret world of phenomena; what we study is their interpretation of world
researchers interpret world too; interpret people's interpretations, reflexivity is built into IPA
48
designing IPA study
```
always idiographic as looking at particular cases
always about meanings
it's quality over quantity
sample size; 6-8 standard
homogenous sample
```
49
rule of transcribing
for verbatim interviews, one hour coding = 6 hour transcription
IPA alwasy begin with detailed reading and analysis of one case before move to next
50
stages of IPA analysis
- read through transcript
- identify key words or phrases; make judgment abou twhat reflects speakers experience
- identify themes; key words may be indicative
- clustering of themes; superordinate themes, connections between them
- integration of cases; use themes from first as hypotheses for rest
51
validation of IPA
validity of analytic claims is matter of their plausibility
- iterative reading; stick to data and return to it
- ask self are these instances similar/different?
- present illustrative quotes for each themes
52
thematic vs IPA
- TA for analysisng social media, IPA for interview
- TA atheoretical, IPA psychological assumptions
- IPA recommends specific sample size
- IPA builds codes and themes from single case
53
characteristics of thematic analysis
flexible
transparent (clearly explain decisions made at each step)
recursive
54
types of comments in IPA coding
descriptive: describing content of what participant says, subject of talk
linguistic: exploring specific use of language by participant
conceptual: engaging at more interrogative and conceptual level
55
ways to cluster themes (Smith 2009)
Abstraction: basic form of identifying patterns between emergent themes and developing 'super-ordinate theme'
subsumption: the emergent theme itself becomes the superordinate
polarisation: opposing themes
contextualisation: consider wider context
numeration: taking account of frequency of theme
function: function in transcript
56
what is discourse analysis
- analysis of talk and text in their own right
| - distinctive way of thinking about textual material; construction of reality
57
stages of DA
```
formulate research Q
gather material
read text 2-3 times
coding; select and organise data
analysis; what language constructs, what kind of people defines, functions of talking about things in that context, suggest other words or phrases that might have been used instead
```
58
rhetorical devices in DA
```
disclaimer
stake inoculation
extreme case formulation
category entitlement
passive voice
three part list
identity claim
```
59
what is a disclaimer
Explicit disavowal of very stance or opinion speaker advocates
60
what is stake inoculation
Claim they have prior interest before they are challenged on it
61
what is extreme case formulation
Semantically extreme word or phrase to defend or justify description/assessment
62
what is category entitlement
Give special credence to certain categories of people that are entitled to make specific knowledge claims
63
what is passive voice
Downplays responsibility of actor in relation to verb
64
what is identity claims
persona along with the degree or range of power a particular person can claim in a specific discourse
65
validity of DA
participant orientation: if speaker treats constructs differently then we can too
written presentation allows readers to judge
66
reliability fo DA
if same material examined more than once, do get same answer?
rhetorical devices are specific and identifiable that can relate to for consistency
67
advantages of DA
gives tools to study how people do things with words and how language constructs reality
study power
study any topic
wide variety of data types
68
disadvantages of DA
doesn't allow for usual generalisations
| relativism: only comment on the language not what it represents
69
what is a latent variable
can't be observed directly
| label given to collection of experiences or events or representations of things
70
what is moderation
alludes to combined effect of two variables on outcome
| a third variable influences the relationship between outcome and predictor
71
what is mediation
when the relationship between a predictor variable and an outcome variable can be explained by their relationship to a third variable
72
model of mediation
```
total effect = indirect effect + direct effect
c' = ab + c
a = X influence on M
b = M influence on Y
c = X influence on Y
```
73
when to use mediation
if you can use a linear model, you can use mediation
correlational : investigate process through which objective measures are related to outcomes (underlying psychological process)
experimental: investigate how experimental manipulation influences DV
74
steps of mediation analysis
-simple regression of total effect of X on Y
-indirect effect: simple regression of X -> M and M-> Y controlling for X
-direct effect: multiple regression controlling for M
ALL UNSTANDARDISED B'S
75
how to analyse mediation
bootstrapped confidence intervals of indirect effect
| if 95 CI not include zero, then indirect effect is treated as significant
76
statistical model of moderation
three predictors in linear model, X, W and XW
77
grand mean centring
- for deviations around fixed point
- transform variable so it has mean of zero
- subtract mean from each participant's score, do for both predictor and moderator
78
interpreting significant interactions
use simple slope analysis or johnson-neyman interval
simple: at what mean of the moderator is the direction of effect and if its sig
J-N: plots line when relationship is zero, anything above is positive and anything below is negative
