Research methods Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

What is the difference between an aim and a hypothesis?

A
  • An aim is a general statement made by the researcher which tells us what they plan on investigating
  • A hypothesis is a precise statement which clearly states the relationship between the variables being investigated
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the experimental method?

A

While all other variables are held constant, one variable is manipulated (IV) and the effect of this on another variable is measured (DV)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the difference between a directional and non-directional hypothesis?

A
  • A directional hypothesis states which way you think the results are going to go
    E.g. Eating smarties will significantly improve an individual’s dancing abilities
  • A non-directional hypothesis simply states that there will be a difference between the two groups/conditions but does not say which will be greater/smaller, quicker/slower etc
    E.g. There will be a difference in male and female performance in a driving test
    Used when there is little or no research or the findings are ambiguous
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is a natural experiment?

A

A natural experiment is an experiment in which the IV is not brought about by the researcher hence would have happened even if the researcher had not been there e.g. if studying reactions to earthquakes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the limitations of a natural experiment? (A03)

A
  • Natural occurring events: may be rare so these experiments are not likely to be replicable - hard to generalise findings
  • Very difficult to randomise participants into groups: confounding and extraneous variables become a problem
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are true experiments?

A

True experiments control the variables under investigation, and randomly allocate participants to groups

Lab and field experiments are both true experiments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is an extraneous variable?

A

An extraneous variable is any variable that you’re not investigating that can potentially affect the outcomes of your research study

Doesn’t vary systematically with the IV - nuisance variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is a confounding variable?

A

A confounding variable is a variable other than the independent variable that systematically affects the dependent variable

Difficult for the researcher to be sure of the origin of the impact of the DV as the confounding variable could have been the cause

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the difference between randomisation and standardisation?

A
  • Randomisation is the use of chance to reduce the effect of bias from investigator effects
  • Standardisation describes using the exact same formalised procedures and instructions for every single participant involved in the research process - eliminates non-standardised instructions as possibly extraneous variables
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is operationalisation?

A

Making sure your variables are in a form that can be easily tested

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the strengths of a natural experiment? (A03)

A

+ Provides opportunities: for research that would have otherwise been impossible due to practical/ethical reasons
+ High external validity: dealing with real-life issues

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are the 4 types of experiments?

A

Laboratory, field, natural, quasi

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is a lab experiment?

A

A lab experiment is an experiment that takes place in a special environment whereby different variables can be carefully controlled

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are demand characteristics?

A

Demand characteristics refer to any cue the researcher or research situation may give which makes the participant feel like they can guess the aims of the investigation. This can cause the participant to act differently within the research situation from how they would usually act.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the 3 types of experimental design?

A

Independent groups
Repeated measures
Matched pairs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is a field experiment?

A

A field experiment is an experiment conducted in a more natural environment, not in a lab but with variables still being well controlled

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are the strengths and weaknesses of a field experiment?

A

Strengths:
- Naturalistic: so more natural behaviours hence high ecological validity
- Controlled IV

Limitations:
- Ethical considerations: invasion of privacy and likely to be no informed consent
- Loss of control: due to extraneous variables hence precise replication not possible

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is independent groups design?

A

Two different groups experience two different conditions - the IV is naturally occurring

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is a strength and weakness of quasi experiments? (A03)

A

+ Controlled conditions: hence replicable, likely to have high internal validity
- Cannot randomly allocate participants: may be confounding variables presented - makes it harder to conclude that the IV caused the DV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What are the weakness of lab experiments? (A03)

A
  • Experimenter’s bias: can affect results and participants may be influenced by these expectations
  • Low ecological validity: high degree of control makes situation artificial, unlike real life
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is the difference between external validity and internal validity?

A
  • External validity refers to the extent to which the results of a study can be generalized to other settings (ecological validity), other people (population validity), and over time
  • Internal validity is a measure of whether results obtained are solely affected by changes in the variable being manipulated (i.e. by the IV) in a cause-and-effect relationship
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is a quasi experiment?

A

A quasi experiment is an experiment whereby the IV has not been determined by the researcher, instead it naturally exists, e.g. gender difference studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What are the strengths of a lab experiment? (A03)

A

+ High degree of control: all variables are controlled, IV has been precisely replicated - greater accuracy
+ Replication: researchers can repeat experiments and check results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What are the strengths of independent groups design?

A

+ Order effects can’t be observed as no participants are used in more than one condition
+ Data collection is less time-consuming - all conditions of the experiment can be conducted simultaneously

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What are the weaknesses of independent groups design?

A
  • Different participants need to be recruited for each condition - expensive
  • Risk of participant variables affecting results between conditions, not just manipulation of the IV
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What is an example of an independent groups experiment?

A

A study on sleep that explores how different amounts of sleep affect people’s reaction times. Whilst one group had 10 hours of sleep per night, the other group had 3
- IV: the amount of sleep (the manipulated variable).
- DV: (the measured variable) was their recorded reaction time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What is repeated measures design?

A

All participants take part in all conditions - same participants allocated to all groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What are the strengths of repeated measures design?

A

+ Results won’t be subject to participant variables
+ Same participants used twice so extra participants do not need to be recruited

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What are the weaknesses of repeated measures design?

A
  • Risk of observing order effects, but this risk be reduced by counterbalancing (controlling order of variables so each order combination occurs the same number of times)
  • If a participant drops out, data will be lost from all conditions of the experiment, not just one
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What is an example of a repeated measures experiment?

A
  • A study investigates whether Quizlet helps A-level psychology students better than traditional textbooks, assessing learning with tests
  • If the researchers conduct a repeated measures experiment, all participants will use Quizlet and standard textbooks
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What is matched pairs design?

A

A pair of participants are matched bases on key variables (age ,gender etc). One member is put in the control group and the other in the experimental group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What are the strengths of matched pairs design?

A

+ Order effects will not be observed as participants only take part in one condition

+ Reduced risk of participant variables affecting results between conditions - tailored participant-matching process

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What are the weaknesses of matched pairs design?

A
  • Different participants needed for each condition- difficult and expensive
  • Matching is a complex process - difficult to match participants identically, so identical twins are often used
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

What is an example of a matched pairs experiment?

A

A study of 100 people for a new diet - each subject would be paired with another subject similar to them and then randomly allocated to either the control or experimental group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

What are the 3 order effects?

A
  • Demand characteristics- subtle hints that suggest to the participant what the experimenter predicts or hopes to find in the study
  • Boredom
  • Fatigue
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

What is random sampling?

A

This method gives every member of the target group an equal chance of being selected for the sample by assigning a number to each member, and then selecting from the pool using a random number generator

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

What are the strengths of random sampling?

A

+ Representative - each member has the same probability of being selected
+ No researcher bias - researcher has no influence over who is picked

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

What are the weaknesses of random sampling?

A
  • Time consuming - need to have a list of the population (sampling frame) and then contacting them takes time
  • Volunteer bias - participants can refuse to take part so can end up with an unrepresentative sample
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

What is opportunity sampling?

A

Participants happen to be available at the time which the study is being carried out so are recruited conveniently

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

What are the strengths and weaknesses of opportunity sampling?

A

+ Easy method of recruiting which is time saving and less costly
+ Covnenient

  • Not representative of the whole population -findings can’t be generalised
  • Researcher bias is presented as they control who they want to select
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

What is systematic sampling?

A

A predetermined system is used whereby every nth member is selected from the sampling frame consistently

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

What is a strength and weakness of systematic sampling?

A

+ Avoids researcher bias and usually fairly representative of the population
- Not truly unbiased unless you use a random number generator then start the systematic sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

What is stratified sampling?

A
  • Stratified sampling involves selecting participants in such a way as to recreate the same proportions of those sub-groups (strata) that exist in the population
  • Then select the sample from each strata using random number generators
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

What are the strengths of stratified sampling?

A

+ No researcher bias - the selection within each strata is done randomly
+ Produces representative data due to the proportional strata so generalisation is possible

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

What are the weaknesses of stratified sampling?

A
  • Time consuming to identify strata and contact people from each
  • Not completely representative - the identified strata can’t reflect all differences between the people of the wider population
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

What is volunteer sampling?

A

Involves self-selection whereby the participant offers to take part either in response to an advert or when asked to

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

What are the strengths and weaknesses of volunteer sampling?

A

Strengths:
- Easy and not time-consuming - quick access to willing participants
- As participants are willing to take part, they are more likely to cooperate in the study

Weaknesses:
- Volunteer bias - may attract a particular profile of a person (keen, curious) - generalisation is affected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
48
Q

What are pilot studies?

A
  • Small, trial versions of proposed studies to test their effectiveness and make improvements
  • They allow for modification of methodology where necessary
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
49
Q

What are the strengths of pilot studies?

A

+ A pilot study allows a researcher to decide whether or not it will be worthwhile to conduct a planned study on a larger scale
+ A pilot study also provides the researchers with practice of running the study before the full data gathering begins, allowing all aspects of the study to go more smoothly

50
Q

What are the ethical standards in psychology?

A

Can Do Can’t Do With Participants

C- informed Consent: participants must be told the aims of the experiment and any possible risks they may be subject to by participating
D- Deception: the act of deliberately witholding information from participants
C- Confidentiality & privacy:
D- Debrief: telling participants the general aim of the study
W- right to Withdraw: at any point in the study
P- Protection from harm: participants must be protected from physical and psychological harm

51
Q

What are the 3 types of consent?

A

Retrospective
Presumptive
Prior general consent

52
Q

What is retrospective consent?

A

Participants are asked for their consent after they have taken part in the study

53
Q

What is presumptive consent?

A

When a researcher gathers opinions from a group like the participants in the study but does not inform the actual participants

54
Q

What is prior general consent?

A

Participants give consent to take part in many studies whereby one of them involves deception, so effectively they are consenting to being deceived

55
Q

What are the different observational techniques?

A

naturalistic, controlled, overt, covert, participant, non-participant

56
Q

What is naturalistic observation?

A

Naturalistic: takes place in the setting or context where the target behaviour would usually occur and all aspects of the environment are free to vary

57
Q

What is a strength and weakness of naturalistic observation?

A

+ High external validity as findings can be generalised to everyday life - studied in natural environment
- Lack of control over research situation makes replication hard and introduces extraneous variables

58
Q

What is a controlled observation?

A

Controlled: likely to be caried out in a psychology lab, in a carefully controlled and structured environment (no IV or DV) e.g Bandura’s Bobo doll study

59
Q

What is a strength and weakness of
controlled observations?

A

+ Extraneous variables are less of a factor due to high levels of control so replication is easier
- May produce findings that can’t be readily applied to real-life settings

60
Q

What is an overt observation?

A

Overt: participants know their behaviour is being observed and they have given informed consent - the observer is clearly visible

61
Q

What is a strength and weakness of an overt observation?

A

+ More ethically acceptable
- The knowledge participants have that they’re being observed could influence their behaviour - demand characteristics

62
Q

What is a covert observation?

A

Covert: participants are unaware they are the focus of the study and their behaviour is observed in secret

63
Q

What is a strength and weakness of a covert observation?

A

+ Participants don’t know they’re being watched which removes participant reactivity and demand characteristics - increased validity
- Unethical as people may not wish to have their behaviours recorded

64
Q

What is a participant observation?

A

Participant: the researcher joins in with the situation being observed

65
Q

What is a strength and weakness of a participant observation?

A

+ The researcher experiences the situation as the participants do which gives them increased insight into the lives of those being studied - increases validity
- The researcher may come to identify too strongly with participants and lose objectivity (going native)

66
Q

What is a non-participant observation?

A

Non-participant: the researcher doesn’t actively become involved in the behaviour being studied - separate from the research situation and doesn’t engage

67
Q

What are the strengths and weakness of a non-participant observation?

A

+ Researcher can be more objective as less likely to identify with participants
- Open to observer bias e.g. stereotypes
- Researcher may lose some valuable insight

68
Q

What is time sampling?

A

Time sampling: the recording of a behaviour within a time frame that is pre-established before the observational study

69
Q

What is a strength and weakness of time sampling?

A

+ Reduces the number of observations that have to be made so less time consuming
- The small amount of data you collect within that time frame ends up being unrepresentative of the observation as a whole

70
Q

What is event sampling?

A

Event sampling: this involves the counting of the number of times a particular behaviour is carried out

71
Q

What is a strength and weakness of event sampling?

A

+ Good for infrequent behaviours that are likely to have been missed if time sampling was used
- Hard to distinguish the end and begininning of a behaviour

72
Q

What are the weaknesses of event sampling?

A
  • Counting errors if the behaviour is very frequent
  • Difficult to judge the beginning and ending of a behaviour
  • If complex behaviour is being observed, then important details may be overlooked
73
Q

What are behavioural categories?

A
  • Involves breaking the target behaviour down into components that can be observed and measured
  • When conducting structured observations, psychologists have to decide which specific behaviours should be examined
  • They operationalise the behaviour through behavioural categories
74
Q

What are self-report techniques and what are the different types?

A

They are a non-experimental research method in which participants report on their own thoughts or behaviour without researcher inference
e.g. questionnaires, interviews (structured or unstructured)

75
Q

What are questionnaires?

A

Questionnaires: involve a pre-set list of written questions to which a participant responds - a study that uses a questionnaire is often called a survey

76
Q

What are the strengths of questionnaires?

A

+ Cost effective: gather large amounts of data quickly as they can be distributed to large numbers of people
+ Less effort: can be conducted without the researcher being present (postal questionnaire)
+ Easy to analyse

77
Q

What are the weaknesses of questionnaires?

A
  • Social desirability bias: particpants may lie to give answers expected of them (demand characteristic)
  • Leading questions: questions worded in a way that encourages a certain answer from participants
  • Misunderstanding: participants could misinterpret questions
78
Q

What is the difference between open and closed questions?

A

Open: questions where there is no fixed choice of response
Closed: questions where there is a fixed choices of responses

79
Q

What are the different types of closed question questionnaires?

A

Likert scale: the respondent indicates agreement with a statement, ranges from strongly agree to strongly disagree

Rating scale: works similarly but gets respondents to identify a value that represents their strength of feeling about a particular topic

Fixed choice scale: the question includes a list of possible options and respondents are required to indicate those that apply to them

80
Q

What is the difference between structured interviews and non-structured interviews?

A

Structured interview: made up of a predetermined set of questions that are asked in a fixed order

Unstructured interview: more like an everyday conversation - interviewer may begin with certain planned questions but then follow these up or ask other questions spontaneously

81
Q

What are the strengths of interviews?

A

+ Unstructured interviews provide potential to gather rich and detailed information from each participant
+ The conversational nature of unstructured interviews is best suited to discussing complex/sensitive issues - participants are more likely to relax and give better responses
+ Structured interviews are easy to replicate

82
Q

What are the weaknesses of interviews?

A
  • Time and expense involved when training interviewers
  • Social desirability bias can be a problem with self-report techniques, i.e. participants give responses that are thought to be the most socially acceptable, rather than necessarily truthful.
  • Interview data can be a time-consuming task to analyse and interpret when it is so detailed
83
Q

What are the do’s and dont’s when constructing interviews?

A
  • Interview schedule
  • Standardised - reduces interviewer bias
  • Single or group interviews
  • Reminder of ethical issues
  • Avoid leading questions
  • Avoid overuse of jargon
  • Avoid double-negatives
84
Q

What is the difference between qualitative and quantitative data?

A

Qualitative: data displayed in words that is non-numerical
Quantitative: data that is displayed numerically

85
Q

What are the strengths and weakness of qualitative data?

A

+ More richness and depth of detail
+ Allows participants to further develop their opinions hence has greater external validity
+ More meaningful insight into participants views
- Difficult to analyse and make comparisons with other data
- Researcher bias as conclusions made rely on the subjective interpretations of the researcher

86
Q

What are the strengths and weaknesses of quantitative data?

A

+ Can be analysed statistically so can be converted to graphs or charts
+ Easy to compare with other data
- Lack of depth in detail
- Participants aren’t able to develop their opinions so results have low external validity

87
Q

What is the difference between primary and secondary data?

A
  • Primary data: information is obtained firsthand by the researcher for the purpose of the investigation
  • Secondary data: when information is collected by someone else other than the researcher e.g. government statistics, journals
88
Q

What are the strengths and weaknesses of primary data?

A

+ Targets the exact information the researcher needs so the data fits their aims and objectives
- Requires time and effort
- Can be expensive

89
Q

What are the strengths and weaknesses of secondary data?

A

+ Easily accessible
+ Inexpensive to collect and requires minimal effort
- Likely that data is outdated or incomplete
- Data may be unreliable - researcher wasn’t there when the study was being conducted so could be unsure of validity of the results

90
Q

What is meta-analysis?

A

Meta-analysis: when the researcher combines results from many different studies and uses all the data to form an overall view of the subject they are investigating

91
Q

What is a strength and weakness of meta-analysis?

A

+ More generalisablity is possible as a larger amount of data is studied
- Publication bias: when the researcher intentionally doesn’t publish all the data from the relevant studies but instead chooses to leave out negative results - gives a false representation of what the researcher was investigating

92
Q

What is are the strengths and weaknesses of the mean?

A

+ Sensitive as it makes use of all values

  • Influenced by extreme values so it can be unrepresentative
93
Q

What are the strengths and weaknesses of the median?

A

+ Unaffected by extreme values

  • Not as sensitive as the mean as it doesn’t use all values
94
Q

What are the strengths and weaknesses of the mode?

A

+ Useful for data in categories

  • Not useful when there are several modes
95
Q

What are the strengths and weaknesses of the range?

A

+ Easy to calculate

  • Affected by extreme values
  • Doesn’t use all values
96
Q

What are the strengths and weaknesses of standard deviation?

A

+ Precise measure where all data values are taken into account

  • Difficult to calculate
  • Affected by extreme values
97
Q

What are correlation coefficients?

A

This value determines the strength and relationship between two variables

  • Negative correlation: less than 0
  • Positive correlation: more than 0
  • Zero correlation: equal to 0
98
Q

What are the strengths of correlations?

A

+ Can be used as starting points to assess patterns between covariables before committing to conducting an experimental study
+ Quick and economical to carry out

99
Q

What are the weaknesses of correlations?

A
  • Difficult to establish a cause and effect relationship as only an association is found
  • Third variable problem is presented: a third variable which the researcher is unaware of that is responsible for the relationship between the co-variables
  • Correlations tend to be misused or misinterpreted especially when made public by the media
100
Q

What is a normal distribution?

A

A symmetrical spread of frequency data that forms a bell-shaped pattern. The mean, median and mode are all located at the highest peak

101
Q

What is a skewed distribution? What are the two types?

A

Skewed distribution: a spread of frequency data that is not symmetrical, where the data clusters at one end

Positive skew
Negative skew

102
Q

What is the difference between a positive and negative skew?

A

Positive: A type of frequency distribution in which the long tail is on the positive (right) side of the peak and most of the distribution is concentrated on the left
Mode < mean, median

Negative: A type of frequency distribution in which the long tail is on the negative (left) side of the peak and most of the distribution is concentrated on the right.
Mode > mean, median

103
Q

What is the distinction between bar charts and histograms?

A
  • Bar charts are used for discrete data (categorical)
  • The bars don’t touch which show we are dealing with separate conditions
  • Histograms are used for continuous data
  • The bars touch
104
Q

What is statistical testing?

A

Provides a way of determining whether hypotheses should be accepted or rejected. In psychology, they tell us whether differences or relationships between variables are statistically significant or have occurred by chance.

105
Q

What is the sign test?
What is the significance value?

A

A statistical test used to analyse the difference in scores between related items.

0.05

106
Q

What are the 3 conditions in order to use the sign test?

A
  1. A difference between variables
  2. Used repeated measures design
  3. Collected nominal data
107
Q

When might a researcher employ a 1% significance value?

A
  • When research may involve human cost
  • When a particular investigation is a one-off and there is no possibility of the research being repeated
108
Q

What 3 things must you look for when looking at a critical value table?

A
  • One-tailed or two-tailed hypotheses
  • Number of participants
  • Significance level (0.05)
109
Q

How do you carry out the sign test?

A
  1. Calculate difference between two sets of data
  2. Add up total number of “+’s” and “-‘s”
  3. The least frequent sign is S value - calculated value
  4. Go to critical value table - calculated ‘S’ value must be equal to or less than the critical value to be significant
110
Q

What is peer review?

A

The assessment of scientific work by experts in the same field, it is done to make sure all research intended to eventually be published is of high quality

111
Q

What are the main purposes of peer review?

A
  • To know whether research is worthwhile hence funding can be allocated to it
  • To validate the relevance and quality of research -> prevents fraudulent research being released to the public
  • To suggest possible improvements or amendments to the research study
112
Q

Reliability

A
  • Measure of consistency
  • A test/study is reliable if the same results are consistently found when it is replicated under the same conditions
113
Q

What are the two types of reliability?

A

Internal reliability: The extent something is consistent with itself

External reliability: The extent a test measure is consistent over time

114
Q

What are the ways of assessing reliability?

A
  • Test-retest: measures external reliability
  • Split-half method measures internal reliability
  • Inter-observer reliability
115
Q

What are the 2 ways of assessing reliability of questionnaires?

A
  • Test-retest: adminster the same test/questionnaire to the same person/people on different occasions
  • If same result is found per participant = external reliability
  • A reliable should have a correlation coefficient of +0.8
  • Split half: researcher splits the test in half & analyses the responses given to the first half of the questionnaire compared to the second half - similar responses in both halves = internal reliability
116
Q

How is reliability assessed in observations?

A
  • Inter-observer reliability: the level of consistency between two or more trained observers when they conduct the same observation - record their observations separately + correlated at the end to assess reliability
  • All observers must agree on the behaviour categories + how they are going to record them before observation begins
  • Observation conducted separately to avoid conformity
    After observational period:
  • Observers compare the 2 independent data sets (often designed as a tally chart)
  • They then test the correlation between the 2 sets - strong positive correlation shows good inter-observer reliability + behaviour categories are reliable
117
Q

What are the different ways of improving reliabilty?

A
  • Questionnaires: not complex or ambiguous questions (avoid misniterepetation), replace open questions with closed ones
  • Interviews: same interviewers, all interviewers are trained to avoid leading & ambiguous questions, structured interviews
  • Experiments: lab studies most reliable - controlled conditions; standardised procedure; random allocation to conditions; control group for comparison; generate quantitative data
  • Observations: behavioural categories are operationalised, measurable & self-evident (no overlaps)
118
Q

What is validity?

A
  • Measure of legitimacy and accuracy
  • The extent to which a test/measurement tool accurately measures what the study sets out to
119
Q

What is the difference between external and internal validity?

A
  • Internal validity: measures whether the results are due to to the manipulation of the independent variable and not confounding variables
  • External validity: measures whether the results can be generalised beyond the research setting
120
Q

What are the other types of validity?

A

Ecological validity: whether it can be generalised to other settings

Population validity: whether it can be generalised to other people

Temporal validity: when it can be generalised over time

121
Q

What are the different ways of assessing reliability?

A
  • Face validity: assesses whether something is what it looks like, to what extent the item looks like what it measures
  • Concurrent validity: assesses through correlation, correlating the scores from research already existing and known to be valid
  • Predictive validity: Assesses validity by predicting how well a test does at predicting future behaviour
  • Temporal validity: Assesses how valid it remains over time
122
Q

What are the different ways of improving validity?

A
  • Experimental research: control group (shows changes in DV were from IV), standardisation (minimises participant reactivity + investigator effects), single-double blinds
  • Questionnaires: anonymity (social desirability), lie-scale
  • Observations: covert observations, behavioural categories
  • Qualitative research: interpretive validity, triangulation (using many different sources as evidence)