Research Methods Flashcards
All AS and A2 research methods on the AQA psychology specification are covered as part of this deck
1
Q
Significance level most often used in Psychology
A
P<0.05
2
Q
Determination that the results are significantly strong to reject the null hypothesis
A
Significance
3
Q
The likelihood that certain events will occur
A
Probability
4
Q
The value a test statistic must reach in order to consider the result significant
A
Critical value
5
Q
The value of a statistic that is calculated for a particular data set (outcome of the stats test)
A
Calculated value
6
Q
(False-positive) occurs if an investigator falsely rejects a null hypothesis that is actually true in the population
A
Type I error
7
Q
(False-negative) occurs if an investigator fails to reject a null hypothesis that is actually false in the population
A
Type II error
8
Q
Decreasing the probability of a type I error increases…
A
the probability of a type II error
9
Q
How to decrease the likelihood of a Type I error
A
Use a smaller significance level (P<0.01)
10
Q
How to decrease the likelihood of a Type II error
A
Increase the sample size in the study
11
Q
Choose the test: Difference, nominal data, Independent Measures
A
Chi Squared (x2)
12
Q
Choose the test: Difference, at least ordinal data, independent measures
A
Mann Whitney U (U)
13
Q
Choose the test: difference, interval/ratio data that is normally distributed, Independent measures design
A
Unrelated t-test (R)
14
Q
Choose the test: difference, nominal data, repeated measures
A
Sign test (S)
15
Q
Choose the test: difference, at least ordinal data, repeated measures design
A
Wilcoxon t test (T)
16
Q
Choose the test: difference, internal/ration data that is normally distributed, repeated measures deign
A
Related t-test (R)
17
Q
Choose the test: Correlation, nominal data
A
Chi Squared (x2)
18
Q
Choose the test: correlation, at least ordinal data
A
Spearman’s Rho (Rs)
19
Q
Choose the test: Correlation, interval/ratio data that is normally distributed
A
Pearson’s product moment
20
Q
Sign test: should the calculated value be greater than or less than for significance?
A
Equal to or less than
21
Q
Mann Whitney U: should the calculated value be greater than or less than for significance?
A
Equal to or less than
22
Q
Wilcoxon: should the calculated value be greater than or less than for significance?
A
Equal to or less than
23
Q
Chi Squared: should the calculated value be greater than or less than for significance?
A
Equal to or greater than
24
Q
Unrelated t test: should the calculated value be greater than or less than for significance?
A
Equal to or greater than
25
Related t test: should the calculated value be greater than or less than for significance?
Equal to or greater than
26
Spearman's Rho: should the calculated value be greater than or less than for significance?
Equal to or greater than
27
Pearson's Product moment: should the calculated value be greater than or less than for significance?
Equal to or greater than
28
Which inferential statistic do I have to calculate by hand?
Sign test
29
Qualitative data
Expressed in words, in depth-non numerical (thoughts, feelings etc).
30
Quantitative data
Numerical data
31
Primary data
Obtained first hand by the researcher for the purpose of the current study
32
Secondary Data
Information already collected by others or already in existence so pre-dates current project
33
Meta-analysis
Combining the findings from a number of studies on a particular topic for an overall conclusion
34
Examples of descriptive statistics
Central tendency, measures of dispersion, charts and graphs
35
Measures of central tendency show what
The average of a set of data (mean, median or mode)
36
The mean is..
found by adding all scores and dividing by the number of scores - the arithmetic average
37
The median is..
The central/middle value (once all data is in order)
38
The mode is...
The most frequently occurring value
39
Strength of the mean
Most representative as it uses all the data scores
40
Weakness of the mean
Easily distorted by outliers
41
Strength of the median
Unaffected by extreme scores/outliers
42
Weakness of the median
Less sensitive (ignores extreme values that may be important!)
43
Strength of the mode
easy to calculate
44
Weakness of the mode
Crude, not very useful, doesn't represent all the data, might me more than one!
45
Measures of dispersion show..
The spread of data (range or standard deviation)
46
The range is
overall data spread. Biggest value minus the smallest value
47
Strength of the range
Easy to calcuate
48
Weakness of the range
Doesn't take into account all data, extreme values only
49
The standard deviation is
a measure of the average deviation from the mean
50
How do you calculate standard deviation?
Step 1: Find the mean.
Step 2: For each data point, find the square of its distance to the mean.
Step 3: Sum the values from Step 2.
Step 4: Divide by the number of data points.
Step 5: Take the square root.
51
What type of graph should I use to represent the strength and direction of a correlation?
Scatter graph/Scattergram
52
When plotting a scatter gram which co-variable goes on the X axis?
It doesn't matter!
53
What type of graph represents the frequency of each variable by the height of its spaced columns and is only used with Discrete data?
Bar Chart
54
When plotting a bar chart which variable goes on the X axis?
The categories (the IV)
55
What type of graph displays continuous data and uses the height and width of touching bars to show frequency?
Histogram
56
The X axis of a histogram must start at..
True 0
57
What does the Y axis of a histogram represent?
the frequency
58
A summary table would display...
Raw data
59
A normal distribution graph looks like...
a Bell curve, symetrical
60
In a normal distribution the mean, median and mode are
The same (at the highest peak of the curve)
61
In a normal distribution the tails of the curve never touch what?
The X axis (they are never 0)
62
A distribution curve that is not symmetrical is known as..
a Skewed distribution
63
In a positively skewed distribution the curve leans..
towards the Y axis
64
In a positively skewed distribution, the longer tail is on the left or right?
The right
65
In a negatively skewed distribution the curve leans..
away from the Y axis
66
In a negatively skewed distribution, the longer tail is on the left or right?
left
67
In a skewed distribution curve, the measures of central tendency appear in what order (starting at the top of the curve working down the tail)?
Mode, median, mean
68
In a normal distribution curve - what percentage of people appear within 1 standard deviation of the mean (either side)?
68%
69
In a normal distribution curve - what percentage of people appear within 2 standard deviations of the mean (either side)?
95%
70
In a normal distribution curve - what percentage of people appear within 3 standard deviations of the mean (either side)?
99.7%
71
A positive correlation is
As one variable increases so does the other
72
A negative correlation is
As one variable increases the other decreases
73
Zero correlation is
No relationship between variables
74
How can we tell the strength of a correlation
How tightly packed the points are around the line of best fit or correlation coefficient
75
A statistical measure of the strength and direction of a linear relationship between two variables is known as..
Correlation Coefficient
76
Correlation Coefficient is between..
+1 and -1
77
A correlation coefficient of 0.1-0.3 (positive or negative) is what strength relationship?
Weak
78
A correlation coefficient of 0.4-0.6 (positive or negative) is what strength relationship?
Moderate
79
A correlation coefficient of 0.7-0.9 (positive or negative) is what strength relationship?
Strong
80
A correlation coefficient of 1 (positive or negative) is what strength relationship?
A perfect correlation
81
DV Data which is in rank order (ranked or rated)
Ordinal data
82
DV data which is categorical
Nominal data
83
DV data which is measured in fixed units with equal distance between points on the scale or set intervals
Interval data
84
Which variable determined the level of data in a study?
Dependent variable
85
Name a qualitative method of data analysis
Content analysis or thematic anaylsis
86
In a content analysis what technique is performed on the data?
Coding
87
Content analysis converts qualitative data to
Quantitative data
88
Thematic analysis produces what type of data?
Qualitative
89
strucLab experiment is..
IV is directly manipulated under controlled setting to measure the impact on a DV
90
Field experiment is
IV is directly manipulated in natural settings to measure the impact on a DV
91
Natural experiment is
The CHANGE in an IV is natural and would have occurred without the presence of the researcher (e.g. before and after a natural disaster - no direct manipulation by a researcher) DV is measured
92
a Quasi experiment is
IV is already occurring (e.g. ethnicity) and so cannot be directly manipulated - the impact on DV is measured
93
Strength of a lab experiment
controlled conditions increase reliability and internal validity
94
Weakness of a lab experiment
setting isn't natural = behaviour isn't natural and results lack ecological validity
95
strength of a field experiement
Higher ecological valdity
96
weakness of a field experiment
lacks control and internal validity
97
strength of a natural experiment
high external validity, unique study opportunity
98
weakness of a natural experiment
rare, less likelihood of causality
99
strength of a quasi experiment
unique insight free from manipulation (less demand characteristics)
100
weakness of a quasi experiment
cannot randomly allocate - less chance of causality (participant variables)
101
Naturalistic observation is
conducted in natural settings
102
Controlled obervation is..
conducted in controlled settings
103
Covert observation is..
participants are unaware they are being studied
104
Overt observation is...
participants are aware they are being studied
105
Participant observation is...
observer is part of the observed group
106
Non-participant observation is..
observer is not part of the observed group
107
1 strength and 1 weakness of naturalistic observations..
+ natural behaviour
- uncontrolled EVs
108
1 strength and 1 weakness of covert observations
+ Natural behaviour
- ethical issues
109
1 strength and 1 weakness of participant observations
+ increased insight (validity)
- loss of objectivity
110
Unlike experiments observations have no...
IV
111
Self report techniques are..
participants explain their own thoughts, feelings or behaviours (questionnaire/interview)
112
A questionnaire is..
A written set of questions (or items) to assess thoughts and experiences
113
Questionnaires can contain open questions; true or false
True
114
1 strength and 1 weakness of a questionnaire
+ cost effective to gather large datasets quickly and easy to analyse
- limited/socially desirable responses
115
An interview where there are no set questions - only the topic is set
Unstructured interview
116
An interview where all questions are pre-determined
Structured interview
117
An interview where some questions are pre-determined but researchers can ask follow up questions as needed
Semi-structured interview
118
1 strength and 1 weakness of a structured interview
+ Easy to replicate
- limits richness of data
119
1 strength and 1 weakness of an unstructured interview
+ rich in depth data
- increased bias and hard to compare/replicate
120
A correlation measures..
relationships
121
The variables in a correlation are called
Co-variables
122
The three outcomes of a correlational study are;
positive, negative and no correlation
123
Correlations cannot guarantee what..
Causation! (a relationship, not a different or affect - always could be 3rd variables)
124
1 strength and 1 weakness of a correlational study
+ starting point for future research, quick and easy as uses secondary data often
- is not causation, always a risk of 3rd variables, can be misused
125
A case study is
an indepth study of one or a small group of people
126
Case studies can be carried out over a long period - this is called
Longitudinal research
127
1 strength and 1 weakness of case studies
+ in depth, can be longitudinal and use lots of measures to understand the individual so can check for concurrent validity
- cannot be replicated, many EVs, subjective
128
A content anaylsis is
used to quantify qualitative data by changing it into frequencies using coding
129
1 strength and 1 weakness of content analysis
+ useful, ethical, reliable (inter-rater)
- hard to establish objective coding units, loses richness of data, time consuming
130
Thematic analysis is
a qualitative method which identifies, analyses and reports themes (patterns) within data
131
1 strength and 1 weakness of thematic analysis
+ useful, check concurrent data as you apply themes to new data sets, keeps richness of data
- Subjective, time consuming
132
An 'aim' in research is...
A general statement of what the researcher wants to investigate
133
A hypothesis is
A clear testable statement that states a relationship or effect between variables
134
A one tailed hypothesis is
Directional - it predicts the direction of the outcome (e.g. which group will perform better)
135
A two tailed hypothsis is
Non directional - it predicts there will be a difference/relationship but not in which direction
136
When do researchers tend to use a directional hypothesis?
When there is previous research on the topic
137
When do researchers tend to use a non-directional hypothesis?
When there is no previous research or it is contradictory
138
Independent variable
the variable that the researcher MANIPULATES or that changes naturally (the cause)
139
Dependent variable
the variable the researcher MEASURES (the effect)
140
What is meant by 'levels of the IV'
The experimental conditions participants are in e.g. if the IV is Amount of Caffeine the levels may be 'Caffeine' and 'No Caffeine'
141
What is the term for clearly defining your variables in terms of how they can be measured?
Operationalisation
142
What is the 'baseline' condition called in an experiment?
Control group
143
An extraneous variable is
A variable outside of the IV which has the capability to affect the DV if not controlled
144
How is an extraneous variable different to a confounding variable?
EVs dont systematically vary with the DV so have the capability to affect the DV is not controlled. CVs do vary with the IV so it's impossible to tell if this has affected the DV or not! It has confounded our results!
145
Participants react to cues from the researcher/environment and this is known as
Participant reactivity
146
These are cues from the research regarding the AIM which lead to the potential of participants changing their behaviour.
Demand characteristics
147
What are the behavioural consequences of demand characteristics?
The please-U effect (over-perform to please the researcher) or the screw-U effect (underperform to sabotage the research).
148
The investigator may (consciously or unconsciously) affect the participant's behaviour, this is known as...
Investigator effects
149
A method to control the effects of bias when designing materials and deciding the order of experimental conditions
Randomisation
150
A method of controlling for investigator effects by keeping all procedures the same for each participant
Standardisation
151
A control method where the participant is not aware of the research aims to prevent demand characteristics
Single blind procedure
152
A control method where the participant is not aware of the research aims to prevent demand characteristics and the researcher is not aware of the aims to prevent researcher bias
Double Blind Procedure
153
What is meant by experimental designs?
The different ways in which participants are organised in relation to the experimental conditions
154
Name the experimental design: different participants complete different levels of the IV and the two separate groups are compared.
Independent measures design
155
Name the experimental design: Pairs of participants are matched on a variable relevant to the DV with one being assigned to condition A and the other to B. The two separate groups are then compared.
Matched pairs design
156
Name the experimental design: all participants take part in all conditions of the experiment and the two groups are them compared.
Repeated measures design
157
1 strength and 1 weakness of an independent measures deign
+ no order effects, less chance of demand characteristics
- more participant variables, more time consuming and costly
158
1 strength and 1 weakness of repeated measures design
+ controls for participant variables, more economical
- more chance of order effects, more chance of demand characteristics
159
1 strength and 1 weakness of a matched pairs design
+ controls for participant variables, reduces order effects and demand characteristics
- can never match participants exactly, time consuming/costly
160
What is meant by order effects?
Performance in a second set of conditions is improved (practice effect) or worsened (fatigue/boredom effect) compared to the first
161
How might you control for order effects?
Counterbalancing or use an independent measures design
162
What is counterbalancing?
the ABBA technique - participants complete the conditions in different order to spread out order effects.
163
How can you control participant variables?
Repeated measures design, matched pairs design, random allocation to conditions
164
What is meant by the 'population'
A group of people who are the focus of the research from which the sample are drawn
165
The group of people who take part in the research and are presumed to represent a larger target population are called...
Sample
166
The methods used to collect your sample are collectively known as
Sampling techniques
167
What is meant by a random sample?
All members of the target population have an equal chance of being selected for the sample
168
How is a random sample collected?
- Get a complete list of all names of people in the target population
- assign each name a number
- use a lottery method to select X amount (picking from a hat, computer method)
169
1 Strength and 1 weakness of random sampling
+ potentially unbiases due to the laws of chance = increase internal validity
- time consuming and could still be unrepresentative particularly is some refuse to take part (then its more like a volunteer sample)
170
What is systematic sampling?
Selecting every nth person in a population
171
How is a systematic sample collected?
- Create a sampling frame (organised list of everyone in the population e.g. alphabetical)
- Choose a sampling system (every 3rd or 5th for example)
- start your sampling from a random point
172
1 Strength and 1 weakness of systematic sampling
+ Objective as the researcher has no influence over participant selection
- time consuming and if participants refuse it becomes biased like a volunteer sample
173
What is stratified sampling?
Where the composition of a sample matches the composition of a population based on its subgroups (or strata)
174
How is a stratified sample collected?
- Identify the strata (or sub groups)
- Work out the representative proportions of each strata for the sample
- Use random sampling to select the number needed in each strata
175
1 Strength and 1 weakness of Stratified Sampling
+ representative as it reflects the proportions of the population
- cannot represent all differences so can't get a completely accurate representation of the population
176
What is opportunity sampling?
The sample is made up of anyone is is willing and available at the time of the research
177
How is an opportunity sample collected?
The research would ask anyone who is around at the time of the study if they would take part
178
1 Strength and 1 weakness of opportunity sampling
+ quick and convenient
- unrepresentative sample as participants may have something in common if they're all free and available at that time and also open to researcher bias as they choose the participants.
179
What is a volunteer sample?
Participants self-select i.e. volunteer to take part in response to an advert
180
How is volunteer sampling conducted?
The researcher places an advert in a relevant place (poster, newspaper or magazine, online) and waits for responses
181
1 Strength and 1 weakness of volunteer sampling
- easy and not time consuming on the part of the researcher
- sample suffers from volunteer bias
182
What is meant by generalisability?
The extent to which the findings of research using a sample can be broadly applied to the population
183
Who is responsible for creation of ethical guidelines?
BPS (British Psychological Society)
184
Name the 4 major principles of the ethics code
- Respect
- Responsibility
- Competence
- Integrity
185
What method would an ethics committee use in determining if a piece of research is ethically acceptable?
Cost- benefit analysis (does the benefit of the research outweigh the costs?)
186
What is meant by informed consent?
Participants are aware of the aims and procedures of the research and their right to withdraw (without penalty) as well as how their data will be used before deciding to take part in the study
187
How do you get informed consent?
Issue a consent letter/brief with all relevant information that participants can sign (parents sign if under 16)
188
What is meant by deception?
Deliberately misleading participants about the true nature of the study (aims, procedures or nature of confederates) meaning you don't obtain informed consent
189
What is meant by protection from harm?
Participants should not, as a consequence of their participation, be placed at a greater risk of physical or psychological harm than in daily life. Participants should have the right to withdraw if they feel so as part of their protection from harm.
190
If you have deceived/exposed participants to harm - what should researchers do?
- Full Debrief (including reveling the true nature of the study and how the data will be used)
- Provide the right to withdraw/withhold data
- Offer counselling if relevant
191
What is meant by confidentiality?
Having the right to control your own information (right to privacy) so participants' data should not be personally identifiable (should be anonymous or coded) nor should institutions/locations be named and should be stored in line with the data protection act.
192
What is meant by a pilot study?
A small scale version of the research conducted prior to the main study.
193
What is the aim of pilot studies?
Check materials/procedures and review before the larger scale study
194
In a structured observation how does the researcher record behaviour?
Using a predetermined set of behavioural categories (or behavioural checklist)
195
Which type of observation records behaviour continuously?
Unstructured observations
196
In an observation the researcher counts the number of instances a particular behaviour is displayed. This is known as...
Event sampling
197
In an observation the researcher records what behaviour is occurring a pre-established intervals of time (e.g. every 10 seconds). This is known as...
Time sampling
198
Questions for which there is no fixed choice and participants are free to answer in as much or little detail as they choose
Open questions
199
Questions which have a fixed set of responses determined by the question setter
Closed questions
200
A form of closed question where respondents indicate their agreement with a statement on a 5 point scale (strongly disagree to strongly agree)
Likert Scale
201
A form of closed question where respondents indicate their strength of feeling towards a statement/between two semantic opposites (e.g. happy to sad)
Rating Scale
202
A form of closed question where there is a list of possible options and respondents select those which apply to them
Fixed choice options
203
What should be avoided during question design?
- Jargon
- emotive language
- leading questions
- double barrelled questions (two questions in one)
- double negatives (I am not unhappy - agree or disagree)
204
When conducted research is assessed by others who specialise in the same field to ensure high quality this is known as
Peer Review
205
When does peer review happen?
Before research can become part of a journal
206
What are the aims of peer review?
- Allocate funding decisions
- Validate quality and relevance of research (looking for fraud also)
- Suggest amendments and improvements
207
Anonymity in peer review can be a problem, why?
Using this to criticise rival research
208
Publication bias in peer review can be a problem, why?
Tendency to only want significant findings, ground-breaking research otherwise we see the file drawer phenomenon
209
Why might someone bury groundbreaking research in the process of peer review
It challenges the status quo
210
We must consider the impact of psychological research on what factor that represents financial sustainability?
The economy
211
Name the term: refers to consistency, i.e. the ability to get the same results. If a study is repeated using the same method, design and measurements, and the same results are obtained
Reliability
212
Name the term: the extent to which a particular measure used in an investigation (e.g. a questionnaire or test administered) is consistent within itself
Internal reliability
213
Name the term: the extent to which the results of a measure are consistent from one use to another
External reliability
214
Explain how the split half method tests reliability
You would compare the scores from the two halves using a correlational analysis
215
Explain how the test-retest method tests reliability
Complete a task twice on two different occasions cores from the 2 tasks (the test and the retest) are compared using correlational analysis
216
Explain how you would establish inter-observer reliability
Two observers would carry out the test separately and then the observers’ sores would be analysed using a correlation
217
What score on a correlation would indicate reliability
0.8 or above
218
How do you increase reliability?
- Operationalising variables
- Pilot studies
- Standardisation
219
Name the term: concerns accuracy; the degree to which something overall measures what it intends to
Validity
220
Name the term: concerns whether the research is accurate in itself, and whether the researcher has measured what they intended
Internal validity
221
Name the term: whether the results are still accurate in other settings
External validity
222
Name the term: The extent to which a measure, at ‘face value’, looks like it is measuring what it intends to
Face validity
223
Name the term: correlating scores on a new test of unknown validity with another test that is known to be valid and trusted to check for accuracy
Concurrent validity
224
Name the term: the extent to which the results are considered an accurate representation of other people
Population validity
225
Name the term: the extent to which results are considered accurate outside the research setting
Ecological validity
226
Name the term: the extent to which results are considered accurate across time
Temporal Validity
227
Name the term: refers to the view that gathering data and evidence from experience (sensory information) is central to the scientific method, rather than simply relying upon our
own viewpoints.
empiricism
228
Name the term: the extent to which research or materials/procedures are able to be repeated
replicability
229
Name the term: not open to interpretation - using critical distance to analyse information rather than subjectivity
objectivity
230
Name the term: - a set of shared assumptions and agreed methods within a scientific discipline (these may change)
paradigms and paradigm shifts
231
Name the term: the opportunity to refute a claim and prove it as false
falsifiability
232
Name the section of a report: A brief summary (150 – 200 words) of the key points of the study that appears at the start of the report
Abstract
233
Name the section of a report: Background to the research area and rationale (why the study was conducted).
The background will include a literature review of relevant past studies and
theories,
Introduction
234
Name the section of a report: Describes how the study was carried out in sufficient detail for someone else to be able to
replicate it.
Method
235
Name the section of a report: Summarises the findings of the research clearly and accurately. There is normally a section on
descriptive statistics and also inferential statistics.
Results
236
Name the section of a report: This section explains what the results mean and is broken down into several sections including looking at modifications and implications for further research
Discusson
237
Name the section of a report: Information on sources of information used in the report shown in alphabetical order.
References
238
Name the section of a report: Copies of materials that are not suited to any other section of the report
Appendices
239
What method of referencing is used
Harvard
240
Outline how an end of test reference should be written
* Author surname then comma and initial followed by full stop
* Publication year in brackets
* Article title with no capitals apart from the first word and full stop at end
* Journal title in italics with a comma
* Volume & issue (in brackets) followed by comma
* Page numbers with hyphen in between and full stop at end
241
What information goes in an in text reference?
Surname of researchers, year of publication (pages numbers only if its a direct quote)
242
If there are two or more researcher in the reference how do we link their names?
&
243
If there are three or more researchers in the reference use
et al.
244
What are the purposes of referencing?
* To avoid plagiarism.
* Provide a theoretical framework for the topic.
* To acknowledge direct quotes.
* To provide evidence to support arguments.
* So that readers can check how much preparation has gone into your work and can find extra information
