Research methods Flashcards

1
Q

Define reliability

A

The extent to which the results of research are consistent. I.e. when a piece of research is repeated using the same method, the sme results are obatined.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Define validity

A

The extent to which a test or piece of research measures what it claims to be measuring.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Define ecological validity

A

Where a measure of behaviour accurately reflects the way in which the behaviour would occur in normal circumstances. The extent to which research findings can be generalised to situations other than the research setting.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Define population validity

A

The extent to which results from research can be generlised to the target populaion. Can only happen if the ptps are typical of the population from whcih they are drawn.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Define Historical/temporal validity

A

Genralising the findings to another historical period. Temporal validity relates to whether findings from a study, or concepts within a theory hold true over time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is a hypothesis?

A

a general prediction about what the researcher expects to happen or find out in an investigation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is a directional hypothesis?

A

Predict the way one variable will affect another in the study. Used when previous studies show similar effect and the researcher can be confident that the same results will be found. Often start with ‘participants who…’

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is a non-directional hypothesis?

A

not specific in what they predict. Usually used when there is no previous research and therefore the researcher cannot be confident about the outcome of their own study. Often start with ‘There will be…’

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is a null hypothesis?

A

Predict that there will be no difference between the two conditions in the IV in relation to the DV or no correlation between the two variables. Used when previous research has not shown a similar affect or there is no previous research. Often start with ‘There wil be..’

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the IV

A

the different conditions. It is the variable that the researcher manipulates and is assumed to have a direct affect on the DV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the DV

A

The variable that is affected by the IV. It is the data collected/ what is measured

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is a control group?

A

A group that closely resembles the people under investigation but is not subjected to the factor under study (e.g.does not recieve treatment). They are used as a benchmark that those being tested are compared to.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Define extraneous variables

A

Any variable other that the IV that could affect the DV if not controlled. Could confound results and affect the internal validity if not controlled. E.g. situational and participant variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

define confounding variables

A

uncontrolled EV’s that may affect the DV and therefore reduce the internal validity of the results.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Types of experiements

A

1) Laboratory: controlled, manipulates IV
2)Field : real-world setting, deliberately manipulates the IV
3)Quasi: IV is pre-existing/ naturally occuring (e.g. gender) but researcher manipulates the task. Controlled conditions and aim is to establish if the naturally occuring IV causes difference in performance on the task (DV).
4)Natural: IV and DV are naturally occuring and researcher simply measures the DV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Strengths (2) and limitation (1) of Quasi and Lab experiements

A

(+)Control over EVs / establish cause and effect - cntrolled conditions. Internal validity.
(+)Replicability
(-)Low ecological validity stimulus material often lacks mundane realism

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

2 strengths and 2 limitations of field and natural experiments

A

(+)High ecological
(+)Reduction of demand characteristics
(-)Difficult to replicate
(-)Low control over extraneous variables.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are the different types of experimental designs?

A

1)Independent groups design: Different participants for each condition
2)Repeated mesures: The same participants in all conditions of the experiment
3)Matched pairs design: Participants are paired as closely as possible on important or relevant variables and then one from each pair is allocated to each condition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

2 Strengths and 1 limitation of independent groups design

A

(+)Order effects are avoided
(+)Same stimulus material can be used for all participants: equally as challenging/easy
(-)more time consuming than repeated measures to gather the sample: twice as many participants are needed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

2 strengths and limitations of repeated measures

A

(+)Participant variables (difference between ptps) do not confound the results
(+)less time consuming to get sample than independent groups design
(-)Cannot use same stimulus material
(-)Order effects may confound results (however, counterbalancing can overcome this)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is counter balancing?

A

half the ptps randomally allocated to condition A then B and half randomly allocated tocodnition B then A (know as AB-BA). It allows order effects to be evenly distributed across both conditions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

How are ptps matched in matched pairs designs?

A

paired on relevant variable following an assesment. Ptps with 2 highest scores are paired, then next to highest etc until they are all paired. One from each pair would be randomally allocated to a different condition of the experiment (so there was an equal number in each condition)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

2 strengths and a limitation of matched pairs design.

A

(+)Order affects are avoided - take part in 1 condition
(+)same stimulus material can be used for all ptps
(-)Difficult and time consuming to match pairs: need to conduct preliminary studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Define correlation analysis

A

will establish the strength and direction (or type e.g. positive or negative) of association and also the strength of the lin between the two co-variables.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Negative vs positive correlation
negative: as one variable decreases the other inceases perfect is -1 Positive: as one variable increases so does the other perfect is 1
26
Types of observations
1)Controlled: behaviour is observed and measured in a controlled environment 2)Naturalistic: behaviour is watched and measured in a natural environment. observes and records natural behaviour in a natural environment 3)Covert: observer is not clearly visible and ptps do not know that theyre being watched 4)Overt: observer is clearly visible and ptps know they are being watched 5)participant: Researcher becomes a member of the group whose behviour she/he is observing 6)Non-participant: researcher remains outside of the group and does not become a member of the group whose behviour he/she is observing
27
Define event sampling and give one strength and limitation
Decides on a specific event relevant to the investigation and records i every time it is observed (+)aims to record all behavior so the results arelikely to be valid (-)may be difficult to record all events if they happen at once so results may not be representative of ptps behaviour and therefore would not be valid
28
Define time sampling and give one strength and limitation
Observing and recording only behaviour that occurs at given points in time such as every five minutes (+)observer has time to record what they have seen so the results are likely to be valid (-)Some bhaviours will happen outside of the intervals so the results may not be representative of ptps behaviour and therefore would not be valid
29
Two strengths and limitations of using a questionnaire
(+)Speed of data collection (+)Researcher bias is unlikely to confound to results: unlike an interview ptps can answer questionnaire without researcher being present (-)Self-report data may not be valid (-)Leading questions or misinterpretation
30
Two types of interviews
1) structured 2) unstructured
31
Two strengths and limitations of interviews
(+)easy to deal with misunderstandings: can be clarified and there could be follow-up questions (+)Replicable (structured) (+)flexible (unstructured) (-)Researcher bias: researcher could misinterpret answers to support their hypothesis (-)Interviewer effects: could inadvertly influence the ptps answers through how they ask the question and from body language etc. Interviews are prone to DC's and socially desirable answers
32
Two strengths and limitations of case studies
(+)High ecological validity (+)Investigates situations which could not be set up for ethical reasons: they often investigate naturally occuring events that would be unethical to test during an experiment. Can provide insight to areas of psychology that we wouldn't be able to investigate in any other way. (-)Difficult toreplicate: they are unique so difficult/impossible to replicate. Not possible to test the external reliability of findings (-)Findings cannot be generalised very easily to other individuals: each individual & their experiences are unique so may only represent that person. May be difficult to generalise findings to others
33
What are the 5 types of sampling techniques?
1)Random: everyone in the target pop has an equal chance of selection. Can use manual or computer selection 2)Opportunity: convenient members of target pop who are willing and available to take part. Researcher asks. 3)Stratified 4)Systematic: researcher gets names of everyone in the target pop and selects every nth member in the sample 5)Volunteer:uses members of the target pop who have put themselves forward to take part. Advert.
34
How is stratified sampling used?
1) identifies different sub-groups (stratas) in the target pop 2)calculate number of each strata required for the sample (based on the proportion in the target pop) 3)Uses random sampling puts name of every member of target pop in different containers according to the sub-group they belong to 4)draws out required number of names from each sub-group
35
1 benefit and 1 limitation of volunteer and opportunity sampling?
(+)Not time consuming (-)sample may not be representative of the target pop/ may be bias: researcher selects the sample themselves (opportunity) or they volunteer
36
2 strengths and limitations of random and systematic sampling
(+)No researcher bias: all ptps have an equal chance of being selected (random)/ the researcher has no influence over who is the every nth number (+)Sample is likely to be representative of target pop: all members of the target pop have an equal chance of selection/ sample is made from the target pop (-)sample may not be representative: all have an equal chance of selection so by chance people with similar characteristics are selected
37
strengths and limitations of stratified sampling
(+)avoids researcher bias (+)very likely to be reprasentative of target pop (-)very time consuming (-)impossible to account for the many number of ways that people are different - might not be representative
38
What is the mean (descriptive stat) incl advantage and disadvantage ?
average, calculated by adding all the values together and dividing by the total number of scores (+)most sensitive measure of cenbtral tendancy as it uses all the values in a set of data (-) can be unrepresentative of the data set if there are extreme values
39
What is the mode(descriptive stat) ? incl advantage and disadvantage
The value in a set of scores that occurs most frequently (+)not affected by outlying values (anomalies) (-)Does not use all the available data and there could be more than one mode
40
What is the median (descriptive statistic)? incl advantage and disadvantage
middle value of a set of numbers placed in numberical order (+)Not affected by anomalous results and onlt takes the middle values (-)Doesn't use all of available dat and is therefore not as sensitive as the mean
41
What is the range?
Difference between the highest and lowest calculated scores in a given set of data.
42
3 ways of improving reliability: experiments
1) Standardisation 2)Take more than one measure: for each ptp as this reduces impact of any anomalous scores 3) Pilot studies: discover any problems with research design such as -ptps misunderstanding of instructions -whether timings etc are adequate
43
Assessing reliabilty: experiement
1)Test-retest: test or procedure is used several times (at least twice), correlate scores from later occasion, short interval between tests (e.g. 1 week) so answers aren't remembered, assess strength of correlation using appropriate stats test. Degree of reliabilty is determined by comparing calculated correlation co-efficient with critical value in stats table - should be a (strong) positive correlation between two sets of scores if they are reliable.
44
Improving reliabilty: observations 3 ways
1)Behavioural categories: operationalised so that it is clear for all observers 2)Pilot studies: identify any problems with design such as poorly defines BC's or inadequate training 3)standardisation: when more than 1 investigator the way they collect and record data should be standardised. This could involve filming the behaviour so that the observers can practise the categorisation.
45
Assessing the reliability: observation
Inter observer reliabilty (extent to which the observers agree on the observations): -2 or more devise set of categories that they intend to use to code the behaviour -carry out observation independently and tally each BC when its observed -at end of study compare and/or correlate their totals with one another -strength of correlation should be assessed using appropriate stats test -determine degree of reliability should be 0.80 or more
46
How is the degree of reliabilty determined when using a stats table (e.g.for inter observer reliability or test retest)
by comparing the calculated correlation co-efficient with the critical value in the statistical table which indicates the extent of correlation - there should be a (strong) positive correlation between the two sets of score if the results are reliable. A correlation coefficient of 0.80 or more suggests good inter-observer relaibilty
47
Improving reliabilty: self report 3 ways
1)Reduce ambiguity: questions may need to be re-examined and rewritten. Could replace some open questions with closed questions. 2)pilot studies: discover problems with design such as leading or ambiguous questionnaires or interviews 3)Standardisation: all ptps should be subject to the same environment, info and questions. using the same researcher can improve reliabilty (esp interviews) exposed to same approach of asking questions, body lanuage, tones etc.
48
Assessing reliabilty: self-report method
Test-retest
49
assessing reliabilty: split-half method
- ptps scores on one half os a test should be correlated with their scores on other half of test -strength of correlation should be assessed using appropriate stats test -reliability assessed by comparing ... should be a (strong) positive correlation between two sets of scores if results are reliable
50
Assessing validity 3 ways
1)Face validity 2)Concurrent validity 3)Content validity
51
Assessing validity - concurrent validity (CV)
-has CV if it produces similar findings to an existing measure. Can be assessed by: -same ptp would complete 2 tests/Qairs (your own and an existing one) that assess the same aim -correlate scores from one test with score from other test -strength of correlation by using stats test -assess degree of validity by... should be +0.8 (strong positive)
52
Assessing validity: Content validity (CV)
asking experts in the field to check methodology of a study to see how accurately it measures the desired behaviour. If they feel it does, then it is said to have content validity.
53
Improving validity
1)Revise/remove questions -poor face v then Q's should be revised so they relate more obviously to the topic -concurrent V low then researcher should remove some Q's that may seem irrelevant and assess concurrent V again 2)Improve research design to control/overcome: Investigatore effects, demand characteristics, confounding variables, social desirability bias and poorly operationalised BC's
54
Improving external validity: ecological and population
Ecological: -give ptps a task with high mundane realism -if possible, conduct a field/ natural experiment Population: -use a large sample -use sampling technique that is likely to produce a representative sample
55
Improving validity: experiment
1)Single blind: reduces DC's - ptps do not know what group or condition they are in and therefore cannot change their response to suit or foil the research. 2)Double blind: reduces DC's and researcher bias - Neither the ptps nor the experimenter know what each group or condition represents.
56
Define Content analysis
a type of observational study in which behaviour is observed indirectly in visual, written or verbal material, it is technique of analysing qualitative data. It turns qualitative data into quantitative data.
57
How is Content analysis carried out?
-Read the source -Identify potential categories which emerged from the data -Read source again and count the number of examples which fell into each category to provide quantitative data (coding) -compare the different categories to see if the results support the hypothesis
58
Define thematic analysis
qualitative data is summarised by identifying repeated themes in the material to be analysed.
59
How is thematic analysis carried out?
-read and re-read source -code the transcript by annotating it -recurring themes of the trancript will be identified from the annotations -re-read transcript to ensure that vthe themes are appropriate and cover all the different key features. -conclusion based onthe themes and contextualising the analysis in relation to previous research
60
Evaluation of content and thematic analysis
(+)produce qualitative and quantitative data depending on the aims of research (flexible) (+)high ecological validity - based on observations (-)could be making artificial distinctions or could miss certain forms of behaviour, reducing validity (-)observer bias reduces the objectivity and validity of findings as different observers may interpret the meaning of behavioural categories differently. Risk researcher may attribute opinions and motivations that were not intended origionally
61
Define what is meant by a case study
A detailed study of a single individual, group of people, institution or event. Usually carried out in the real worls. They are ideographic, very individualistic and are usually longitudinal
62
Strengths and limitations of case studies
(+)investigate naturally occuring events that would be unethical to test during an experiment. Can provide insight to psychology that we wouldn't be able to investigate otheriwse. (+)Usually longitudinal - rich in depth info (-)difficult to generalise from individual cases (-)ethical issues such as confidentiality, consent (-)replicability (-)self report
63
Features of science
-objectivity and the empirical method -replicability and falsifiability -theory construction and hypothesis testing -paradigms and paradigm shifts
64
Nominal data
A 'head count' of how many people are in each category
65
Ordinal data
Rough numerical score but no proper/recognised units have been used to measure the score.
66
Interval data
Recognised units of measurement e.g. IQ score
67
choosing a statistical test (what is the table?)
Nominal ordinal Interval repeated measures, Sign test, wilcoxon, related t test matched pairs, sign test, wilcoxon, related t test Independent measures, Chi2, mann-whitney, unrelated t test correlation, chi2, spearman's rho , pearson's r
68
mnemonic to remember stats table
research super wouldn't Rodger methods sonic wear rabbitt is cheese marks& uses cool cake spencers protection
69
What is a type 1 error
When you accept the hypothesis when it is false (also when you reject the hypothesis and its true). More likely to make a type 1 error if the level of significance is too lenient (too much room for chance) (e.g. 0.1 or 10% rather than 5%)
70
What is a type 2 error
Would occur where a real difference in the data is overlooked as it is wrongly accepted as being not significant, accepting the null hypothesis where it is false (i.e. rejecting your hypothesis when it is true) in error (a false negative). More likely too occur when level of significance is too stringent (e.g.0.01 or 1% rather than 5%)
71