RESEARCH METHODS 2 Flashcards
Define research methods
The process by which information or data is collected usually for the purpose of testing a hypothesis and/or a theory
Define correlation
A mathematical technique in which a researcher investigates an association between two variables, called co-variables.
What type of variables for the two co-variables have to be
Continuous variables
What type of graph is correlation usually plotted on
Scattergram
What does each axis represent in a scattergram
One of the variables investigated
Define correlation coefficient
A number between -1 and +1 that represents the direction and strength of a relationship between co-variables
What two things does a correlation coefficient tell us about the relationship between co-variables
The direction and strength of correlation
What does a coefficient of +1 represent
A perfect positive correlation
What does a coefficient of -1 represent
A perfect negative correlation
The closer the coefficient is to +1 or -1 the ——-
Stronger the relationship between the co-variables is
Which correlation coefficient is stronger -0.5 or +0.5
They are as strong a relationship as each other
Can coefficients that appear to indicate weak correlation still be statistically significant
What does it depend upon
Yes - the side of the data set
Define case studies
An in-depth investigation, description and analysis of a single individual, group institution or event
What data does connecting a case study usually involve
Qualitative data
Hat might researchers construct of the individual concerned
A Case history
What three things may be used to construct a case history
Interviews, observations and questionnaires
What two things might a person be subject to to assess what they are (are not) capable of
Experimental or psychological testing
What type of data would experimental or psychological testing produce from a case study
Quantitative data
What do you call a case study if it takes place over a long period of time
Longitudinal
Who else might data be gathered from rather than just the individual in a case study
Family and friends
Define content analysis
A research technique that enables the indirect study of behaviour by examining communications that people produce.
Give 5 examples of examined communication that people produce
Texts, emails, tv, film or other media
What type of research is content analysis
Observational
What is the aim for content analysis to have conclusions draw
For it to be summarised and described in a systematic way so overall conclusions can be drawn
Define coding
The stage of a content analysis in which the communication to be studied is analysed by identifying each instance of the chosen categories.
What stage is coding in content analysis
The initial stage
What would large data sets be categorised into
Meaningful units.
How might words in text be manipulated to produce quantitative data
Counting up the number of times a word is used
Define thematic analysis
An inductive and qualitative approach to analysis that involves identifying implicit or explicit ideas within data.themes will often emerge once the data has been coded.
When will themes often emerge form data
Once the data has been coded
Is the outcome of thematic analysis qualitative or quantitative
Qualitative
What does a theme in content analysis refer to
Any idea, explicit or implicit that is recurrent.
Are themes more likely to be more or less descriptive than coding units
More descriptive
What might researchers do after they are happy with the themes they have developed
May collection a new set of data to test the validity of the themes and categories.
What will the reseracher do if the themes explain the new data adequately
Write up the final report
What will a final report typically use in thematic analysis to illustrate each theme
Direct quotes from the data to illustrate each theme
What are the four strengths of case studies
Offer detailed insights on very unusual and atypical forms of behaviour.
Contribute to our understanding of ‘typical’ functioning.
Generation of hypothesis for future study
One solitary contradictory instance may lead to the revision of an entire theory.
What are the three limitations to case studies
Generalisation of findings on research of small sample sizes.
Information in the final report is based on the subjective selection and interpretation of the researcher.
Personal accounts from participant, family or friends may be prone to inaccuracy and memory decay.
What are the three strengths of content analysis
Avoids many ethical issues, no issues with obtaining permission.
Such communications have the benefit of being high in external validity.
Can produce both qualitative and quantitative data
What is the limitation of content analysis
May suffer from a lack of objectivity, especially when more descriptive forms of thematic analysis are employed
What do modern analysts do to evaluate and show their own biases
Clear about how their own biases and preconceptions influenced the research process.
Often make references to them as part of their final report
What is the name given to the process of referencing biases in final reports
Reflexivity
Define reliability
Refers to how consistent a measuring device is - and this includes psychological tests or observations which assess behaviour
If a test or measure in psychology assessed some ‘thing’ on a particular day what would we expect to be the case on another day
If this is not the case what do we assume has happened
Expect it to be the same
The thing has changed
What do psychologists tend to measure rather than concrete things
(4 examples)
Abstract things
Attitudes, aggression, memory and IQ
What have psychologists developed to assess whether their measuring tools are reliable
Test-retest
Define test-retest reliability
A method of assessing the reliability of a questionnaire or psychological test by assessing the same person on two separate occasions. This shows to what extent the test produces the same answers.
What is the method for test-retest
Administering the same test or questionnaire to the same person on different occasions.
If the test is reliable what should be the case in the test-retest method
The results obtained should be the same or very similar each time they are administered
What is the test-retest method most likely to be used on
What is another example of where it can but usually wont be applied
Psychological tests and questionnaires
Interviews
What 2 reasons are there for leaving the right amount of time between test and re-test
The participant cannot recall their answers to the questions to a survey
Not so long that the participant’s attitudes, opinions or ability’s might have changes
How would two data sets from test-retest be manipulated
Two sets of scores would be correlated to make sure they are similar
What correlation should be present to indicate a reliable measuring instrument
Significant and positive correlation
Define inter-observer reliability
The extent to which there is agreement between two or more observers involved in observations of a behaviour.
How is inter-observer reliability measured
By correlating the observations of two or more observers
What is the maths sum applied to inter-observer reliability
(Total number of agreements) / (total number of observations)
What number does the result from the maths sum for inter-observer reliability have to be higher than to have a good reliability
+0.80
What type of research is inter-observe reliability important in
Observational reserach
What is the main issue in observational research
One observers interpretation may differ greatly form anothe s
What 3 negative things are introduced into data collection if one observers interpretation is different from another’s
Subjectivity, bias and unreliability
How can inter-observer reliability be tested before the actual experiement
With a pilot-study
In the pilot-study what is being checked to be applied in the same way
Behavioural categories
What is the reliability test called when applied to content analysis
Inter-rater reliability
What is the name of the reliability test done on interviews
Inter-interviewer reliability
What should the correlation coefficient exceed in both test-retest and inter-observer reliability for them to be deemed reliable
Exceed +0.8
What two things can be done to improve a questionnaire if it produces a low test-retest reliability
Some of the items to be ‘deselected’ or rewritten
What type of questions can be replaced with another type of question in questionnaires to make them more reliable
Why
Open questions can be changed to closed questions
Will be less ambiguous
What is the best way to ensure reliability in interviews
To use the same interviewer each time
What should be done if the same interviewer cannot be used every time
What does this prevent
Interviewers must be trained
Prevents one particular interviewer from asking too leading or ambiguous questions
What two words describe a type of interview that is less likely to be reliable
Unstructured and more free-flowing
What can be properly operationalised to improve the reliability of observations
Behavioural categories
What two things must behavioural categories be
Measurable and self-evident
What must behavioural categories do
Overlap
All possible behaviours must be ____
Covered on a check list
What will happen if categories are not operationalised well, or are overlapping or absent
Different observers have to make their own judgements of what to record where and may end up with different and inconsistent records.
What two things can the observers do if reliability is low
Training in using behavioural categories
May wish to discuss their decisions with each other so they can apply categories more consistently
In an experiment was is the focus for reliability
The procedure
What is the goal in an experiment to ensure a high reliability
Standardised procedures
Define validity
The extent to which an observed effect is genuine - does it measure what it is suppose to, and can it be generalised beyond the research setting within which it was found.
For high validity what must represent what is out in the real world
Observed effects
What is the word given to whether the researcher had managed to measure what they intended to
Internal validity
What is the word that refers to the extent to which findings can be generalised beyond the research setting
External validity
Give an example of how reliable data from a research might not be valid
(study on weight is it reliable? Is it valid?)
A broken set of scales may tell someone’s weight consistently but it may always be 5kg more than their actual weight.
The scales are reliable but the weight is not true so lacks validity.
What does internal validity refer to
Whether the effects observed in an experiment are due to the manipulation of the independent variable and not other factors
What is one major threat to the internal validity of a study
If participants respond to demand characteristics - acting in a way they think is expected
Give an example of a study in which demand characteristics are expected to have influenced results
Milgram’s shock study
What does external validity refer to
(What are the 3 others)
Factors outside the investigation.
Generalising to other settings, other populations of people and other areas.
What type of validity does ecological validity come under
It is a type of external validity
Define ecological validity
The extent to which findings from a research study can be generalised to other settings and situations
What type of experimental setting would have a high ecological validity
A more natural setting - one that is likely to be seen in everyday life
E.g. a field study
What is one example of a setting that people believe will have low ecological validity
A lab setting
In an experiment a task that is used to measure the ____ variable will have low ecological validity
What term is given to this
Dependent variable
Low mundane realism
Give an example of a field study in which you would expect high ecological validity but it is actually low
(Memory)
A list of words to remember in a shopping mall.
Using a word list makes the study lack ecological validity.
What must be looked at to decide whether findings can be generalised beyond the setting of reserach
All sorts of aspects of the research
Define temporal validity
The extent to which findings from a research study can be generalised to other historical times and eras.
What type of validity does temporal validity fall under
External validity
Give an example of a study that have low temporal validity.
Why is it the case
Asch’s research having high rates of conformity
They took place in a particularly conformist era in American history (1950s / post WW2)
Define face validity
A basic form of validity in which a measure is scrutinised to determine whether it appears to measure what it is suppose to.
What two things can be done to determine face validity
By simply ‘eyeballing’ the measuring instrument or by passing it to an expert to check
Define concurrent validity
The extend to which a psychological measure relates to an existing similar measure
How can concurrent validity be tested (example with intelligence)
The new-intelligence test will be given to participants alongside a well-established test and IQ scores they achieve may be compared.
What would close agreement between a set of data using an old test and a set of data from a new test mean
The new test has high concurrent validity
Close agreement between the new and old test is indicated if the correlation between two sets is what
Exceeds +0.80
What are two examples looked in more detail of things that can be done to improve validity
Control group
Standardised procedures
What can a control group allow researchers to better assess when looking at validity
Whether changes in the dependent variable were due to the effect of the independent variable
The impact of what two things are minimised when standardising procedures
Participant reactivity and investigator effects on the validity if the outcome
What two types of procedures may help achieve minimised participant reactivity and investigator effects
Single-blind
Double-blind
What is the case in single-blind procedures
What does it reduce the effects of
Participants are not made aware of the aims of a study until they have taken part to reduce the effect of demand characteristics
What is the case in a double-blind study
What two things does this reduce the effects of
A third party conducts the investigation without knowing its main purpose
Reduces demand characteristics and investigator effect
What two things does the introduction of a lie scale into questionnaires and psychological tests assess
The consistency of a respondent’s response
Control for the effects of social desirability bias
What can be promised to respondents to further enhance reliability
Why
Data submitted will remain anonymous
They wont hide negative truths
What type of observations can produce high ecologically valid findings due to minimal intervention by the researcher
Covert observations - behaviour of those observed is likely to be natural and authentic
What can have a negative impact on the validity of observational data collection if they are too broad or overlapping
Behavioural categories
Which method of data collection and research is thought to have a higher ecological validity than the otehr
Qualitative methods have higher ecological validity than quantitative
Why is detail and depth associated with case studies and interview more likely to have higher ecological validity
It is better able to reflect a participants reality
Define interpretive validity
The extent to which the researcher’s interpretation of events matches that of their participants.
What two things can interpretive validity be demonstrated through
Coherence of the researcher’s narrative
The inclusion of direct quotes from participants within report
Define triangulation
The use of a number of different sources as evidence
What does triangulation do to validity
Enhances it
Give 3 examples of what can be combined and used in triangulation
Data complied through interviews with friends and family, personal diaries and observations
What two words and one phrase can be used to describe validity
Whether a test is legitimate and genuine
Whether findings can be generalised
Define statistical testing
Used in psychology to determine whether a significant difference or correlation exists.
What does a statistical test determine about null hypothesis
Whether it should be rejected or retained
What are the three factors to consider when deciding which statistical test to use
Whether the researcher is looking for a difference in correlation
In the case of a difference, what experimental design is being used
The level of measurement
Define levels of measurement
Quantitative data can be classified into types or levels of measurement
What are three example types of measurement quantitative data can be classified into in levels of measurement
Nominal, ordinal and interval
What is the first thing to consider when deciding which statistical test to use
Is the researcher looking for a difference or correlation
Where should it be obvious if the researcher is looking for a difference or correlation
In the wording of the hypothesis
What is not an issue if the investigation is looking for a correlation rather than a difference
Experimental design
What are the three types of experimental design
Independent groups
Repeated measures
Matched pairs
Which two types of experimental designs are referred to as related designs
Repeated measures and matched pairs
What is the case with participants in a repeated measures design
Is this classed as related
Same participants are used in all conditions of the experiment
Yes
What is the case with participants in a matched pair design
Is this classed as related
Participants in each condition are not the same but have been matched on some variable that is important for the investigation.
Yes
What is the case with participants in a independent design
Is this classed as related
Participants in each condition are different
No - unrelated
What must the researcher choose between in decision 2 of experimental design
Whether participants will be related or unrelated
What is the third factor influencing the choice of statistical tests
The levels of measurement
How is nominal data represented
In the form of categories
why is nominal data discrete
One item can only appear in one category
Give an example of a question asked in nominal data and the possible answers
Do you like dogs?
Yes or no
How is ordinal data represented
It is data that can be ordered in some way
Give an example of a question asked for ordinal data and potential answers
Rate how much you like dogs on a scale of 1 to 10
10 - i love dogs
Does ordinal data have to have equal intervals between each unit
No
Which type of data has to have equal intervals between each unit
Interval data
Why does ordinal data lack precision
It is based on subjective opinion rather than objective measures
Why does an IQ test lack precision when looking at ordinal data
IQ test questions are derived from a view of what constitutes intelligence rather than any universnl measurement.
Why is ordinal data not used as part of statistical testing
What is done with ordinal data instead, can this be used
Due to its unsafe nature
Raw scores are converted to ranks and ranks are used in the calculation
How is interval data represented
Based on numerical scales that include equal units, precisely defined size.
What is the most precise and sophisticated for of data in psychology
Interval data
What type of test is interval data a necessary criterion for
Parametric tests
What type of measurement is taken to produce interval data based on accepted units of measurement
Public scales of measurement
Give three examples of accepted units of measurement used in interval data
Time, temperature and weight
What is nominal data’s measure of central tendency
Mode
What is ordinal data’s measure of central tendency
Median
What is interval data’s measure of central tendency
Mean