Research methods 5+6 Flashcards

1
Q

what are controlled observations?

A

Participants’ behaviour is observed and measured in a controlled environment. For example, through a one way mirror or on a video.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what are the advantages of controlled observations?

A

Control over extraneous variables:
* The researcher manipulates the environment and/or the variables so it is unlikely that other factors will confound the results. This is a strength because it increases internal validity of the study.

Replicability:
* Controlled observations are replicable because the researcher has a high degree of control and uses standardised procedures. This is a strength because if the exact study is repeated and the same results are obtained the study has high external reliability.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what are the limitations of controlled observations?

A

Demand characteristics & Investigator effects are more likely to confound results
* As participants know that they are part of a study, are in a controlled environment and engaged in carefully set up tasks their behaviour may be affected by demand characteristics. This is a limitation because it decreases internal validity of the study.

Low ecological validity:
* As the setting of a controlled observation is not a typical one behaviour demonstrated in controlled observations may not reflect how participants would behave outside the research setting. This is a limitation because it decreases external (ecological) validity of the study.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what is a naturalistic observation?

A

Participants’ behaviour is watched and measured in a natural environment. The observer simply observes and records naturally occurring behaviour in a natural setting

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what are the advantages of a naturalistic observation?

A

High ecological validity:
* The participants are in a natural environment so their behaviour is likely to be natural (particularly if the observation is also covert). This is a strength because it increases external (ecological) validity of the study.
Reduction of demand characteristics:
* Participants may be unaware that they are taking part in a study (particularly if the observation is also covert) so their behaviour is unlikely to be affected by demand characteristics. This is a strength because the study is likely to be measuring natural behaviour which increases internal validity of the study.
Ethical method for socially sensitive research:
* In a natural experiment it is possible to study variables that it would be unethical to manipulate in a controlled setting. This is a strength because they can provide insight into topics that could not be investigated in any other way.
Useful to use alongside/instead of a lab experiment:
* Naturalistic observations are a natural way of checking results that have been found in artificial conditions and also to check whether experimental findings apply outside laboratories. This is a strength because they can further our knowledge of a topic.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what are the limitations of naturalistic observations?

A

Low control over extraneous variables:
* As the situation is completely naturally occurring it is not possible to control extraneous variables. This is a limitation because it can reduce the internal validity of the study.
Difficult to replicate:
* As a result of low control over extraneous variables and no standardised procedures, the exact replication of a natural observation is more difficult than with a controlled observation. This is a limitation because it is very difficult to assess the external reliability of the results.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what are the limitations of a overt observation?

A

Demand characteristics may confound results
* As participants know that they are part of a study their behaviour may be affected by demand characteristics. This is a limitation because it decreases internal validity of the study.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what is overt (disclosed) observations?

A

The observer is clearly visible (not hidden from view) and participants know that they are being observed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what are the strengths of overt observations?

A

Not unethical:
* As Participants know that they are being observed they can give informed consent and be fully debriefed at the end of the study. This is a strength as the study is ethical.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what are the strengths of a covert observations?

A

Demand characteristics will not confound results :
* As participants do not know that they are part of a study their behaviour will not be affected by demand characteristics. This is a strength because it increases the internal validity of the study.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what are the limitations of a covert observation?

A

There can be ethical issues:
* As Participants do not know that they are being observed they cannot give informed consent and be fully debriefed at the end of the study. This is a strength as the study may be considered unethical.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what is a covert (undisclosed) observation?

A

The observer is not clearly visible (hidden from view) and participants do not know that they are being observed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what is a participant observation?

A

The researcher becomes a member of the group
whose behaviour he/she is observing.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what is a non participant observation?

A

The researcher remains outside of the group and does not become a member of the group whose behaviour he/she is observing.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what are the strengths of a participant observations?

A

Increased insight:
* The researcher can experience the situation as the participants do which gives them increased insight into the lives of the people being studied. This is a strength because it may increase the internal validity of the study.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what are the strengths of a non participant observations?

A

Presence of the researcher is unlikely to confound the results (particularly if also a covert observation):
* The researcher does not become a member of the group whose behaviour he/she is observing so participants are likely to behave naturally. This is a strength as it increases the internal validity of the study.

Researcher bias is unlikely to confound results:
* The researcher does not become a member of the group whose behaviour he/she is observing which means that they are likely to be more objective than if carrying out a participant observation. This is a strength because it increases the internal validity of the results.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

what are the limitations of a participant observation?

A

Presence of the researcher may confound the results:
* The researcher becomes a member of the group whose behaviour he/she is observing which may cause participants to behave unnaturally. This is a limitation as it would decrease the internal validity of the study.

Researcher bias may confound results:
* The researcher becomes a member of the group whose behaviour he/she is observing which means that they may become too involved in the group and may lose objectivity. This is a limitation because it would decrease the internal validity of the results.

18
Q

what are the limitations of a non participant observation?

A

Decreased insight:
* The researcher will not experience the situation as the participants do so they may miss important subtleties and are likely to gather less data than in a participant observation. This is a limitation because it would decrease the internal validity of the study.

19
Q

what is operationalisation?

A
  • clear identification/definition of the observable actions/behaviours to be recorded
  • this enables the behaviour under review to be measured objectively
20
Q

what are the advantages and disadvantages of behavioural categories?

21
Q

what is event sampling and what design is it part of?

A

observational design
The observers decide on a specific event relevant to the investigation and record it every time it is observed. This is useful when the behaviour happens quite infrequently and could be missed if time sampling were used e.g. counting the number of times players disagree with a referee during a football match

22
Q

what are the limitations of event sampling?

A

If too many observations happen at once it may be difficult for the researcher to record all behaviour so results may not be representative of participants’ behaviour and therefore would not be valid.

23
Q

what are the strengths of event sampling?

A

The observer aims to record all behaviour so the results are likely to be valid

24
Q

what is time sampling and what design is it part of?

A

observational design
Observing and recording only behaviour that occurs at given points in time such as every 5 minutes e.g. a preschool researcher notes the number of aggressive physical interactions within a particular playgroup during 5-minute intervals.

25
what are the limitations of time sampling?
Some behaviours will happen outside of the intervals so the results may not be representative of participants’ behaviour and therefore would not be valid.
26
what are the strengths of time sampling?
The observer has time to record what they have seen so the results are likely to be valid.
27
what does Inter-rater reliability check?
* A careful pilot study is done before starting any major observational research. * Trial observations are done with all observers watching out for the agreed behavioural categories. A film of the behaviour in question may also be used. * Observers use the same behavioural categories and tally the behaviour each time they observe it occurring. * All the observation scores are then correlated (i.e. compared with each other). * If there is a strong positive correlation between the scores (i.e. they are similar) then the observers are assumed to be reliable and ready for the real study. If not, more training or a change in/clarification of behavioural categories will occur
28
what is a pilot study?
a small scale study that is carried out before the main study in order to check procedures
28
HOW IS PEER REVIEW USED TO VALIDATE NEW KNOWLEDGE?
Process (mark scheme summary): * other psychologists check the research report before deciding whether it could be published * independent scrutiny by other psychologists working in a similar field * work is considered in terms of its validity, significance and originality * assessment of the appropriateness of the methods and designs used * reviewer can accept the manuscript as it is, accept with revisions, suggest the author makes revisions and re-submits or reject without the possibility of re-submission * editor makes the final decision whether to accept or reject the research report based on the reviewers’ comments/recommendations * research proposals are submitted to panel and assessed for merit.
28
what does a pilot study check?
* Timings (if too long or too short could be altered for the real study) * Participants’ understanding of the procedure and instructions * Leading/ambiguous questions are used in questionnaires/interviews (and if they are, can be re-worded) * Operationalisation of behavioural categories in observational research * If the standardised instructions are clearly worded * The number of participants needed for a study
29
what do pilot studies use that are intended to be used in the main study?
exact procedure
30
what is the purpose of peer review?
* to ensure quality and relevance of research, eg methodology, data analysis etc * to ensure accuracy of findings * to evaluate proposed designs (in terms of aims, quality and value of the research) for research funding
31
what is peer review?
Peer review is the process by which psychological research papers, before publication in a journal, are subjected to independent scrutiny by other psychologists working in a similar field (peer) who consider the research in terms of its validity, significance and originality.
32
why is peer review important in psychological research?
* prevents dissemination of irrelevant findings/unwarranted claims/unacceptable interpretations/personal views and deliberate fraud – improves quality of research * ensures published research is taken seriously because it has been independently scrutinised * increases probability of weaknesses/errors being identified – authors and researchers are less objective about their own work
33
what are the methods used during peer review?
* The Single-blind review: This is the usual form of peer review, which involves the names of reviewers not being revealed to the researcher. The idea is that reviewer anonymity allows for an unbiased review. However, there is the danger that anonymous reviewers may purposely delay the review process to allow them to publish similar research first, and/or hide behind their anonymity to be undeservedly harsh. * Double-blind review: This involves both reviewers and the researcher being anonymous. The idea is that bias based on the researcher's ethnicity, gender, age, etc. will not occur and that research will be peer reviewed fairly and not be based upon the researcher's fame (or lack of it). However, it's likely that the researcher would be identifiable from the writing, research style, etc. * Open review: This involves reviewers and the researcher being known to each other. This is seen as reducing the risk of personal comments and plagiarism (stealing other people's work) and encourages open, honest peer reviewing. However, it may be that deserved criticism is watered down due to politeness or fear of retribution from famous, powerful researchers.
34
LIMITATIONS OF PEER REVIEW: Problems of Validation
* In a very small number of cases peer review has failed to detect fraudulent research including fabrication (where data is made up), falsification (where data exists but has been altered) and plagiarism (where work has been copied from others). * However, it should be stressed that cases of proven fraudulent research are very rare.
35
LIMITATIONS OF PEER REVIEW: Consistency with Previous Knowledge
* Most findings build on previous knowledge or theories * Research that does not 'fit' with previous work is often seen as suspect and can be rejected. * This means that new findings that go against existing theories might not be published. * Peer review tends to favour positive results (i.e. ones where the results support the hypothesis). * For this reason many negative findings (i.e. ones when the null hypothesis has been accepted) are either not published or are ignored. * If ten negative findings are overlooked whilst one positive finding is published our understanding of a topic is distorted. * There may be resistance to revolutionary ideas that go against the elite or prevailing views,
36
LIMITATIONS OF PEER REVIEW: Bias in Peer Review
* Peer review is subject to bias. * There are a number of ways that the review may be biased, for instance if the reviewer's theoretical view is different from that in the manuscript (for example, if the reviewer is convinced that intelligence has a strong genetic component they might not look favourably on research that suggests that it is largely the result of upbringing). * In addition, there is evidence of both 'institution bias' (the tendency to favour research from prestigious institutions) and gender bias (the tendency to favour male researchers). * If the author and the reviewer share these values then they may be published as objective science e.g. Bowlby's work on maternal deprivation was later seen to reflect the cultural values and politics of the post-war period and his emphasis on separation from mothers rather than parents was questioned. * Research occurs in a narrow social world and social relationships within that world affect objectivity and impartiality. There are even suspicions that some researchers’ ability to consider research in an unbiased and professional manner is compromised by them being funded by organisations that want certain research to be seen as scientifically acceptable.
37
what should a consent form include?
Procedural: * Include exactly what participants are expected to do (including a description of the task). * Check participants ‘understanding of what they are being asked to do * Ask if they have any questions? Ethical - Inform participants that: * There is no pressure to consent * They can withdraw at any time * They can withdraw their data from the study * Their data will be kept confidential and anonymous as they will not be named * They will receive a full debrief at the end of the study * Ask participants if they consent to taking part in the study and leave a space for them to sign and date.
38
what should a debrief include?
* Thank the participants for taking part * Include the full aim of the study * Explain what participants in both conditions of the study were expected to do * Remind participants that they can still withdraw from the investigation and that their information remains confidential * Describe the results of the study * Allow participants the opportunity to ask any questions * Let participants know that if they have suffered any psychological harm then they can contact you. * Ask participants if they still consent to their results being used for the study
39
example of a consent form
40
example of a debrief