Pilot Studies and Peer Review

Question 1

what is a pilot study?

Answer 1

A small study conducted before the main study to see if procedures and materials are appropriate and work properly.

Question 2

pilot studies evaluation

Answer 2

• Allows methodology to be scrutinised
• Tests the internal validity of methods e.g. checking questions and tasks actually test what they are supposed to
• Reduces the chance of wasting time and money on large scale research that may be flawed

Question 3

what is peer review?

Answer 3

• when a psychologist completes a piece of research/article they will send their work to a another psychologist(s) working in a similar field for the work to be independently scrutinised and considered for publishing.
• usually a double blind peer review - the established psychologist(s) carrying out the peer review are anonymous so that the psychologist who wrote the research does not know who will peer review their work, and also the peer reviewer will not know whose research they are analysing.
  If the research does not meet high standards and is of poor quality, then the research will not be published.

Question 4

what are the 3 purposes of peer review?

Answer 4

Office for Science and Technology
- Allocating research funding
- Publication of research in journals
- Assessing the ratings of universities

Question 5

what is publication bias?

Answer 5

the failure to publish the results of a study on the basis of the direction or strength of the study findings - may mean that only studies which have statistically positive results get published.

Question 6

peer review evaluation

Answer 6

Ways to improve validity:
Ensuring there is a reputable expert to review the work
Anonymity of the process

• Publication bias is a weakness
• Journals can add bias to the process by only publishing work that is socially acceptable
• Part of the process is public review and this is not always critical so leads to reduced validity