Deciding on a research question, reliability and validity Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

Aim of research

A

A broad statement of the purpose of the research.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Alternative hypothesis

A

A testable statement that a piece of research attempts to support or reject.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Directional hypothesis

A

A hypothesis that suggests there will be a difference/relationship between variables, where the IV will affect the DV** in one specific direction/outcome.**

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Non- directional hypothesis

A

A hypothesis that suggests there will be a difference between variables, the IV will affect the DV, but does not state a specific direction/outcome for results.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Null hypothesis

A

There will be **no causal relationship **between an independent variable and a dependent variable and and relationship is due to chance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Independent variable

A

The variable that the psychologist manipulates and controls to see how it effects behaviour.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Dependent variable

A

The variable that is measured by the psychologist.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Operationalise

A

A precise definition of the behaviour being manipulated, observed or measured. This allows for repetition and raises reliability as it is an agreed value that has been attributed to the measurement.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Co-variables

A

Two or more quantities being measured in a correlation by the researcher that may or may not vary with each other.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Extraneous variable

A

These are variables that are not being measured but affect the behaviour of all the participants equally.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Co-founding variables

A

Variables in a study which might affect some individuals behaviour but not others, having negative consequences for validity.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Internal validity

A

The findings are accurate and the study measured what it intents to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

External validity

A

The study paints a picture of real life behaviours.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Researcher bias

A

The researcher either directly or indirectly influences the results of the study, through the process of designing the study or through the way the research is conducted/analysed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Demand characteristics

A

Participants unconsciously work out the aim of the investigation and act differently.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Social desirability bias

A

Participants give the response they think is required to show them in the best possible light. This may mean that they are not a true reflection of the real thoughts.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Content validity

A

Ask an expert in an area of behaviour to check the test is valid.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Predictive validity

A

The degree to which a test accurately predicts the future outcome on a more broadly related topic.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Concurrent validity

A

Validating a measurement by comparing it with an established measurement that has known validity. If similar results occur on both tests, then the new test has concurrent validity.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Construct validity

A

The extent to which a test measured the intended theoretical concept.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Face validity

A

Whether the test appears to measure what it claims to and hence is subjective. Tests where the purpose is clear, even to naïve respondents are said to have high face validity.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Specific validity issues

A

Factors that could cause problems with validity such as researcher bias, social desirability bias and demand characteristics.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Ways of dealing with issues of validity

A

Improving validity through methods such as double or single blind procedures, or through changing the location/nature of the blind research task to make them more reflective of real life.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Assessing validity

A

Methods of checking the internal or external validity of a study.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Experiments

A

A research method where cause and effect is measured, through the control and manipulation of key variables, and where the participants are randomly allocated to experimental/control groups.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Quasi-experiments

A

A research where the experimenter has NOT deliberately manipulated the IV and participants are NOT randomly allocated. Methods within this category include natural experiments and difference studies.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Natural experiments

A

A research method where the IV arises naturally, although the DV can still be measured in a laboratory or any other location of the researcher’s choice. This method would be used when it is unethical to directly manipulate the IV.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Participant observations

A

A research method where the researcher takes on the role of a participant and whilst observing other participants’ behaviour around them.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Non-participant observations

A

A research method where the researcher watches and records participants behaviour without interfering in any way (from a distance).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Content analysis

A

A research method which involves exploration of behaviour to see what categories, codes or themes emerge, and tallying each time material fits a theme. It converts qualitative data into quantitative data so that it can be more easily compared.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Structured interviews

A

A research method that includes standardised questions (like in a questionnaire), which are known as an interview schedule, and are usually asked face to face.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

Questionnaires

A

A research method that includes a list of written questions, which generate closed and/or open answers. These can be used in person, on-line or through other methods e.g. postal.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Semi-structured interviews

A

A research method which involves asking participants questions, usually face to face. These can be in the form of an interview schedule, but could also include follow up questions to expand on answers of the questions asked.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

Correlational studies

A

A research method which involves a comparing two continuous variables (co-variables) to see if there is an association/relationship between them.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

Case studies

A

A method which involves an in-depth investigation of a phenomenon, which uses a descriptive analysis of a person, group or event. It is a holistic study through one or more methodologies that is usually longitudinal.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

Self-reports

A

A method which involves a participant reporting on their own thoughts and feelings though methods such as interviews or questionnaires.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

Quantitative date

A

A type of data that can be measured numerically by the psychologist, so that statistical analysis can be completed e.g. scores on an IQ test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

Qualitative data

A

A type of data that can be observed , but not measured numerically. It usually takes the form of words, thoughts and feelings, and is difficult to analyse e.g. a participants feelings about school.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

Primary sources

A

Information sources/data that is directly collected by the researcher first-hand e.g. they collect data through a questionnaire, experiment, interviews etc. for their research.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

Secondary sources

A

Information sources/data that have not been directly collected/created by the researcher e.g. use of methods such as content analysis of existing data, or literature reviews.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

Cross-sectional studies

A

A method which involves comparing one group of participants, representing a cross-section of society, against another at the same point in time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

Brain scans

A

A research method which involves taking images of the living brain to investigate brain function e.g. PET, fMRI and CAT scans.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

Longitudinal studies

A

A method which involves conducting research over a long period of time in order to observe long-term effects of X on a specific behaviour. It may utilise a range of other methodologies such as case studies, interviews etc.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

Conducting research in a laboratory environment

A

A location of research where scientific research and measurement can be taken using specialist/large equipment (which would not be practical in the field). Conditions and variables are controlled, and procedures are standardised.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

Conducting research in the field

A

A location of research outside of the laboratory, in a natural setting e.g. school, hospital, workplace etc. It has lower levels of control over confounding variables than the laboratory, but can still utilise a standardised procedure.

46
Q

Conducting research on-line

A

A location of research where participants are accessed via the internet/social networks/mobile apps etc. Often involves questionnaires but can also be experimental, correlational etc.

47
Q

Target populations

A

The group of individuals that a researcher is interested in studying e.g. people in the UK.

48
Q

Sampling frames

A

A group/population that is identified when it is unrealistic to study the whole target population e.g. people in London.

49
Q

Random sampling

A

A sampling technique where participants are selected from the sampling frame, where everyone has an equal chance of being selected. E.g. Names are pulled out of a hat, or a computer is used to randomly select participants.

50
Q

Opportunity sampling

A

A sampling technique where participants are selected at the researcher’s convenience without knowing any details about the sample in advance e.g. picking people who were there at the time, in your specific location.

51
Q

Systematic sampling

A

A sampling technique where every nth person on a list is selected by the researcher e.g. every 3rd house on a street, or 5th person on a register.

52
Q

Stratified sampling

A

A sampling technique where the target group is divided into subgroups, e.g. by sex, and then the participants are selected randomly from each subgroup.

53
Q

Quota sampling

A

A sampling technique where the target population is divided into subgroups, e.g. by sex, and the participants are chosen from each subgroup at the convenience of the researcher.

54
Q

Self-selected sampling

A

A sampling technique where participants volunteer (select themselves) for research e.g. they come forward/respond to the psychologist after reading an advertisement in a newspaper or on a notice board.

55
Q

Snowball sampling

A

A sampling technique where participants are initially recruited by the psychologist and then those participants recruit further participants from people they know, therefore the sample group appears to ‘snowball’.

56
Q

Observational sampling techniques

A

A sampling technique that is used to collect data about specific behaviours or events within specific time frames.

57
Q

Event sampling

A

Where participants are observed by the psychologist, who records a specific behaviour (event) each time it occurs to create a total score.

58
Q

Time sampling

A

Where the psychologist observes and records behaviour (such as a score) at specific time intervals, e.g. every 15 minutes, and then creates an average score for each participant being observed.

59
Q

Independent groups

A

An experimental design where participants take part in only one experimental condition.

60
Q

Repeated measures

A

An experimental design where participants take part in both the control and experimental conditions.

61
Q

Matched pairs

A

A form of independent groups design where the experimental and control conditions are deliberately similar e.g. there are balance between gender and IQ levels in each group/condition.

62
Q

Nominal data

A

The level of measurement that shows categories of data represented by frequencies. The data sets have no relative numerical value e.g. boys and girls.

63
Q

Ordinal data

A

The level of measurement where data can be placed into ascending or descending order, but the intervals between data not necessarily equal e.g. the times for first, second and third in a race.

64
Q

Interval data

A

The level of measurement that has equal numerical intervals between scores e.g. temperature. The interval between 1 and 2 degrees is the same as between 21 and 22 degrees.

65
Q

Ratio data

A

The level of measurement that has equal intervals between scores and has an absolute or true zero point e.g. speed (mph)

66
Q

Frequency tables

A

A chart/table which shows the rate of occurrence (frequency) for a number of measured values/categories.

67
Q

Graphical representation

A

A range of diagrams that show the rate of occurrence for a number of measured values/categories.

68
Q

Bar chart

A

A diagram that represents frequencies of non-continuous data.

69
Q

Line graphs

A

A diagram that shows a linear representation of frequencies of data.

70
Q

Histograms

A

A diagram that represents the distribution of frequencies for continuous data.

71
Q

Pie charts

A

A diagram that represents data proportionately, as part of a whole picture of responses.

72
Q

Scatter diagrams

A

A diagram that represents a relationship/correlation between two or more co-variables.

73
Q

Distribution curves

A

Linear representations of data that include a mean, median and modal score to show a spread of data.

74
Q

Normal distribution

A

A type of distribution where the mean, median and mode are equal. This can be referred to as a bell curve.

75
Q

Negative skewed distribution

A

A type of skewed distribution, where the mode is greater than the mean.

76
Q

Positive skewed distribution

A

A type of skewed distribution, where the mode is less than the mean.

77
Q

Measures of central tendency

A

A form of estimation of a mid-point/average in a set of data.

78
Q

Mean

A

The average that is shown by all scores in the data set when they are divided by n.

79
Q

Median

A

The id-point in a set of data that has been placed in order.

80
Q

Measures of dispersion

A

A measure that shows the spread of data, whether it is tightly clustered or has a broader spread.

81
Q

Range

A

A value which shows the spread of data, representing the difference between the lowest and highest scores.

82
Q

Standard deviation

A

A value which represents the amount of variation of results from the mean score.

83
Q

Internal reliability

A

The extent to which a test or measure is consistent within itself e.g. the use of a standardised instructions and procedure for all participants.

84
Q

External reliability

A

The extent to which a test produces consistent results over several occasions.

85
Q

Ways of dealing with reliability

A

A measure which improves consistency and accuracy within the results e.g. the use of a standardised procedure or measures such as counterbalancing.

86
Q

Assessing reliability

A

Measures used to check the consistency of a set of results.

87
Q

Inter-rater reliability

A

Where two or more psychologists produce consistent results by using a standardised procedure, agreed coding system, or correlation of their data.

88
Q

Test-retest reliability

A

Involves testing and retesting the same participants over time, with the same test, and comparing their scores. If the scores are the same the test has external reliability.

89
Q

Split-half reliability

A

Involves splitting a pp’s test answers in half and seeing whether s/he got the same or similar scores on the two halves. If so, internal reliability is high; if not, it is low and individual questions would need to be redesigned.

90
Q

Confidentiality

A

Third parties should not be able to trace information back to individual participants. This is usually achieved through providing anonymity e.g. using participant numbers not names.

91
Q

Deception

A

Deliberately misleading or falsely informing participants about the nature of research.

92
Q

Risk of stress, anxiety, humiliation or pain

A

Research could induce more than minimal pain through repetitive or prolonged testing. Invasive testing, such as the administration of drugs, or vigorous physical exercise, would not usually be encountered in everyday life, thus is unethical.

93
Q

Risk to the participants’ values, beliefs, relationships, status or privacy

A

Research that is likely to face this type of risk focuses on socially sensitive topics (e.g. sexuality) and includes potentially sensitive data (e.g. confidential documents).

94
Q

Valid consent

A

Includes giving participants enough information (in a form they can understand) so that they can make an informed choice about whether they wish to participate.

95
Q

Working with vulnerable individuals (including children)

A

Children under the age of 16, those lacking in mental capacity, people in care, people in custody (prison) or on probation, and people engaged in illegal activities, such as drug use, would be categorised in this way.

96
Q

Working with animals

A

Research with non-human species is strictly controlled. Restrictions on type of animal, care, number of animals required etc. are all controlled by ethical guidelines and laws such as the Animals Act (1986).

97
Q

Ways of dealing with ethical issues

A

Methods such as ethical committees and guidelines.

98
Q

Ethics committees

A

Provide a set of moral principles that guide research from its inception through to completion and publication of results.

99
Q

Ethical guidelines

A

The board that is in place to ensure that proposed research meets the standards of the current ethical codes of conduct and guidelines.

100
Q

Debriefing

A

A method which aims to ensure participants are aware of the true nature of the study (overcoming any deception). It should return the participant back to their original state.

101
Q

Chi-squared test

A

A statistical test that is used when the experimental design is independent groups, when the level of data is at least ordinal and when the hypothesis is predicting a difference between variables. The observed value must be higher than the critical value for results to be considered statistically significant.

102
Q

Mann Whitney U test

A

A statistical test that is used when the experimental design is repeated measures/matched pairs, when the level of data is at least ordinal and when the hypothesis is predicting a difference between variables. The critical value must be higher than the observed value for results to be significant.

103
Q

Sign test

A

A statistical test that is used when the experimental design is repeated measures/matched pairs, when the level of data is nominal and when the hypothesis is predicting a difference. The critical value must be higher than the observed value for results to be considered statistically significant.

104
Q

Spearman’s rank order correlation coefficient

A

A statistical test that is used when the level of data is at least ordinal and is related, and when the hypothesis is predicting a correlation/relationship between variables. The observed value must be higher than the critical value for results to be considered statistically significant.

105
Q

Wilcoxon matched pairs signed ranks test

A

A statistical test that is used when the experimental design is repeated measures/matched pairs, when the level of data is at least ordinal and when the hypothesis is predicting a difference between variables. The observed value must be higher than the critical value for results to be significant.

106
Q

Probability values

A

A numerical value that gives an indication of the likelihood that results are due to a real difference/correlation and not due to chance e.g. in psychology we accept a probability value of 95%, where results are due to chance in 5% of cases.

107
Q

Significance levels

A

A numerical value that is usually expressed in value including two decimal places. This level tells you the margin of error that could occur in your results e.g. 0.05 suggests that there is a 5% possibility that results are due to chance and not the difference/correlation between variables.

108
Q

Observed (calculated) values

A

The numerical value that is created as a result of inferential statistical analysis of your data. This will be compared to the critical values for the test to calculate level of significance.

109
Q

Critical values from tables

A

The tabulated numerical values that have been assigned to a particular inferential statistical test. It is compared to the observed value for your set of data to calculate significance.

110
Q

Peer review

A
  1. Researcher submits article to journal.
  2. Article assessed by editor of journal.
  3. If accepted by editor, article is sent to anonymous reviewers (who are also experts in the field).
  4. Reviewers submit their comments to the editor.
  5. Editor may reject the article, or return it to the author to make revisions.
  6. Revised article is re-submitted to editor for publication.
111
Q

Format of reporting psychological investigations

A
  1. Broad aim and purpose of the research is stated along with key definitions of terms (potentially including hypotheses) as part of an introduction.
  2. A literature review is included to create a context for the research.
  3. The methodology and sampling of the research is described.
  4. The results are reported; use of frequency tables and or graphical representation is included.
  5. A discussion of the results and consequent conclusions are drawn. Comments about areas of further research are usually included.