PSYC*2360 Chapter 4: Tools for Building Better Designs Flashcards

1
Q

Which research design involves manipulating all independent variables and randomly assigning participants to groups?

A

True experiments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is a quasi-experimental design?

A

A research design in which the researcher can’t manipulate the independent variable or use random assignment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Are non-equivalent, posttest only designs and non-equivalent, pretest-posttest designs experimental or quasi-experimental?

A

Quasi experimental

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the difference between non-equivalent group, posttest only and non-equivalent group, pretest-posttest designs?

A
  • Posttest only: Outcome measures are administered to two or more groups without random assignment
  • Pretest-posttest: Baseline measures of groups are taken before an intervention, then an outcome measure is administered
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are quasi-independent variables?

A

Variables treated as if they are independent variables in an experimental design, even though they can’t be manipulated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is self-report?

A

Any measurement technique that directly asks participants how they think or feel

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the two most common examples of self-report measures?

A
  • Interviews
  • Surveys/questionnaires
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are the two main advantages of self-report measures?

A
  • Relatively cheap and easy to administer
  • Receive first-hand information from the source
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Social desirability, demand characteristics, and retrospective bias are the main drawbacks of which type of measure?

A

Self-report

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is social desirability?

A

The tendency for respondents to give answers that make them look good

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are demand characteristics?

A

Cues that potentially make the participants aware of what the researcher expects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is retrospective bias?

A

The tendency to view or interpret past events inaccurately

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What must researchers do to properly measure behaviour?

A

They must find a way to quantify it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the three main types of behavioural measures?

A
  • Behavioural trace
  • Behavioural observation
  • Behavioural choice
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is a behavioural trace?

A

A behavioural measure that relies on evidence left behind by a participant who is longer present to determine if a behaviour occurred

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are the two main advantages of behavioural trace measures?

A
  • Doesn’t require the participants’ cooperation
  • Avoids issues like social desirability and demand characteristics
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is the main disadvantage of behavioural trace measures?

A

The interpretation of a behavioural trace’s meaning depends on the researcher to draw inferences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What do behavioural observations rely on?

A

Directly seeing or observing behaviour as it occurs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

T or F: A drawback of behavioural observation is that it cannot go beyond what can be visually observed.

A

False

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Which behavioural measure involves participants making a purposeful selection from several options?

A

Behavioural choices

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What are the two main disadvantages of behavioural measures?

A
  • They are often time-consuming, expensive, and cumbersome
  • Introduce the possibility for participant reactivity and demand characteristics
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is participant reactivity?

A

When participants act differently or unnaturally because they know someone is watching them

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

T or F: Behavioural measures tend to provide findings that are more relatable to the general public.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What are unobtrusive measures?

A

Strategies that allow for observation and assessment without a participant’s awareness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is the difference between a raw scare and a true score?

A
  • Raw score: The actual score, comprised of a true score and error
  • True score: What the raw score would be if the test were a perfect measure and was uninfluenced by extraneous factors
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What are the extraneous influences that cause a raw score to deviate from the true score referred to as?

A

Errors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

A variation from the measure’s true score due to unsystematic or chance factors that occur in a haphazard, disorganized, or arbitrary way is known as what?

A

Random error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

T or F: It is possible to remove random error from a study.

A

False

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

T or F: Bias is also known as a systematic error.

A

True

30
Q

What is bias?

A

An error that systematically pushes scores in one direction

31
Q

T or F: Statistics can be used to address bias.

A

False

32
Q

Which form of error is more problematic, random error or bias?

A

Bias

33
Q

What is standardization?

A

Keeping experimental conditions the same for everyone and as free from variation as possible

34
Q

T or F: Standardization helps minimize bias, but can’t remove random error.

A

True

35
Q

What is observer/scorer bias?

A

The misinterpretation of an observation based on existing beliefs, previous experiences, or expectations

36
Q

What does the sensitivity of a measurement refer to?

A

The range of data a researcher can gather from a particular instrument

37
Q

To strike the right balance between being overly sensitive and not sensitive enough, it is recommended to use how many options in self-report measures?

A

5-9

38
Q

What is the ceiling effect?

A

When all responses of a measure fall at the top end of the scale

39
Q

In terms of the boundaries of a measurement tool, what might cause a ceiling effect?

A

The upper boundary being set too low

40
Q

If the independent variable is unable to affect the dependent variable, which is more likely, a ceiling effect or a floor effect?

A

A ceiling effect

41
Q

What is the floor effect?

A

When all responses of a measure fall at the bottom end of the scale

42
Q

In terms of the boundaries of a measurement tool, what might cause a floor effect?

A

The lower boundary being set too high

43
Q

What is the difference between reliability and validity?

A
  • Reliability: The extent to which a measure will produce the same results each time it is used
  • Validity: The extent to which a research method measures what it is intended to measure
44
Q

Does random error threaten reliability or validity?

A

Reliability

45
Q

Does bias threaten reliability or validity?

A

Validity

46
Q

T or F: Without validity, there is no reliability.

A

False. Without reliability, there is no validity.

47
Q

T or F: Even with reliability, a measure can either be valid or invalid.

A

True

48
Q

What is the entire group of interest in a study referred to as?

A

The population

49
Q

What is the subset of a population from which the researcher collects data referred to as?

A

A sample

50
Q

What is the explicit strategy used for recruiting participants from the population referred to as?

A

The sampling plan

51
Q

What is a representative sample?

A

A sample with specific features that characterize the population of interest

52
Q

What is probability sampling?

A

A sampling approach in which everyone from a given population has an equal chance of being selected to participate in a study

53
Q

What are three types of probability sampling?

A
  • Simple random sampling
  • Stratified random sampling
  • Cluster random sampling
54
Q

What is the procedure for simple random sampling?

A

A subset of individuals is randomly selected from the entire population

55
Q

T or F: Access to the entire population is not necessary for simple random sampling.

A

False

56
Q

What is the procedure for stratified random sampling?

A

The population is divided into strata (subpopulations), then simple random sampling is used to select participants from each stratum in proportion to the population at large

57
Q

What is the procedure for cluster random sampling?

A

The population is divided into groups/clusters, then simple random sampling is used to select which clusters participate

58
Q

T or F: In cluster random sampling, clusters are normally naturally occurring.

A

True

59
Q

What is non-probability sampling?

A

A sampling approach in which everyone from a given population does not have an equal chance of being selected to participate in a study

60
Q

What are four types of non-probability sampling?

A
  • Convenience sampling
  • Quota sampling
  • Purposive sampling
  • Snowball sampling
61
Q

What is the procedure for convenience sampling?

A

Involves nonrandom selections of participants who are readily available to the researcher

62
Q

What is the procedure for quota sampling?

A

Researchers choose ahead of time that they want their sample to hold certain characteristics, then freely choose any participant that helps meet the quota

63
Q

What is the procedure for purposive sampling?

A

The researcher chooses a sample based on whom they think would be appropriate or qualified for the study

64
Q

Which type of non-probability sampling is most often used when a limited number of people have expertise in the area under investigation?

A

Purposive sampling

65
Q

What is the procedure for snowball sampling?

A

Existing study participants recruit future participants from among their acquaintances

66
Q

How does snowball sampling introduce bias into a sample?

A

The more social connections a person has, the higher their chance of selection

67
Q

What does non-response bias refer to?

A

The chance that those who refused to participate may systematically differ in a meaningful way from those who did

68
Q

Comparing the results of individuals who refused to participate at first, then agreed, with individuals who initially accepted, may be helpful when making inferences about which type of bias?

A

Non-response bias

69
Q

What is the volunteer subject problem?

A

The concern about the generalizability of conclusions from volunteer participants because they may differ from non-volunteers in meaningful ways

70
Q

What is the college sophomore problem?

A

The concern of generalizability, given that researchers often use convenience samples consisting of college/university students