Stats - Research Design

Question 1

What design has at least one manipulated IV and subjects are randomly assigned?

Answer 1

True Experimental Design

Question 2

What design has at least one manipulated IV, and subjects are not randomly assigned

Answer 2

Quasi-Experimental Design

Question 3

What design has no manipulation of an independent variable?

Answer 3

Non-experimental, observational or passive design

Question 4

How do you eliminate the possible carryover effects in “within-subject design”?

Answer 4

Counterbalancing
(Latin square = how you can do counterbalancing)

Question 5

Difference between idiographic and nomothetic

Answer 5

Idiographic: single-subject approach
Nomothetic: group approached

Question 6

What is the significant problem associated with a single-subject design called that results in highly correlated data from measuring the same person repeatedly?

Answer 6

autocorrelation

Question 7

What single-subject design has a baseline and then a treatment phase?

Answer 7

AB Design

Question 8

What’s a threat to an AB Design & what does it mean?

Answer 8

The threat of history which is when something co-occurs at the time of research that impacts the outcomes of the research

Question 9

Explain the process of an ABAB Design

Answer 9

When a single study research design starts with a baseline phase, then a treatment phase, then a return to baseline phase and then another treatment phase

Question 10

What does an ABAB design protect against?

Answer 10

A threat of history

Question 11

What single subject design could have problems with the ethics & a failure of returning to baseline?

Answer 11

ABAB Design

Question 12

What single subject design helps you try out two different treatments at once?

Answer 12

Simultaneous (alternating) treatment design

Question 13

What single-subject design is when the treatment is done sequentially, across either subjects, settings or behaviours

Answer 13

Multiple Baseline Design

Question 14

What design resolves the problems found in AB & ABAB designs?

Answer 14

Multiple Baseline Design

Question 15

What would the single-subject design be called if a researcher set a criterion of 8 cups per day and then over time, changed it to 6 cups per day to eventually no cups at all

Answer 15

Changing Criterion Design

Question 16

What type of sampling measurement do you use when a behaviour is not discrete?

Answer 16

Time sampling

Question 17

What’s momentary time sampling?

Answer 17

Only recording a behaviour that it is present or absent at the precise moment that the interval ends

Question 18

What’s whole interval sampling?

Answer 18

Observed for the entire interval and only received a checkmark if the target behaviour is exhibited for the full duration of the interval

Question 19

What type of sampling will tally the number of times a target behaviour occurs or doesn’t occur? It’s also a sampling best for discrete behaviours or ones that don’t happen often.

Answer 19

Event Recording

Question 20

What’s the research called that evaluates treatment under conditions that only resemble or approximate clinical settings where the problems studied are less severe?

Answer 20

Analogue Research

Question 21

What’s it called when you do outcome investigations conducted in clinical settings?

Answer 21

Clinical Trials

Question 22

Cross-sectional research

Answer 22

When you research differences across sections (e.g., different ages)

Question 23

What does the problem of cohort effects mean in cross-sectional research?

Answer 23

inherent differences between groups that limit the research being done

Question 24

What type of research has problems with significant expenses and high dropout rates?

Answer 24

Longitudinal Research

Question 25

What research follows subjects over many years to understand the changes as we age?

Answer 25

Longitudinal research

Question 26

What's cross-sequential or cohort sequential research?

Answer 26

Takes several cross-sections and follows them for a briefer timeframe (e.g., 10 years)

Question 27

What are sampling procedures?

Answer 27

How we select our subjects from the population

Question 28

What type of sampling provides an equal chance of every member of a population being randomly selected?

Answer 28

Simple Random Sampling

Question 29

What type of sampling is first divided into strata, and then a random sample of equal size of each strata is selected

Answer 29

Stratified Random Sampling

Question 30

Proportional Sampling

Answer 30

Individuals are randomly selected in proportion to their representation in the general population

Question 31

What's sampling called where you pick every 10th person is selected in a way that's not bias

Answer 31

Systematic Sampling

Question 32

What type of sampling involves identifying naturally occurring groups of subjects and randomly selecting certain groups (e.g., classes at a university)

Answer 32

Cluster sampling

Question 33

What's a threat in research design?

Answer 33

Something interfering with drawing clear conclusions in research

Question 34

What causes threats to internal validity?

Answer 34

Factors other than the IV that may have caused the change to the DV

Question 35

What's a threat of maturation?

Answer 35

Factors that affect a subject's performance because of the passing of time

Question 36

What's the best control for a threat of history or maturation?

Answer 36

Having a control group within your study

Question 37

What's a threat of testing or test practicing?

Answer 37

it comes from subjects familiarity with the testing that affects scores on repeated testing

Question 38

What's the best control for Testing or Test Practice threats?

Answer 38

Solomon Four Group Design

Question 39

What's involved in the Solomon Four Group Design?

Answer 39

Involves dividing subjects into 4 groups where: 1. one group is measured pre and post and gets the intervention in between 2. second group is measured pre and post but does not get the intervention 3. third group is measured post only and gets the intervention 4. fourth group is measured post only and does not get the intervention

Question 40

What's an instrumentation threat?

Answer 40

Changes in observers or the calibration of equipment that's causing change other than the subjects themselves

Question 41

The threat of statistical regression or a tendency to the mean

Answer 41

is the tendency for extreme scores (scores very much above or below the mean) to become less extreme (closer to the mean) on retesting without any intervention.

Question 42

What's a very common threat to internal validity?

Answer 42

Statistical regression

Question 43

What's the best way to manage the threat of statistical regression?

Answer 43

A control group

Question 44

The threat of selection bias

Answer 44

it's a threat of non-random assignment, when you don't randomly assign your subjects like using volunteers

Question 45

Threat of Attrition or Experimental Mortality

Answer 45

Subjects quitting the experiment and there's a differential loss of subjects from the groups

Question 46

Threat of Diffusion

Answer 46

When the no-treatment group actually gets some of the treatment

Question 47

What's a threat of construct validity

Answer 47

if our treatment was effective, was it the essential components of treatment that caused the results or was it something else (if it's something else then it was a threat to construct validity)

Question 48

Threat of attention & contact with clients (threat to construct validity)

Answer 48

did the treatment group do better because they simply got attention from the therapist

Question 49

Experimental expectancies is also called what?

Answer 49

The Rosenthal Effect

Question 50

What is experimental expectancies (Rosenthal Effect)? (threat to construct validity)

Answer 50

Unintentional cues or clues given to the subjects about how they should respond by the experimenter

Question 51

How do we control experimenter expectancy threat?

Answer 51

keeping the experimenter blind to the control vs non control group

Question 52

Threat of demand characteristics (threat to construct validity)

Answer 52

factors in the procedures that suggest how the subject should behave, like telling subjects the medication has side effects and then subjects report more side effects

Question 53

How to control the threat of demand characteristics?

Answer 53

Keeping the subjects blind

Question 54

What's the John Henry Effect or compensatory rivalry? (threat to construct validity)

Answer 54

it occurs when the control group tries harder than the experimental group in the spirit of competition

Question 55

What is a threat to external validity?

Answer 55

When something interferes with the generalizability - can we generalize from our research situation to people who aren't participating

Question 56

Threat of sample characteristics (external validity)

Answer 56

The volunteers of the research are somehow different than the rest of the population

Question 57

Threat of stimulus characteristics (external validity)

Answer 57

the setup of the artificial research not meeting the same characteristics as naturalistic settings

Question 58

What's an example of a contextual characteristics threat to external validity

Answer 58

Reactivity which is when subjects behave in a certain way just because they are participating in the research and are being observed

Question 59

the Hawthorne effect is an example of what type of threat to external validity.

Answer 59

Contextual characteristics

Question 60

Threat of low power to statistical conclusion validity

Answer 60

diminishing the ability to find significant results like small sample sizes or inadequate interventions

Question 61

Threat of unreliability of measures to statistical conclusion validity

Answer 61

The measures are unreliable

Question 62

Threat of variability in procedures to statistical conclusion validity

Answer 62

inconsistency of treatment procedures

Question 63

Threat of subject heterogeneity

Answer 63

It's when during research where the goal is to look for differences, the greater the subject variability/diversity/heterogeneity the less likelihood of finding significance

Question 64

What two concepts minimize moat threats to internal validity but then what's the tradeoff?

Answer 64

using a control group and random assignment the more controlled or precise the experiment is, the less generalizable it will be

Question 65

The greater the internal validity, the lower the _____ _______

Answer 65

external validity