Research Design Flashcards

1
Q

True experimental design

A

at least one IV Is manipulated and subjects are randomly assigned

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Quasi-experimental design

A

at least one IV is manipulated, but there is non-random assignment of subjects, typically because subjects are already in pre-existing groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Observational, passive, or non-experimental

A

no intervention or manipulation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Between groups design

A

only compares groups that are independent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Within subjects design

A

groups contrasted are correlated or related (e.g. matched or repeatedly measured)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Counterbalancing

A

Because of possible carryover effects

Latin square is most sophisticated form of counterbalancing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Mixed design

A

involve groups that are both independent or correlated

e.g. between and within subjects design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Single subjects designs (five types)

A

one or very few subjects are studied intensively and each subject is measured many times
AB, ABAB, multiple baseline, simultaneous treatment, changing criterion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Autocorrelation

A

effect of measuring the same person repeatedly, which results in highly correlated data
significant problem associated with any single subject design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

AB Design

A
single subjects design
baseline condition (A) followed by treatment condition (B)
most significant problem is the threat of history - hard to determine whether it was intervention that caused change or some other event
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

ABAB Design

A

single subjects design
baseline (A), treatment (B), baseline (A), treatment (B)
protects against threat of history
two problems: failure of DV to return to baseline and issue of ethics regarding removing effective treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

multiple baseline design

A

single subjects design
treatment applied sequentially or consecutively across subjects, situations, or behaviors
problems: more time consuming and expensive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

simultaneous (alternating) treatment design

A

single subjects design
involves two or more interventions implemented concurrently during the treatment phase
treatments are balanced and varied across time of day
allows for comparison of the relative effectiveness of two or more interventions for an individual

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

changing criterion design

A

single subject design

attempt made to change behavior in increments to match a changing criterion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

time sampling

A

type of behavioral measurement that is useful when a behavior is not discrete, and thus has no distinct beginning and end
two types: momentary time sampling and whole-interval sampling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

momentary time sampling

A

observer recording whether target behavior is present or absent at the moment the time interval ends

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

whole-interval sample

A

aka interval sampling or interval recording

involves scoring target behavior positively only if it is exhibited for a full duration of the time interval

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

event recording

A

involves tallying the number of times the target behavior occurred

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

analogue research

A

evaluates treatment under conditions that only resemble or approximate clinical situations
typically study less severe problems
treatments tend to be highly standardized
e.g. participants are college students and volunteers and therapists are graduate students
problem - limited generalizability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

clinical trials

A

outcome investigations conducted in clinical settings

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

cross-sequential research

A

aka cohort-sequential research
takes several cross sections (e.g. of age groups) and follows them over briefer periods of time (e.g. 5-10 years instead of lifespan)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

simple random sampling

A

every member of population has an equal chance of being randomly selected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

stratified random sampling

A

population first divided into strata (e.g. age levels, income levels, ethnic groups), and then random sample of equal size from each stratum is selected

24
Q

proportional sampling

A

individuals randomly selected in proportion to their representation in the general population

25
Q

systematic sampling

A

involves selecting every kth element after a random start

26
Q

cluster sampling

A

involves identifying naturally occurring groups of subjects (clusters) and randomly selecting certain clusters (e.g. classes or departments at a university); once cluster has been selected, all the subjects within the cluster are usually surveyed

27
Q

internal validity

A

degree of validity of statements made about whether X causes Y

28
Q

threats to internal validity (8)

A

history, maturation, testing or test practice, instrumentation, statistical regression, selection bias, attrition or experimental mortality, diffusion

29
Q

threat to internal validity - history

A

specific incidents that intervene between measuring points, either in or outside of the experimental situation

30
Q

threat to internal validity - maturation

A

factors that affect the subjects’ performance because of the passing of time (fatigue, maturing)

31
Q

threat to internal validity - testing or test practice

A

occurs when familiarity with testing affects scores on repeated testing

32
Q

Solomon Four-Group Design

A

controls for testing threat to internal validity
divides subjects into four groups
Group 1: pre-test, intervention, post-test
Group 2: pre- and post-test
Group 3: intervention and post-test
Group 4: post-test only

33
Q

threat to internal validity - instrumentation

A

refers to changes in observers of calibration of equipment

34
Q

threat to internal validity - selection bias

A

caused by non-random assignment

35
Q

threat to internal validity - attrition or experimental mortality

A

when there is a differential loss of subjects from the groups

36
Q

threat to internal validity - diffusion

A

occurs when the no-treatment group actually gets some of the treatment

37
Q

construct validity

A

refers to factors other than the desired specifics of the intervention that result in differences
these factors often lumped under threats to external validity

38
Q

threats to construct validity (4)

A

attention and contact with clients
experimenter expectancies
demand characteristics
John Henry effect

39
Q

threat to construct validity - experimenter expectancies

A

aka Rosenthal effect
refers to cues or clues transmitted to subjects by the experimenter
eg. smiling inadvertently nodding encouragingly only to those receiving treatment

40
Q

threats to construct validity - demand characteristics

A

factors in the procedures that suggest how subject should behave
e.g. subjects given medication told it might cause side effects, those with placebo told there won’t be side effects
to reduce demand characteristics, subjects should be blind to treatment condition

41
Q

threats to construct validity - John Henry Effect

A

aka compensatory rivalry
occurs when persons in a control group try harder than usual in spirit of competition with experimental group
JH was legendary railroad steel driver who swung his hammer in competition with steam drill and died from overexertion
to control for JOhn HEnry effect, experimental and control groups should not know each other

42
Q

external validity

A

generalizability

43
Q

threats to external validity (3)

A

sample characteristics
stimulus characteristics
contextual characteristics

44
Q

threats to external validity- sample characteristics

A

refers to differences between sample and population

45
Q

threats to external validity - stimulus characteristics

A

such as artificial research arrangements

features of the study with which the intervention is associated

46
Q

threats to external validity - contextual characteristics

A

refer to conditions in which the intervention is imbedded
reactivity - when subjects behave in a certain way just because they are participating in research and being observed
Hawthorne effect - frequently described example of reactivity

47
Q

threats to statistical conclusion validity (4)

A

low power
unreliability of measures
variability in procedures
subject heterogeneity

48
Q

threats to statistical conclusion validity - low power

A

low power is the diminished ability to find significant results
contributing factors - sample size, inadequate interventions (e.g. tx only lasting two sessions)

49
Q

threats to statistical conclusion validity - unreliability of measures

A

even if intervention is effective, significant differences may not be found if the outcome measure sured is unreliable

50
Q

threats to statistical conclusion validity - variability in procedures

A

refers to inconsistency in treatment procedures, which can obscure significant treatment findings
especially a concern in psychotherapy outcome research

51
Q

threats to statistical conclusion validity - subject heterogeneity

A

makes it more difficult to find significant differences between groups

52
Q

Face validity

A

What test appears superficially to measure

53
Q

Experimentwise Error Rate

A

Probability of making a Type I error

54
Q

idiographic

A

term used to describe single subject approaches

55
Q

nomothetic

A

term used to describe group approaches

56
Q

normative data

A

data that can be compared both within and across subjects

57
Q

ipsative data

A

results from forced choice format

can only describe relative strengths or interests wihin a subject and cannot be used for comparisons across subjects