Research Design Flashcards

1
Q

True experimental design

A

at least one IV Is manipulated and subjects are randomly assigned

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Quasi-experimental design

A

at least one IV is manipulated, but there is non-random assignment of subjects, typically because subjects are already in pre-existing groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Observational, passive, or non-experimental

A

no intervention or manipulation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Between groups design

A

only compares groups that are independent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Within subjects design

A

groups contrasted are correlated or related (e.g. matched or repeatedly measured)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Counterbalancing

A

Because of possible carryover effects

Latin square is most sophisticated form of counterbalancing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Mixed design

A

involve groups that are both independent or correlated

e.g. between and within subjects design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Single subjects designs (five types)

A

one or very few subjects are studied intensively and each subject is measured many times
AB, ABAB, multiple baseline, simultaneous treatment, changing criterion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Autocorrelation

A

effect of measuring the same person repeatedly, which results in highly correlated data
significant problem associated with any single subject design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

AB Design

A
single subjects design
baseline condition (A) followed by treatment condition (B)
most significant problem is the threat of history - hard to determine whether it was intervention that caused change or some other event
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

ABAB Design

A

single subjects design
baseline (A), treatment (B), baseline (A), treatment (B)
protects against threat of history
two problems: failure of DV to return to baseline and issue of ethics regarding removing effective treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

multiple baseline design

A

single subjects design
treatment applied sequentially or consecutively across subjects, situations, or behaviors
problems: more time consuming and expensive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

simultaneous (alternating) treatment design

A

single subjects design
involves two or more interventions implemented concurrently during the treatment phase
treatments are balanced and varied across time of day
allows for comparison of the relative effectiveness of two or more interventions for an individual

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

changing criterion design

A

single subject design

attempt made to change behavior in increments to match a changing criterion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

time sampling

A

type of behavioral measurement that is useful when a behavior is not discrete, and thus has no distinct beginning and end
two types: momentary time sampling and whole-interval sampling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

momentary time sampling

A

observer recording whether target behavior is present or absent at the moment the time interval ends

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

whole-interval sample

A

aka interval sampling or interval recording

involves scoring target behavior positively only if it is exhibited for a full duration of the time interval

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

event recording

A

involves tallying the number of times the target behavior occurred

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

analogue research

A

evaluates treatment under conditions that only resemble or approximate clinical situations
typically study less severe problems
treatments tend to be highly standardized
e.g. participants are college students and volunteers and therapists are graduate students
problem - limited generalizability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

clinical trials

A

outcome investigations conducted in clinical settings

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

cross-sequential research

A

aka cohort-sequential research
takes several cross sections (e.g. of age groups) and follows them over briefer periods of time (e.g. 5-10 years instead of lifespan)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

simple random sampling

A

every member of population has an equal chance of being randomly selected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

stratified random sampling

A

population first divided into strata (e.g. age levels, income levels, ethnic groups), and then random sample of equal size from each stratum is selected

24
Q

proportional sampling

A

individuals randomly selected in proportion to their representation in the general population

25
systematic sampling
involves selecting every kth element after a random start
26
cluster sampling
involves identifying naturally occurring groups of subjects (clusters) and randomly selecting certain clusters (e.g. classes or departments at a university); once cluster has been selected, all the subjects within the cluster are usually surveyed
27
internal validity
degree of validity of statements made about whether X causes Y
28
threats to internal validity (8)
history, maturation, testing or test practice, instrumentation, statistical regression, selection bias, attrition or experimental mortality, diffusion
29
threat to internal validity - history
specific incidents that intervene between measuring points, either in or outside of the experimental situation
30
threat to internal validity - maturation
factors that affect the subjects' performance because of the passing of time (fatigue, maturing)
31
threat to internal validity - testing or test practice
occurs when familiarity with testing affects scores on repeated testing
32
Solomon Four-Group Design
controls for testing threat to internal validity divides subjects into four groups Group 1: pre-test, intervention, post-test Group 2: pre- and post-test Group 3: intervention and post-test Group 4: post-test only
33
threat to internal validity - instrumentation
refers to changes in observers of calibration of equipment
34
threat to internal validity - selection bias
caused by non-random assignment
35
threat to internal validity - attrition or experimental mortality
when there is a differential loss of subjects from the groups
36
threat to internal validity - diffusion
occurs when the no-treatment group actually gets some of the treatment
37
construct validity
refers to factors other than the desired specifics of the intervention that result in differences these factors often lumped under threats to external validity
38
threats to construct validity (4)
attention and contact with clients experimenter expectancies demand characteristics John Henry effect
39
threat to construct validity - experimenter expectancies
aka Rosenthal effect refers to cues or clues transmitted to subjects by the experimenter eg. smiling inadvertently nodding encouragingly only to those receiving treatment
40
threats to construct validity - demand characteristics
factors in the procedures that suggest how subject should behave e.g. subjects given medication told it might cause side effects, those with placebo told there won't be side effects to reduce demand characteristics, subjects should be blind to treatment condition
41
threats to construct validity - John Henry Effect
aka compensatory rivalry occurs when persons in a control group try harder than usual in spirit of competition with experimental group JH was legendary railroad steel driver who swung his hammer in competition with steam drill and died from overexertion to control for JOhn HEnry effect, experimental and control groups should not know each other
42
external validity
generalizability
43
threats to external validity (3)
sample characteristics stimulus characteristics contextual characteristics
44
threats to external validity- sample characteristics
refers to differences between sample and population
45
threats to external validity - stimulus characteristics
such as artificial research arrangements | features of the study with which the intervention is associated
46
threats to external validity - contextual characteristics
refer to conditions in which the intervention is imbedded reactivity - when subjects behave in a certain way just because they are participating in research and being observed Hawthorne effect - frequently described example of reactivity
47
threats to statistical conclusion validity (4)
low power unreliability of measures variability in procedures subject heterogeneity
48
threats to statistical conclusion validity - low power
low power is the diminished ability to find significant results contributing factors - sample size, inadequate interventions (e.g. tx only lasting two sessions)
49
threats to statistical conclusion validity - unreliability of measures
even if intervention is effective, significant differences may not be found if the outcome measure sured is unreliable
50
threats to statistical conclusion validity - variability in procedures
refers to inconsistency in treatment procedures, which can obscure significant treatment findings especially a concern in psychotherapy outcome research
51
threats to statistical conclusion validity - subject heterogeneity
makes it more difficult to find significant differences between groups
52
Face validity
What test appears superficially to measure
53
Experimentwise Error Rate
Probability of making a Type I error
54
idiographic
term used to describe single subject approaches
55
nomothetic
term used to describe group approaches
56
normative data
data that can be compared both within and across subjects
57
ipsative data
results from forced choice format | can only describe relative strengths or interests wihin a subject and cannot be used for comparisons across subjects