Research Designs Flashcards

1
Q

true or false: the only method of control over pre-existing differences is through dispersion.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are major REASONS for choosing a within-subjects design?

A
  1. Dispersion; variables are spread equally because they are compared to themselves
  2. greater statistical power to find small effects
  3. Convenience (less people needed)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Explain the statistical reason for why you would opt to do a W-S experiment?

A

Lower Type 2 error (i.e. more likely to reveal a significant difference if a difference does in fact exist)

Maximizes primary variance associated w/ IV & reduces unwanted error variance (NOISE)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

When would you choose to not do an W-S experiment and go for between-subjects?

A
  1. If conditions cause lasting change; can’t give other levels of the IV because permanent change has happened
  2. Convenience reasons (lengthier time in session or multiple times)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the major threats to the internal validity of a W-S?

A

All are related to possible effects of repeated testing

Order Effects: response changes in a systematic fashion

Carry Over Effect: when a response to one task/condition varies as a function of whether another task/condition that precedes (or follows) it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

A child has to do both a lacing task and puzzle task. By the time the child gets to the puzzle, the performance level starts decreasing. What time of order effect is this? (A THREAT TO INTERNAL VAL.)

A

Fatigue effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

A child has to do both a clean up task and a reading task. The child did not perform well on the clean up task, but as they got more familiar, their performance increased. What type of order effect is this? (A THREAT TO INTERNAL VALIDITY)

A

Warm-up effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

A child is presented with a cognitive test that has them do both an inhibitory control test and an attentional span test. Although the child believed that the strategy to the 1st task would be applicable to the 2nd, it was not. What type of threat to internal validity is this?

A

Carry-Over effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

True or False: There is no general improvement or decline in carry-over effects

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

When are the internal validity threats most likely in W-S experiments?

A

When researcher adopts a constant order of presentation of conditions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the alternatives to a consistent order in administration of conditions?

A

Randomize (good for when # of tasks/conditions is large)

Counterbalancing (distribute task/condition equiv. across all possible positions)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Which is better counter-balancing or randomizing?

A

Counterbalancing bc it ensures no confounding of task & order

Permits check of order effects (if ea order is represented enough, we can compare the diff orders of pres)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

When would you HAVE TO CHOOSE a between-subjects design?

A

If expect conditions to cause lasting change.= (e.g. Therapy)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the MAJOR THREAT to internal validity in a B-S design?

A

When the two IV groups have systematically different kinds of participants in them = NON EQUIVALENT GROUPS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is the selection effects/bias?

A

When there are already differences found between condition groups; thus not a true effect of experimental manipulations; NOT RANDOMLY DISPERSED

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

To rule out pre-existing differences between participants in different conditions/groups, the
experimental method of control is through

A

equal dispersion = meaningful human differences are spread equally across the different conditions/groups.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

How do we rule out the non-equivalent groups threat in B-S design?

A

Random assignment

matching on important attributes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

True or False: It’s common for random assignment to be done in combination with a matching constraint (e.g., sex of infant); researchers seldom use totally random assignment.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

True or False:Most B-S studies include a degree of matching for variables like age and sex; this is a wider attempt to match on all variables of potential importance.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is the logic behind RA?

A

If ea. person has an equal chance of being selected, then the characteristics associated w/ each person have an equal chance of falling in each group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

How does matching on important attributes work (aka Matched Groups)

A

Identifies dimensions on which to make groups equal (e.g., IQ, SES, health status - the list will vary across studies) and then assigns participants based on these dimensions.

22
Q

True or false: Matching is always necessarily “partial matching”

A

true; we can never identify all potentially important variables

23
Q

What remains more important even in a matched-group design?

A

The random assignment

24
Q

What is the defining characteristic of a correlation design?

A

no manipulation of causal variable (i.e., IV/predictor); just measured as it naturally occurs

25
Q

What does a correlational statistic measure?

A

degree of relation between two variables (i.e., the relation between “predictor” & “criterion”); how much the variables “move” up and down together; THE NUMBER (-1 to +1)

Direction of relation; whether variables “move” in the same direction (positive +) or in opposite directions (i.e., when one goes up, the other goes down) (negative -)

26
Q

True or False:A correlational design and a correlational statistic are separable.

A

True

27
Q

True or False: Statistics other than correlation statistic/coefficient can be used to examine results of correlational design

A

True

28
Q

True or False: In some cases, a certain type of corr. coefficent can be calculated for experimental designs

A

True

29
Q

Correlational design = ?

A

“Nonexperimental” design (better phrasing)

group/condition comparisons based on correlational data

30
Q

Why would you choose to do a non-experimental design?

A
  1. wider range of variation/levels of the IV/predictor variable
  2. manipulation of IV/predictor is impossible (e.g. parent-child relationship quality)
  3. manipulation is unethical (e.g. spanking)
  4. manipulation is difficult (e.g. experiment w/in natural setting or too aritficial)
31
Q

Why can’t we establish cause-and-effect in a correlational/experimental design?

A

Lacks all of the forms of control we talked about earlier; control over the iv, setting, and pre-existing differences

32
Q

Lack of control of IV/predictor means lack of?

A

Internal validity

33
Q

What is the reverse causality problem?

A

Unsure of the direction of the effect ; X-> Y or Y->X

34
Q

How can we rule out reverse causation?

A

Nature of the variables; body size may affect aggression, but aggression may not cause your body size

35
Q

When does the reverse causality problem happen?

A

Sometimes

36
Q

What is the “third variable” problem?

A

Can’t be sure of equivalent comparison groups (i.e., can’t rule out a systematic difference on an extraneous variable; a preexisting difference or during study

37
Q

When is the third variable problem a problem?

A

Always

38
Q

How can we strengthen causal inferences for reverse causality?

A

Measure variables at more than one time, then calculate cross-lag correlations

39
Q

For reverse causality; if X causes Y; what should correlate and what shouldn’t?

A

X1 & Y2 should sig correlate

Y1 & X2 should NOT correlate

40
Q

true of false: the correlation test for reverse causation proves causal role of X

A

False; it does not bc the study does not have exp. control, but does heighten probability of causal inference

41
Q

True or False: We ALWAYS need to address the confound variable in correlational studies

A

Yes; major threat of C

42
Q

How do we address the confound variables?

A

1) measure potential C
2) plan to statistically test for whether C varies with your IV and most importantly, your DV
3. if PV is cont & has no groups (also assum. C is cont) do a regression analysis/ if P has group/cat (C should be cont); then do t-test or ANOVA to see if means/avgs differ
4. since most DVs (Y) are cont, you test whether c systematically varies with your DV w/ a corr coefficent

43
Q

How do we address the confound variables?

A

1) measure potential C

2) plan to statistically test for whether C varies with your IV and most importantly, your DV

  1. if PV is cont & has no groups (also assum. C is cont) do a regression analysis/ if P has group/cat (C should be cont); then do t-test or ANOVA to see if means/avgs differ
  2. since most DVs (Y) are cont, you test whether c systematically varies with your DV w/ a corr coefficent
  3. Check results; C is only a confound if it varies with BOTH PV/IV and DV
44
Q

C is only a confound variable when what?

A

Varies w both DV and IV/PV

45
Q

How do you address “third variable problem”

A

By stat controlling/removing confound factors

46
Q

What do you do when there is a confound involving CONTINUOUS variables?

A

include covariates in multiple regression; whether X1 or X2 predicted any variation in the DV above and beyond explained by the confound C `

47
Q

What do you do when there is a confound involving groups?

A

include C as a covariate when conducting a one-way or two-way ANOVA (i.e., ANCOVA), then see if the means of your groups significantly different

48
Q

If you study a SINGLE predictor (X1) that is continuous there’s another option…

A

compute partial correlation for y-X1

49
Q

What does partialing out do?

A

removes the contribution of a third variable C from a correlation between two other variables (Y, X1).

50
Q

Partial- correlation holds the C ____ while examining the relation between the two variables

A

constant

51
Q

What is the main limitation of statistical control in non-experimental designs?

A

No way to identify/measure, and statistically remove all possible confounding C factors.