Group Design Flashcards

1
Q

6 steps in conducting an experiment

A
  • formulate hypothesis
  • select variables
  • limit alternative explanations
    manipulate IV and measure DV
  • analyze variation in DV
  • draw inferences about relationship between IV and DV
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

select setting

A

field or lab

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

select type of approach

A

longitudinal or cross sectional

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

equivalence in groups

A

making sure all confounding are considered and groups are equivalent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

how do we ensure group equivalence

A
  • assign participants independently and randomly to conditions (levels of IV)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

dependent assignment

A

If participant 1 went into group A, participant 2 went into group B (might make sense if you want to avoid the influence of the preexisting relationships between participants)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

who is good for studying nature vs. nurture

A

Twin studies are good for researching nature vs. nurture, don’t assign participants randomly or twins may end up in same group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

independent design

A

Assign participants independently and randomly to conditions (levels) of the IV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

completely randomized group design with 2 levels

A
  • The simplest type of the independent random design is completely randomized design: participants are randomly assigned to 2 different levels of one independent variable.
  • 2 variable so can use t-test
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

if there is more than 2 conditions being testes the correct statistical test is

A

ANOVA ANalysis of VAriance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

2x2 design has _____ conditions

A

4

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

if we do not see main effect ad only see effect in particular condition(s)

A

we cannot interpret main effects without stating the interaction differences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

2 major types of dependent design

A

matched group design

within participant / repeated measure design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

matchced group design

A
  • We assign participants non-randomly into groups are matched (equalized) at least on one matching variable
  • You select two participants with a similar performance /ability /characteristic and assign one participant to condition 1 and another to condition 2. The variable that the participants perform similarly on is called the matched variable.
  • powerful technique since matching reduces variability between participants, and yet you don’t have to worry about carryover effects or differential order effects since one participant does not do all the conditions but only one.
  • is crucial that the matched variable is related to (correlated with) the dependent variable.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

within participant or repeated measure design

A
  • The same participants are used in all treatment conditions. Participants are equivalent to themselves
  • Design is economical
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

dependent design

A
  • Dependent designs can have one or more IVs, just like independent designs
  • Often time serves as one of the IVs, e.g., if the same group of participants is measured at different occasions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

factorial dependent experiment

A

all combinations of all levels of all IVs are present in such an experiment, we call it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

carry over effects

A

Since a participant sees all experimental items (stimuli), we should be concerned with the effects of items they see early on in their performance later in the experiment: carryover, order, transfer effects. Fatigue and practice are common examples of carryover effects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

complete counterbalancing

A

each condition occurs equally often and precedes and follows all other conditions the same number of times. It works beautifully but requires a large number of participants

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

differential order effects

A
  • example of confounding variable
  • if some conditions change the behaviour of participants in an irreversible way, counterbalancing won’t help with this, as this is not about practice or fatigue.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

mixed designs

A

some variables are assessed within participants and some between participants. If carryover is expected for a variable, it can be treated as a between-participants, others - where no such problem is expected - as within-participants

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

ANOVA DV and IV

A
  • The dependent (Y) variable is the interval / ratio numeric variable
  • But the independent (X) variable is is categorical (nominal / ordinal)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

how does ANOVA work

A

analyzed variance between and within each sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

total sum of squares

A

SSt = SSw + SSb

25
Q

if samples have difference means the variance between them will be _____

A

larger than the variance within samples

26
Q

calculating the ratio of variance we use a

A

F-test

27
Q

The ratio of variances follows the F-distribution with two values of degrees of freedom

A

total number of data points across samples, minus one; and number of samples minus 1

28
Q

ANOVA tells us

A

us is that there is a significance difference between groups. It does not tell us where it is

29
Q

t-test i excel

A

= Z-TEST (range)

30
Q

how is correlation computed

A

graphically represented by the regression line

31
Q

regression line

A

the line that maximizes the sum of residuals

32
Q

residuals

A

distances from the observed values values to the line

33
Q

if r (correlation coefficient) is closer to 1

A

stronger correlation

34
Q

small r

A

0.1

35
Q

medium r

A

0.3

36
Q

large r

A

0,5

37
Q

correlation only measure ______) relationships

A

linear

38
Q

can you meaningfully use z-scores in non- normal distributions

A

no

39
Q

spearman’s p

A

ranks one variable then the other, for each pair compute the difference of ranks d and square it

40
Q

spearman’s p is maximal when

A
  • X consistently increases with the increase/decrease in Y.

- Unlike Pearson’s r, it does not matter how strong the increase in X is, only how systematic it is

41
Q

survey

A

looks into attitudes and opinions

42
Q

face-to-face interviews

A

• Consider the location you are at: at the airport you generally do not see impoverished people, and you do see a larger percent of people who are on the road due to their occupation (e.g., businesspeople).

43
Q

disadvantages of face-to-face interviews

A
  • sampling procedure
  • interviewer’ bias
  • social desirability and other types of reactivity (imagine asking high-school students whether they smoked marijuana).
  • Costs
44
Q

phone interview

A
  • Usually structured interviews: a prepared list of questions, or a script.
  • Must be shorter than face-to-face, no more than 10 minutes.
  • Advantages: relative anonymity, better sampling.
45
Q

disadvantage to phone interview

A

selection bias

46
Q

self administered questionnaire

A
  • A responder reads and responds to a SAQ, no contact with the researcher.
  • Cheap and fast: often a tool of preference.
47
Q

disadvantage to self advminstered questionnaire

A

responders must follow the instructions and be literate; researchers must do a very good job writing up the questionnaire

48
Q

group administered questionnaires

A
  • The questionnaire is distributed among people who naturally form a group: a class in school, a society, a community, etc..
  • Better targeting of populations you are interested in
49
Q

internet questionnaires

A
  • The cheapest and fastest way of collecting information.
  • Good targeting of populations of interest: for data on opinions about animal rights you can post your survey on a website defending these rights.
50
Q

disadvantages to internet questionnaires

A

Problems: multiple submissions; self-selection

51
Q

program evaluation

A
  • a common task that researchers face is an evaluation of the efficiency of large-scale social programs
  • Researchers assess whether the program
    Has met its goals
    Is really needed
    Is cost efficient
    Is well run
    Can be improved and how
52
Q

how is program evaluation done

A
  • (Re-)defining goals in measurable terms. Selecting outcome variables: the more objective the measures, the better. Important to reduce bias.
  • Checking the deliverables of a program against its advertise goals.
  • User satisfaction is often measured as well as indices of improvement in the life of targeted individuals
53
Q

archival research

A
  • Time-series data rely on information documented before an event and after the event. Researchers retreat to existing and available collections of older data.
  • For linguists, corpora are an example of archival data.
54
Q

advantages of archival research

A
  • Huge information base.
  • No problem with participants’ reactivity.
  • Experimenter’s bias is important though, and needs to be reduced. Might reflect in what data is chosen and how.
55
Q

meta-analysis

A
  • Review all published studies on a topic.
  • Compare effects and effect sizes over multiple studies.
  • The idea is to compute the effect size combined over experimental and correlational studies of the same underlying variable
56
Q

PIAAC

A
  • Program for the International Assessment of Adult Competencies
  • ages 16-65
  • multi-stage sampling
  • combined with quota
  • can handle 2 IV
57
Q

does meta-analysis have high or low statistical power

A

high

58
Q

benefit of meta-analysis

A

useful for summarizing the results of existing studies and for working out recommendations for further research