Task 3 Flashcards

1
Q

Dependent variable

A
• “Outcome variable”
• Measurable
• Influenced by change in condition
Example:
Is reaction time decreased by drinking coffee?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Independent variable

A

• “Condition”
• Directly altered by experimenter
Example:
Is reaction time decreased by drinking coffee (eg 1cup, 2cups, 3cups)?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Which question should you ask while thinking about the reliability of your experiment?

A

How similar would the result be if the experiment is repeated?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Which question should you ask by thinking about the validity of your experiment?

A

Does the measure actually measure what the researcher intends to measure?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Name 3 sources of variability

A
  1. precision of measure: variability due to imperfections in measuring tool
  2. Interrater Reliability: variability due to differences in judgments of observer
  3. Marion of error: variability due to individual differences within a sample
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Test-retest reliability

A
  • Similarity of result if test is repeated

* Best for assessing stable characteristics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Name 3 problems of test-retest reliability

A
  • Remembering of questions
  • Longer interval between tests needed
  • Change in participant between tests
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

explain parallel/ alternate-forms reliability

A

-equivalent questions are asked
- can be administered after each other
2 tests with a bigger time difference

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Name 2 problems of parallel / alternate-forms reliability

A

• Equivalence of questions
• Change in participant between tests
one bigger test at one time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Explain split-half reliability

A

• One bigger test is administered
• Equivalent questions are repeated
• Results of equivalent questions are scored
individually

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the problem of Split-half reliability?

A

Equivalence of questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the accuracy of measure by validity?

A
  • Comparing to a standard

* Biased if scores differ on average from standard

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What do you know about the observer bias? What is the solution?

A
  • May arise of researcher has a desired outcome in mind

* Solution: Blind observers (Researcher do not know condition of participant during experimentation)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Name 4 types of validity

A
  1. Face Validity
  2. Content Validity
  3. Criterion-related Validity
  4. Construct Validity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Face Validity

A

test seems to test what it is explained to test. Perceived legitimacy of the test can influence participants’ attitude

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Content Validity

A

test actually tests what it is designed to test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Criterion-Related Validity

A

Compare your results with someone else
• Concurrent: agreement with “golden standard” (right now)
• Predictive: successful prediction of future behavior

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Construct Validity

A
  • Convergent (similar to instruments measuring the same construct) you compare to a other test from the same area and want to get similar results
  • Divergent (not similar to measure of a different construct) you compare to a test of another area and want to have different results
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is internal validity?

A
  • Ability of your research design to adequately test your hypothesis
  • Showing that the variation in the independent variable caused the observed effect
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Name 2 threats (Bedrohungen) of internal validity?

A

• Rival hypothesis: another alternative variable might explain the effect
Alternative explanations
• Confounding: combination of variables explains the effect and one cannot separate the effect of these variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Name 8 sources of confounding (Störeinfluss)

A
  1. History: specific events other than treatment occur between observations (eg. 9/11)
  2. Maturation: fatigue or aging change performance over time
  3. Instrumentation: instrument calibration changes and confounds the effect
  4. Statistical regression: subjects selected for treatment on the basis of their extreme scores tend to move closer to the mean when retesting
  5. Biased subject selection: nonrandom
  6. Experimental mortality / attrition: dropouts (is mainly a problem if its a random dropout (experiment gets to heavy pat. drops out)
  7. Demand characteristics: participants know
    the purpose of the study and behave differently
  8. Placebo effect: participants get better because they believe that they receive an effective treatment
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is external validity?

A

ability of your research design to generalize the results beyond the research setting to real world situations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Name 4 threats of external validity

A
  1. reactive testing
  2. interactions between participant selection biases and independent variable
  3. reactive effects of experimental arrangements
  4. multiple treatment interference
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

reactive testing

A

pretests may affect reaction to the experimental test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Interactions between participant selection biases and the independent variable

A

participants that signed up voluntarily could be more extroverted, this could affect your study if you are measuring for example personality types

26
Q

Reactive effects of experimental arrangements

A

artificial experimental setting and knowledge of being a study-participant change results

27
Q

Multiple treatment interference

A

If participants are exposed to multiple treatments and later treatments are affected by former ones

28
Q

Why taken samples?

A

To make general statements about the population, but it is only possible to ask a limited number of people

29
Q

What is important to keep in mind by choosing a sample?

A
  • How many is enough

* Is my sample biased

30
Q

What is a simple random sample?

A

A group of people is randomly chosen from the whole population
• Solves problem of bias
• In reality hard to manage to get a truly random sample

31
Q

Population

A

all individuals that are there (usually too big to test every individual)

32
Q

sample

A

a smaller group chosen from big group

33
Q

generalization

A

applying findings from a sample to a large population

34
Q

representative sample

A

matches characteristics of the population

35
Q

Non-representative sample

A

biased

36
Q

Random sample

A

identify the population and then draw a random sample from it

37
Q

Nonrandom sample

A

choosing special individuals/ subject pools

Only university students
Internet research
Animal subjects (same breed, sex etc.)

38
Q

Name 5 kinds of sampling

A
  1. simple random sample
  2. stratified sampling
  3. proportionate sampling
  4. systematic sampling
  5. cluster sampling
39
Q

simple random sample

A

randomly selecting a number of people

40
Q

stratified sampling

A

dividing population into segments (=strata), then selecting a sample of equal size from each segment

41
Q

proportionate sampling

A

proportions of people in the population are equal to proportions in your sample

42
Q

systematic sampling

A

every Kth element after a random start

43
Q

cluster sampling

A

naturally occurring groups of subjects and randomly selecting certain clusters

44
Q

Multistage sampling

A

selecting individuals from those clusters

45
Q

Laboratory research

A
  • Take individuals into laboratory setting
  • Control variables
  • More ethical
  • High internal validity and low external validity
46
Q

Field research

A

• In participants natural environment
• Lesser control of confounding variables
• Results can easily be generalized to the real
world
• High external validity and low internal validity

47
Q

Which options do you have for your research setting?

A

laboratory research or field research

48
Q

Which negative effects can volunteerism of a participant have?

A

Volunteerism lowering internal validity
change in outcome not because of condition, but because participants want to “help” the researcher

Volunteerism lowering external validity because subjects that volunteer often differ in specific ways from the average population

49
Q

Which 2 types of non-experimental research do you know?

A

observational research

surveys

50
Q

Name 3 method of quantification for observational research

A
  • Frequency
  • Duration
  • Interval
51
Q

How can you simplify a sampling of observational research ?

A
  • Time: alternate observing and recording
  • Individual: one subject at a time
  • Event: one behavior at a time
  • Recording: taping the situation
52
Q

Naturalistic observation

A

• High external validity (compared to
laboratory experiments)
• No causal links can be established

53
Q

Which 2 designs of questionnaires do you know

A

• Open-Ended Items: more detailed, but time
consuming to analyze
• Closed-Ended Items: easy to analyze, but
loss of details

54
Q

What do you know about nonresponse bias of a survey?

A

• Solutions: Several contacts (prenotice letter,
thank you postcard, replacement
questionnaire), small reward
• Non-factors (things that do not help to get participants): length, personalization, anonymity, deadline

55
Q

What happens by the social desirability effect?

A

• People tend to alter answers if they feel
evaluated/watched
• Less of a problem in online-surveys

56
Q

When do you have high internal validity?

A

if you hold everything expect of the independent variable constant (same age, same gender,..)

57
Q

How can you control a placebo effect?

A

By adding a control group

58
Q

What do you know about regression towards the mean?

A
  • its a threat to validity
  • only occurs if you select an extremest subgroup from a larger group
  • there has to be random measurement error
  • extremely positive= upward measurement error
  • extremely negative- downward measurement error
  • you have to re-measure the extreme subgroup will very likely be less extreme and be closer to the average of the entire group
59
Q

What is the Solution for threats of internal validity?

A

adding a control group

60
Q

What defines a real experiment?

A
  • consists of minimally two groups: experimental and control group
  • participants are randomly assigned to one of the two conditions / groups
  • additional design choices affect validity
61
Q

How must the control-group be?

A

Equivalent to experimental group