Task 3 Flashcards

1
Q

Dependent variable

A
• “Outcome variable”
• Measurable
• Influenced by change in condition
Example:
Is reaction time decreased by drinking coffee?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Independent variable

A

• “Condition”
• Directly altered by experimenter
Example:
Is reaction time decreased by drinking coffee (eg 1cup, 2cups, 3cups)?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Which question should you ask while thinking about the reliability of your experiment?

A

How similar would the result be if the experiment is repeated?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Which question should you ask by thinking about the validity of your experiment?

A

Does the measure actually measure what the researcher intends to measure?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Name 3 sources of variability

A
  1. precision of measure: variability due to imperfections in measuring tool
  2. Interrater Reliability: variability due to differences in judgments of observer
  3. Marion of error: variability due to individual differences within a sample
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Test-retest reliability

A
  • Similarity of result if test is repeated

* Best for assessing stable characteristics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Name 3 problems of test-retest reliability

A
  • Remembering of questions
  • Longer interval between tests needed
  • Change in participant between tests
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

explain parallel/ alternate-forms reliability

A

-equivalent questions are asked
- can be administered after each other
2 tests with a bigger time difference

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Name 2 problems of parallel / alternate-forms reliability

A

• Equivalence of questions
• Change in participant between tests
one bigger test at one time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Explain split-half reliability

A

• One bigger test is administered
• Equivalent questions are repeated
• Results of equivalent questions are scored
individually

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the problem of Split-half reliability?

A

Equivalence of questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the accuracy of measure by validity?

A
  • Comparing to a standard

* Biased if scores differ on average from standard

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What do you know about the observer bias? What is the solution?

A
  • May arise of researcher has a desired outcome in mind

* Solution: Blind observers (Researcher do not know condition of participant during experimentation)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Name 4 types of validity

A
  1. Face Validity
  2. Content Validity
  3. Criterion-related Validity
  4. Construct Validity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Face Validity

A

test seems to test what it is explained to test. Perceived legitimacy of the test can influence participants’ attitude

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Content Validity

A

test actually tests what it is designed to test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Criterion-Related Validity

A

Compare your results with someone else
• Concurrent: agreement with “golden standard” (right now)
• Predictive: successful prediction of future behavior

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Construct Validity

A
  • Convergent (similar to instruments measuring the same construct) you compare to a other test from the same area and want to get similar results
  • Divergent (not similar to measure of a different construct) you compare to a test of another area and want to have different results
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is internal validity?

A
  • Ability of your research design to adequately test your hypothesis
  • Showing that the variation in the independent variable caused the observed effect
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Name 2 threats (Bedrohungen) of internal validity?

A

• Rival hypothesis: another alternative variable might explain the effect
Alternative explanations
• Confounding: combination of variables explains the effect and one cannot separate the effect of these variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Name 8 sources of confounding (Störeinfluss)

A
  1. History: specific events other than treatment occur between observations (eg. 9/11)
  2. Maturation: fatigue or aging change performance over time
  3. Instrumentation: instrument calibration changes and confounds the effect
  4. Statistical regression: subjects selected for treatment on the basis of their extreme scores tend to move closer to the mean when retesting
  5. Biased subject selection: nonrandom
  6. Experimental mortality / attrition: dropouts (is mainly a problem if its a random dropout (experiment gets to heavy pat. drops out)
  7. Demand characteristics: participants know
    the purpose of the study and behave differently
  8. Placebo effect: participants get better because they believe that they receive an effective treatment
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is external validity?

A

ability of your research design to generalize the results beyond the research setting to real world situations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Name 4 threats of external validity

A
  1. reactive testing
  2. interactions between participant selection biases and independent variable
  3. reactive effects of experimental arrangements
  4. multiple treatment interference
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

reactive testing

A

pretests may affect reaction to the experimental test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Interactions between participant selection biases and the independent variable
participants that signed up voluntarily could be more extroverted, this could affect your study if you are measuring for example personality types
26
Reactive effects of experimental arrangements
artificial experimental setting and knowledge of being a study-participant change results
27
Multiple treatment interference
If participants are exposed to multiple treatments and later treatments are affected by former ones
28
Why taken samples?
To make general statements about the population, but it is only possible to ask a limited number of people
29
What is important to keep in mind by choosing a sample?
* How many is enough | * Is my sample biased
30
What is a simple random sample?
A group of people is randomly chosen from the whole population • Solves problem of bias • In reality hard to manage to get a truly random sample
31
Population
all individuals that are there (usually too big to test every individual)
32
sample
a smaller group chosen from big group
33
generalization
applying findings from a sample to a large population
34
representative sample
matches characteristics of the population
35
Non-representative sample
biased
36
Random sample
identify the population and then draw a random sample from it
37
Nonrandom sample
choosing special individuals/ subject pools Only university students Internet research Animal subjects (same breed, sex etc.)
38
Name 5 kinds of sampling
1. simple random sample 2. stratified sampling 3. proportionate sampling 4. systematic sampling 5. cluster sampling
39
simple random sample
randomly selecting a number of people
40
stratified sampling
dividing population into segments (=strata), then selecting a sample of equal size from each segment
41
proportionate sampling
proportions of people in the population are equal to proportions in your sample
42
systematic sampling
every Kth element after a random start
43
cluster sampling
naturally occurring groups of subjects and randomly selecting certain clusters
44
Multistage sampling
selecting individuals from those clusters
45
Laboratory research
* Take individuals into laboratory setting * Control variables * More ethical * High internal validity and low external validity
46
Field research
• In participants natural environment • Lesser control of confounding variables • Results can easily be generalized to the real world • High external validity and low internal validity
47
Which options do you have for your research setting?
laboratory research or field research
48
Which negative effects can volunteerism of a participant have?
Volunteerism lowering internal validity change in outcome not because of condition, but because participants want to “help” the researcher Volunteerism lowering external validity because subjects that volunteer often differ in specific ways from the average population
49
Which 2 types of non-experimental research do you know?
observational research | surveys
50
Name 3 method of quantification for observational research
* Frequency * Duration * Interval
51
How can you simplify a sampling of observational research ?
* Time: alternate observing and recording * Individual: one subject at a time * Event: one behavior at a time * Recording: taping the situation
52
Naturalistic observation
• High external validity (compared to laboratory experiments) • No causal links can be established
53
Which 2 designs of questionnaires do you know
• Open-Ended Items: more detailed, but time consuming to analyze • Closed-Ended Items: easy to analyze, but loss of details
54
What do you know about nonresponse bias of a survey?
• Solutions: Several contacts (prenotice letter, thank you postcard, replacement questionnaire), small reward • Non-factors (things that do not help to get participants): length, personalization, anonymity, deadline
55
What happens by the social desirability effect?
• People tend to alter answers if they feel evaluated/watched • Less of a problem in online-surveys
56
When do you have high internal validity?
if you hold everything expect of the independent variable constant (same age, same gender,..)
57
How can you control a placebo effect?
By adding a control group
58
What do you know about regression towards the mean?
- its a threat to validity - only occurs if you select an extremest subgroup from a larger group - there has to be random measurement error - extremely positive= upward measurement error - extremely negative- downward measurement error - you have to re-measure the extreme subgroup will very likely be less extreme and be closer to the average of the entire group
59
What is the Solution for threats of internal validity?
adding a control group
60
What defines a real experiment?
- consists of minimally two groups: experimental and control group - participants are randomly assigned to one of the two conditions / groups - additional design choices affect validity
61
How must the control-group be?
Equivalent to experimental group