Ch. 9 - Research & Program Evaluation Flashcards
(53 cards)
1
Q
Internal validity
A
- refers to whether the DVs were truly influenced by the IVs or whether other factors had an impact
2
Q
External validity
A
- refers to whether the experimental research results can be generalized to larger populations
3
Q
Experiments emphsaize parsimony, which means
A
- interpreting the results in the simplest ways
4
Q
Occam’s Razor suggests
A
- that experimenters interpret the results in the simplest manner
5
Q
Flaws in research are often called
A
- bubbles (think air bubbles stuck under a sticker)
6
Q
An experiment is confounded when…
A
- undesirable variables are not kept out of the experiment
- AKA contaminating variable
7
Q
Basic research vs. applied research
A
Basic research: conducted to advance our understanding of theory
Applied research AKA action research: conducted to advance our knowledge of how theories, skills, and techniques can be used in terms of practical application
8
Q
Causal-comparative design
A
- a true experiment that lacks randomly assigned groups
- data can be analyzed with a test of significance (i.e., t-test or ANOVA) just like experiement
9
Q
If you can’t randomly assign subjects into groups…
A
- considered quasi-experimental
10
Q
Hypothesis testing is related to work of
A
RA Fisher
11
Q
Null hypothesis
A
- suggests that there will not be a significant difference between groups
- the IV does not affect the DV
12
Q
Alternative hypothesis
A
- suggests that there will be a significant difference between groups
- IV does affect DV
13
Q
Percentage vs. percentile
A
Percentage: Raw score
Percentile: descriptive statistic that thells what percentage of cases fell below a certain level
14
Q
p = .05 means…
A
- differences really do exist
- will obtain samee results 95/100 times
- 5% error factor
15
Q
Type I error
A
- When you reject the null when it is true
- lowering significance levels lowers type I errors
- AKA alpha error
16
Q
Type II error
A
- When you accept the null when it is false
- AKA beta error
- lowering significance raises the risk of type II error
17
Q
If researcher changes significance level from .05 to .001
A
- type I error decrease, type II error increase
18
Q
t-test
A
- used to compare two groups with single IV
19
Q
one-way ANOVA
A
- used when there is more than one level of a single IV
20
Q
two-way ANOVA
A
- used with 2 IVs
- more than 1 IV = factorial design
21
Q
Correlation coefficient
A
- indicates degree or magnitude of relationship between two variables
- degree of linear relationship
22
Q
N = 1
A
- intensive experimental design
- case study
- popular with behaviorists who seek overt behavioral changes
- AKA idiographic studies or single-subject designs
23
Q
Normal distribution stats
A
- 68% fall within +- 1 SD
- 95% fall within +- 2 SD
- 99.7% fall within +- 3 SD
24
Q
Regardless of the shape the _ will always be the high point when a distribution is displayed graphically
A
- mode
25
X axis used to
Y axis used to
- plot the IV (horizontal)
- plot the DV (vertical)
26
Range
- highest - lowerst score or highest - lowest score + 1
- increases with sample size
27
Z-scores
- same as SDs
- AKA standard scores
28
Platykurtic distribution
- looks like the upper half of a hot dog lying on its side
- flat and spread out
29
Kurtosis =
- refers to the peakedness of a frequency distribution
30
Leptokurtic =
- tall and thin distribution
31
Stanine scores
- divide the distribution into nine equal intervals with stanine 1 as the lowerest ninth and 9 as the highest ninth
32
Nominal
Ordinal
Interval
Ratio
- Qualitative; distinguish groups; no true 0; does not indicate order
- Rank order; relative distance not always equal; relative placement or standing; does not delineate absolute differences
- Interval: numbers scaled at equal distances; no absolute 0; can add and subtract, but can't multiply or divide; IQ tests are interval
- Ratio: Interval scale with true 0; addition, subtraction, multiplication, division possible; most psychological attributes cannot be measured on ratio scale
33
Nocebo
Placebo
- has a negative effect
- i.e., when a doctor comments one only has 6 weeks to live
- placebo has possitive effect
34
Hawthorne effect
- if subjects know they are a part of an experiment, their performance sometimes improves
- reacting to the presence of the investigation
- AKA observer effect
35
Rosenthal effect
- AKA experimenter expectancy effect
- the experimenter's beliefs about the individual may cause the individual to be treated in a special way so that the individual begins to fulfill the experimenter's expectations
36
Halo effect
- when a trait which is not being evaluated influences a researcher's rating on another trait (i.e., attractiveness and counseling)
37
Statistical regression
- predicts that very high and very low scores will move toward the mean if a test is administered again
38
Ipsative implies
- within-person analysis (i.e., was you jog faster today than yesterday) rather than a normative analysis between individuals
39
Demand characteristics
- can confound an experiment
- relates to any bit of knowledge - correct or incorrect - that the subject in an experiment is aware of that can influence their behavior
40
Post-hoc tests
- Duncan's multiple-range
- Tuey's
- Scheffe
- further discriminates between the ANOVA groups
41
Pygmalion effect
- Rosenthal effect and experiment becomes a self-fulfilling prophecy
42
Ahistoric therapy
- any therapy that focuses on the here and now
43
Statified sampling
- When a special characteristic needs to be represented in the sample, such as race, gender, etc.
44
Snowball sampling
- when subjects invite others to the study
45
Sampling error
- small samples do not mimic the population
46
Systematic sampling
- picking a number between 1 and 10 and then picking every nth person
47
Operational definition
- outlines a procedure
- operationally define procedures so one can replicate the procedure
48
Axiom
- universally accepted idea needing no additional proof
49
Non-parametric measures
- Mann-Whitney U test
- Wilcoxon signed-rank test for matched pairs
- Soloman and the Kruskal-Wallis H test
50
Matched design
- subjects are matched in regard to any variable that could be correlated with the DV, which is really the post-experimental performance
- unmatched groups are known as independent groups
51
Inductive logic or reasoning
Deductive logic or reasoning
- the research goes from specific to generalization
- research goes from general to specific
52
Standard error of measurement (SEM)
- tells what would most likely occur if the same individual took the same test again
53
