Research And Program Evaluation Flashcards

(99 cards)

1
Q

What is the purpose of applied research?

A

Its conducted to advance our knowledge of how theories, skills and techniques can be used in terms of pratical application

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the most valuable type of research?

A

Experiments aimed to discover cause and effect relationships

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Whats a quasi-experiment?

A

Its when the researcher uses preexisting groups and the IV cannot be altered (ex: gender, ethnicity). Can determine cause/effect.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is internal validity?

A

Refers to whether the DVs were truly influenced by the experimental IVs or whether other factors had an impact

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Whats external validity?

A

Whether or not the experimental results can be generalized to large populations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are some threats to internal validity?

A
  • Maturation of subjects (psychological and physical changes including fatigue)
  • Instruments used to measure bx
  • Mortality (subjects withdrawing)
  • Statistical regression
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What does it mean when experiments emphasize parisomy?

A

Interpreting the results in the simplest way

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Occams Razor suggests that experimenters…

A

Interpret the results in the simplest manner

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Parisomy is equivalent to the word…

A

Parsimony

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is an “ex post facto study?”

A

Meaning “after the fact”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Whats an IV?

A

The variable the experimenter manipulates, controls, alters, or wishes to experiment with

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Whats a DV?

A

Expresses the outcome or data in regards to factors you wish to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is a control group?

A

They do not recieve the IV. Only the experimental group recieves the IV.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

If you cannot randomly assign subjects, what type of experiment would it be?

A

Quasi-experiments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

How many ppl do you need for a true experiment?

A

At least 30

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Who’s work is closely related to hypothesis testing?

A

R.A. Fisher

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Whats a null hypothesis?

A

Asserts there will not be a significant difference between the experimental group and control group (samples will stay the same)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

When does a null hypothesis take place?

A

When an IV does not affect the DV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Whats an experimental hypothesis?

A

Suggests that a difference will be evident between the control and experimental group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Whats an affirmative hypothesis?

A

Asserts that the IV has indeed caused a change

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Whats a percentile rank?

A

Its a descriptive stat that explains what percentage of the cases fell below a certain level

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Whats a between subjects design?

A

When theres different subjects for each condition. Each subject recieves only one value of the IV.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Whats a within-subject design?

A

When the same subjects are employed (also referred to as repeated measures). 2 or more values/levels are administered to each subject

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What does the letter P refer to in relation to a test of significance?

A

Probability/ level of significance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Whats a parameter?
Summarizes the characteristics of a population
29
Whats ethnographic research?
Involves research that is collected via interviews, observations and inspection of documente
30
What is the accepted probability level in social sciences?
.05 or less
31
Whats another way to refer to the level of significance?
Confidence level
32
Whats a type I error?
Alpha
33
Whats a type II error?
Beta
34
When does the type I (alpha error) occur?
When the researcher rejects the null hypothesis when its true
35
Whats a type II (beta) error?
When the researcher accepts the null when its false
36
What happens when you lower the statistical level (ex: .05 to .01)
Lowers Type I errors but raises the chance of committing type II errors
37
How do you test for significant differences between groups?
t Tests
38
How do you test for significance with more than 2 groups?
ANOVAs. They test when theres more than one level of the single IV.
39
Whats an ANCOVA?
Tests 2 or more groups while controlling for extraneous variables
40
What test do you use for two IVs?
Two way ANOVA
41
What table do you look at for ANOVAs?
Consult a table for F values
42
Whats a correlation coefficient?
Statistic that indicated the degree or magnitude of the relationship between 2 variables
43
Whats the range for correlation coefficients?
0.00 (no relationship) to 1.0 or -1.0
44
Whats a negative correlation coefficient?
Means that as one variable goes up, the other goes down
45
Whats a biserial correlation?
Indicates that one variable is continuous while the other is dichotomous
46
When is the term bivariate utilized?
When correlational data describe the nature of 2 variables
47
What does N stand for?
Number of people being studied
48
Whats a single blind study?
When participants dont know which group they are in, but the experimenter does
49
Whats a double blind study?
Both parties are unaware of groups and hypothesis
50
What are experimenter effects?
When the experimenter unconsciously communicates his or her intent or expectations to the subjects
51
Whats an ABA design?
Baseline (A) is secured, then intervention is implemented (B) then the outcome is examined via new baseline (A)
52
What designs are used when theres more than 1 target bx?
Multiple baseline designs
53
Whats the 68-95-99 rule?
In normal distribution, 68% of scores fall in the 1st SD of the mean, 95% within 2 SDs of the mean, 99.7% within 3 SDs
54
When do you use factorial designs?
When several experimental variables are investigated (2 or more IVs) sometimes the IVs are referred to as levels.
55
What will be the highest point in a distribution, regardless of shape, when displayed graphically?
The mode
56
What would a graphic look like if everyone did bad on a test?
Scores would fall on the left/low side of the distribution. Graphically the tail would point to right or positive side
57
What do graphs look like if everyone scores really high?
Scores would fall on the right side of the curve, which would give you a long tail that points to the left, indicative of a negative skew
58
How can you tell if a distribution is positively or negatively skewed?
The tail...tails on the right are positive, tails on the left are negative
59
Whats the benefit of standard scores vs raw data?
Standard scores allow you to analyze data in relation to the properties of a normal bell shaped curve
60
What type of distribution can be graphically displayed like a bar graph?
A histogram
61
Whats the mesokurtic?
Peak of the curve
62
What goes on the x axis?
The IV scores
63
What is the x axis also known as?
The abscissa
64
What goes on the Y axis?
The frequency of the DVs
65
Whats the Y axis also known as?
The ordinate
66
What's a scattergram (aka scatterplot)?
A pictorial diagram or graph of 2 variables being correlated
67
What's the John Henry Effect?
A threat to the internal validity of an experiment that occurs when subjects strive to prove that an experimental treatment that could threaten their livelihood really isn't all that effective
68
What is the variance?
A measure of dispersion of scores around some measure of central tendency. It is the standard deviation squared.
69
How do you calculate the standard deviation?
It is the square root of the variance
70
What are Z-scores?
They are the same as standard deviations, they are sometimes called standard scores
71
What are T scores?
T scores have a mean of 50 with every 10 points landing at a standard deviation above or below the mean
72
What does platykurtic refer to?
The peakedness of a frequency distribution
73
What does a platykurtic distribution look like?
It is flatter and more spread out than the normal curve
74
What does a leptokurtic distribution look like?
It is when the curve is very tall, thin and peaked (distribution leaps tall buildings)
75
What is a nominal scale?
- It is qualitative - Used to distinguish logically separated groups - Classifies, names, labels and identifies by group - No order, or zero point
76
What is an ordinal scale?
- Rank orders variables | - Relative distance between elements is not always equal
77
What is an interval scale?
- Has numbers scaled at equal distances but has no absolute zero point - You can add or subtract - Most tests used in school fall into this category
78
What's an example of an interval scale?
IQ tests
79
What's a ratio scale?
- An interval scale with a true zero point | - Can add, subtract, multiply or divide
80
What are some examples of a ratio scale?
- Time - Height - Weight - Temperature
81
What does 2X3 refer to?
- Factorial notation - First variable has 2 levels (ex: boy, girl) - Second independent variable has 3 levels
82
Whats the Rosenthal Effect?
The experimenter expectancy effect. Occurs when the experimenters beliefs about the individual may cause the individual to be treated in a special way so the individual begins to fill the experimenters expectations.
83
What is the acceptable return rate for questionnaire surveys?
50-75% (with a sample size of at least 100)
84
What are some survey problems?
- Low return rates - Lack of random subjects - Not representative of the population - Poor construction of the instrument
85
Whats the Hawthorne Effect?
When someones performance improves merely bc they are apart of an experiment. The subject reacts to the presence of the investigator.
86
Whats the Halo Effect?
The Halo effect occurs when a trait which is not being evaluated (ex: attractiveness) influences a researchers rating on another trait
87
Whats a trend analysis?
- Refers to a statistical procedure performed at different times to see if a trend is evident - Describes an application of the ANOVA to see if performance on one variable mimics the same trend on a second variable
88
What is statistical regression?
Predicts that very high and very low scores will move toward the mean if a test is administered again
89
What is a quartile?
Refers to the points that divide a distribution into 4ths
90
What is a cross-sectional study?
Clients are assessed at one point in time
91
Whats ipsative mean?
Implies a within person analysis rather than a normative analysis between individuals (looking at an individuals own patterns)
92
What's a chi-square used for?
Its used to determine whether an obtained distribution differs significantly from an expected distribution. Must have mutually exclusive categories.
93
What is random sampling?
Each subject has the same probability of being selected and the selection of one subject does not affect the selection of another
94
What is stratified sampling?
When you select based on special characteristics which need to be represented (ex: race, gender, educational degree, age)
95
What is quota sampling?
A type of stratified sampling where a specific number of cases are needed for each strata
96
What is a cluster sample?
Uses an existing sample or cluster of people or selects a portion of an overall sample (ex: high school seniors)
97
What is systematic sampling?
With this approach you take every nth person
98
What's an operational definition?
It outlines a procedure so that other researchers can attempt to replicate the experimental procedure
99
What is a matched design?
The subjects are "matched" in regard to any variable that could be "correlated" with the DV
100
What is inductive logic/reasoning?
Research that goes from specific to generalization
101
What is deductive logic/reasoning?
Reduces the general to the specific
102
What is the standard error of measurement (SEM)?
Tells the counselor what would most likely occur if the same individual took the same test again