Research and Program Evaluation Flashcards
1
Q
Research question
A
- relational, descriptive, causal
2
Q
Quasi-experiment
A
- the researcher uses preexisting groups, hence the independent variable (IV) cannot be altered (example gender, age, etc). in this type of experiment, one cannot say with any degree of statistical confidence that the IV caused the dependent variable (DV)
3
Q
Internal Validity
A
- whether the DVs were truly influenced by the experimental IVs
4
Q
Threats to interval validity
A
- maturation of subjects, mortality (subject withdrawing), instruments used, statistical regression
5
Q
External Validity
A
- whether the results can be generalized to a large population. e.g if the results of a study only apply to the population in the study then the external validity is low.
6
Q
Chi-square
A
- non-parametric statistical measure that tests whether a distribution differs significantly from an expected theoretical distribution
- it’s used to determine whether an obtained distribution differs significantly from an expected distribution
7
Q
Non-parametric
A
- only able to make a few assumptions
8
Q
Factor analysis
A
- data reduction
9
Q
Parsimony
A
- interpreting the results in the simplest way
10
Q
Occam’s Razor
A
- suggests interpreting the results in the simplest manner
11
Q
Bubbles
A
- flaws in research
12
Q
Journal of Counseling Psych
A
- publishes more counseling research articles than any other periodical in the field
13
Q
Confounding
A
- Occurs when an undesirable variable are not kept out of the experiment, flaw the experiment, all correlational research is said to be confounded
14
Q
Basic Research
A
- conducted to advance our understanding of theory
15
Q
Applied Research
A
- conducted to advance our knowledge of how theories, skills, and techniques can be used in terms of practical application.
16
Q
IV
A
- variable research manipulates, controls
17
Q
DV
A
- expresses the outcome of the data
18
Q
Control group
A
- does not receive the IV (treatment)
19
Q
Experimental group
A
- receives the IV
20
Q
Ethics:
A
- subjects are informed of any risks
- negative after effects are removed
- allowed to withdraw at any time
- confidentiality of subjects are protected
- results reported in an accurate format
- Only use techniques you are trained in
21
Q
30 people
A
- to conduct a true experiment
22
Q
100 people
A
- for a survey
23
Q
Organismic variable
A
- variable researchers cannot control yet exist. E.g: height, weight, gender, natural variable
24
Q
R.A Fisher
A
- Hypothesis testing
- determining if the null hypothesis is to be accepted or rejected
25
Hypothesis
- educated guess
26
Research hypothesis
- testable expected relationship between two or more variables
27
Null hypothesis
- suggest that there will not be a significant difference between the experimental group and the control group
28
Meta-analysis
- study that analyzes the findings of numerous studies
29
Alternative hypothesis
- asserts that IV causes a change
30
Inferential statistical
- provide information about the population
31
Descriptive Analysis
- merely describe the data
32
T-test
- compares 2 groups
| - used to ascertain whether 2 sample means are significantly different
33
two-tailed T-test
- non-directional experimental hypothesis
34
One-tailed T-test
- directional experimental hypothesis, the hypothesis specifies that one average mean is larger than the other
35
Between-subjects design
- when a research study uses different subjects for each condition, each subject receives only 1 values of the IV, exploring the effects of treatment between two groups.
36
Within-subject design
- same subjects are employed, 2 or more values/levels of the IV are administered to each subject, assess changes that occur as they experience the intervention
37
Parameter
- summarizes a characteristic of a population
38
Split-Plot design
- assess a general intervention on whole plot and other treatments to subplots within the whole
39
Ethnographic research
- involves information collected via interviews, observations, and the inspection of documents
40
P level
- level of significance/ level of confidence
- .05 on 5% chance the different between control and experimental group is due to chance factors
- .01
- .001 rules out chance levels - high confidence of less error
41
Type I Error (alpha)
- researchers rejects the null when it is true
| - raising sample sizes lowers type 1 and 2 errors
42
Type II Error (beta)
- researchers accept the null when it is false
| - raising sample sizes lowers type 1 and 2 errors
43
Anova
- more than 2 groups
| - a one-way analysis of variance is used for testing one independent variable
44
Ancova
- analysis of covariance which tests 2 or more groups for extreme variable
45
Manova
- study has more than two DV
46
2 way Anova
- requires 2 IVs
47
Mancova
- involves multiple dependent variables
48
Correlation coefficient
- association between two variables, how a change in one is to the change in another correlation does not imply causation
49
Positive correlation
- both variable change in the same direction
50
Negative correlation
- variable are inversely associated
51
Biserial correlation
- 1 variable is continuous and the other is dichotomous
52
Hawthorne Effect
- reacting to the presence of a research
- affects participants responses
- if the subject knows they are given a particular attention they respond to that attention
53
Rosenthal Effect
- experimenter's belief about the individual may cause the individual to be treated in a special way so that the individual begins to fulfill the experimenter's expectations
54
Observer bias
- when the researcher has perceptions regarding the research that are inaccurate
55
Hallo Effect
- occurs when a trait which is not being evaluated influence a researcher's rating on another trait
56
Trend Analysis
- a statistical procedure performed at different times to see if a trend is evident
57
Analysis of Covariances
- controls for sample differences which exist, helps, to remove confounding variable, it statistically eliminates
58
Statistical Regression
- threats to internal validity, predicts that very high and very low scored will move toward the mean it a test is administered again
59
Cross-sectional
- clients are assessed at one point in time
60
Longitudinal study
- the same people are studied over a period of time
61
Summative Evaluation
- is used to assess a final product and attempts to ascertain how well the goal has been met
62
Formative
- is going and conducted while the program is underway (progress evaluation)
63
Counterbalancing
- switching the order in which stimuli are presented to a subjected
64
Cluster sampling
- used when a list of the entire population cannot be found and solved this problem by using as existing sample or cluster of the population as a sample
65
Horizontal sampling
- occurs when a researcher subjects from a single socioeconomic group
66
Vertical sampling
- occurs when people from 2 or more socioeconomic classes are utilized
67
Systematic sampling
- take every nth person
68
Parametric test
- the assumption is that the scores are normally distributed
69
Non-parametric sampling
- the curve is not a normal distribution
70
independent groups
- unmatched or uncorrelated groups
71
organismic variable
cannot be manipulated like hight and weight
72
Null hypothesis
- asserts that the samples will not change
| - IV does not affect the DV
73
test of significance
- determines whether a difference in the group scores is significant
- compare control group to an experimental group
74
social sciences
- accept probability level of .05 or less
75
Alpha
- Error I
76
Alpha
- Error I
| - reject the null hypothesis when true
77
Beta
- Error II
| - accept the null when false
78
.01 to .001
- lowest type I error, however, increases type error II beta
79
Nominal
- qualitative
- the most elementary
- classifies names, labels, or identifies by group
- has no true zero
- does not indicate order
80
Positive correlation
- both values go up
81
negative correlation
- one value goes up and the other down
82
behaviorist often utilize N =1
- take a baseline measure
83
Single blind study
- the subject does not know whether they are part of the control of the experimental group
84
Double-blind study
- when the subject is unaware of the status
| - neither the subject not the research know who belongs to what group
85
Pearson r
- Interval and ratio
86
Spearman rho
- ordinal data
87
68-95-97.5
- SD: 1 -2-3
| - ALL SCORES will fall between 3 SD s pf the mean
88
modal score
- the highest point of the curve
89
mode
- the point of maximum concentration
| - highest point of distribution
90
range
- it's the distance btw the largest and smallest number
91
mean
- average
92
median
- it's the best for skewed distributions and extreme scores
93
Raw score
- means nothing
94
Transformed score or standard score
- such as percentile ranks, t-scores, z-scores, stanines, or standard deviation over a raw score is that standard score allows you to analyze the data in relation to the properties of the normal bell-shaped curve
95
X axis
- it's also known as the abscissa
| - plot IV scores
96
Y axis
- it's also known as the ordinate
| - plot the DV
97
Z Score
- the same as a standard deviation
| - also called a standard score
98
T score
- mean = 50
| - SD = 10
99
NOIR
- NOMINAL
- ORDINAL
- INTERVAL
- RATIO
100
Ordinal
- provides relative placement or standing
| = order
101
Interval
- used for tests in schools
| - no absolute zero
102
Ratio
- has a true zero point
- most psychological attributes cannot be measured on a ratio scale
- highest level of measurement
- time, height, weight, temperature volume, and distance meet the reqs for this measurement
103
Halo effect
- occurs when a trait that's not being evaluated influences a researcher's rating on another trait (e.g attractiveness or how much a person is liked)
104
Analysis of covariance techniques
- it helps to eliminate difference between groups
105
cohort study
- study with subjects that share same characteristics
106
Standardized tests
- always have formal procedures for test administration and scoring
- testing format, materials, and scoring process are consistent
107
cross-sectional method
- done at a single point in time and preferably in time consumption
108
Ipsative vs Normative
- ipsative implies a within-person analysis rather than a normative analysis between individuals
109
Duncan's multiple range, Tukey's, or Scheffe's test
- to test significant differences between group means
110
Casual comparative research
- groups were not randomly assigned and the researcher did not control the IV
111
systematic sampling
- choosing every TH person
112
Operational definition
- outlines a procedure
| - operationally define procedures so that other researchers can attempt to replicate
113
parametric tests
- normally distributed
114
nonparametric test
- not a normally distributed
115
Matched design
- subjects are matched in regard to any variable that could be correlated with the DV
116
U Mann-Whitney
- uncorrelated/unmatched
- independent groups
- two groups
117
Wilcoxon
- it's an alternative to the t test when parametric precepts cannot be accepted
- can be used for two groups
118
deductive
- reduces the general to specific
119
inductive
- goes from specific to a generalization
120
Standard Error of Measurement (SEM)
- tells the counselor what would most likely occur if the same individual took the same test again
121
Likert scale
- includes choices and categories
