Research and Program Evaluation

Question 1

True variance/coefficient of determination

Answer 1

Obtained by squaring the correlation
(number between 0 and 1 that measures how well a statistical model predicts an outcome.)

Question 2

Construct Validity

Answer 2

When a test successfully measures a hypothetical construct.

Question 3

What is most likely to threaten internal and external validity?

Answer 3

Selection of subjects

Question 4

Ordinal scale data

Answer 4

Involves rankings or order of people/objects based on a particular attribute

ex: a horse categorized as a second-place winner in a race

Question 5

Interval scale data

Answer 5

Calculated with the assumption that each number represents a point that is an equal distance from the point adjacent to it but NO zero point

can add and subtract but cannot multiply or divide

Question 6

Ratio scale data

Answer 6

Have an absolute zero. (ex. weight)

Question 7

Scatter plot

Answer 7

Depicts pairs of scores

Easy to see patterns (but broad generalization)

Instantly see positive or negative relationship between the data and if relationship is strong or weak

Question 8

Purposeful sampling

Answer 8

NOT used to generalize the findings to the population (not random)

Question 9

t-score

Answer 9

Mean of 50 and standard deviation of 10

Question 10

Convergent validity

Answer 10

Convergent validity occurs when the construct being studied correlates highly with other constructs.

Question 11

Content validity

Answer 11

The extent to which a measure represents all facts of a given social concept.

(ex. the condition of a sample from a larger population being a true representation of that larger population)

Question 12

Ex Post Facto Study

Answer 12

Investigates possible relationships among variables after the fact.

Focus is on what has already occurred.

Also called casual comparative research.

Question 13

Single blind vs double blind experiment

Answer 13

Single blind = subjects do not know whether they are in the placebo or experimental group

Double blind= neither the participants nor the experimenter know which subjects are in the experimental and placebo groups

Question 14

internal validity
vs
external validity

Answer 14

internal= whether dependent variables were truly influenced by the experimental independent variables OR if other factors had an impact

external= whether the experimental research results can be generalized to larger populations

Question 15

parsimony

Answer 15

interpreting the results in the simplest way

Question 16

a test of significance

Answer 16

needed to compare a control group to the experimental group

Question 17

p= probability

Answer 17

accepted level = .05 or less

Question 18

Type I (ALPHA) error
vs
Type II (BETA) error

Answer 18

alpha error (I) = researcher rejects the null hypothesis when it is true

beta error (II) = researcher accepts null hypothesis when it is false

Question 18

increased sample size

Answer 18

will lower the risk of chance/error factors

Question 18

t-test

Answer 18

used to test for significant differences between groups

Question 19

ANOVA

Answer 19

one-way analysis of variance is used when there is more than one level of single IV

ex: 1rst group receives no assertiveness training
2nd group receives 4 sessions of training
3rd group receives 6 sessions of training

with two IV would need a two way ANOVA or MANOVA

Question 20

correlation coefficient

Answer 20

when a researcher uses correlation then there is no direct manipulation of the IV- nothing is manipulated just measured

a statistic that indicates the degree or magnitude of relationship between two variables

often abbreviated to lower-case r

a positive correlation is NOT a stronger relationship than a negative one (a - only indicates the fact that as one variable goes up the other goes down)

correlation does not mean casual

Question 21

mode

Answer 21

most frequently occurring score and the least important measure of central tendency

in a basic curve the point of maximum concentration

regardless of the shape, will always be the high point when a distribution is displayed graphically BECAUSE it is the point where the most frequently occurring score falls

Question 22

factorial experiment

Answer 22

used if a researcher wants to ferret out the effects of more than one IV

several experimental variables are investigated and interactions can be noted

Question 23

bar graph is also called a….

Answer 23

histogram

Question 24

x axis

Answer 24

used to plot the IV scores

also called the abscissa

a horizontal line is drawn nuder a frequency distribution

horizontal axis

Question 25

y axis

Answer 25

also called the ordinate

used to plot the frequency of the DV

Question 26

nominal scale

Answer 26

qualitative

simplest type of scale

used to distinguish logically separated groups

a DSM diagnostic category

no true zero point and does not indicate order

Question 27

Hawthorne effect

Answer 27

if subjects know they are part of an experiment or if they are given more attention because of the experiment their performance sometimes improves

Question 28

Rosenthal effect

Answer 28

experimenter expectancy effect

Question 29

analysis of covariance technique

Answer 29

controls for sample differences which exist

helps remove confounding extraneous variables

statistically eliminates differences in average values influenced by covariates

Question 30

demand characteristics

Answer 30

relates to any bit of knowledge (correct or incorrect) that the subject in an experiment is aware of that can influence their behavior

Question 31

ERIC

Answer 31

educational resources information center