Midterm 2

Question 1

Interrater Reliability

Answer 1

Is there consistency from rater to rater
- cohen’s kappa

Question 2

Alternative (parallel form) reliability

Answer 2

Is there consistency between forms of the test?
- correlation coefficient

Question 3

Inter-item (internal consistency) reliability

Answer 3

Consistency between individual items and the total score?
- cronbach’s alpha

Question 4

Test-retest reliability

Answer 4

Consistency between scores on tests given in two separate occasions?
- correlation coefficient

Question 5

Representative reliability

Answer 5

Is the measure consistent across sub populations or groups of people?
- no stat test

Question 6

Face validity

Answer 6

do the items on the scale appear to measure what you say they do?
panel of experts establish it

Question 7

Content validity

Answer 7

Is the full content covered?

Question 8

Criterion validity

Answer 8

How does the measure relate to an already known standard?
- Concurrent: correlate with existing measure of the construct
- Predictive: correlate with other traits that would be associated with what you are trying to measure

Question 9

Construct validity

Answer 9

How well does the operational definition assess the underlying theoretical construct?
- Discriminative: does the measure differentiate between groups we’d expect to score differently?
- Convergent: do multiple measures of the same construct hang together or operate in consistent ways?

Question 10

Probability Sample

Answer 10

RANDOM generalizable

Question 11

Non-Probability Sample

Answer 11

Not random, not generalizable

Question 12

simple random sample

Answer 12

totally random, computer generator

Question 13

systematic sample

Answer 13

every Kth element, random starting point

Question 14

stratified sample

Answer 14

population put into subgroups and then randomly selected from each group

Question 15

cluster sample

Answer 15

researcher obtains a list of clusters not individuals, clusters are randomly sampled

Question 16

convenience sample

Answer 16

whoever is willing to

Question 17

purposive sampling

Answer 17

sample is selected from predetermined criteria

Question 18

snowball sample

Answer 18

ask for referrals

Question 19

quota sample

Answer 19

try and get a sample that resembles the population (you just go convenience until you meet that criteria)

Question 20

distribution of sample means

Answer 20

if we take a sample enough time, the means should form a normal curve

Question 21

standard error

Answer 21

an estimate of the deviation of a summarizing measure from the true population parameter

Question 22

margin of error

Answer 22

a value that tells us how close to truth the estimate is

Question 23

purposes of descriptive research

Answer 23

1. exploration - curiosity
2. description - current state
3. explanation - why/how
4. feasibility or complexity

Question 24

survey research

Answer 24

• interviews
• questionnaires
  fairly inexpensive, anonymous, far reaching

Question 25

correlational

Answer 25

1. cross sectional - group differences at a single point in time
2. longitudinal - assess changes over time for one group

Question 26

longitudinal studies

Answer 26

• trend: changes in population over time
• cohort: study people over time w common characteristic (repeated cross sectional, not necessarily the same people)
• panel: follow same group of people over time

Question 27

observational research

Answer 27

1. naturalistic - continuous, take notes about everything going on, no preset operational definitions
2. systematic- behavior checklist or time sampling

Question 28

experimental

Answer 28

• pretest, treatment, posttest, control group, random assignment

Question 29

one shot

Answer 29

treatment, posttest

Question 30

one shot pretest-posttest

Answer 30

pretest, treatment, posttest

Question 31

pretest-posttest control group

Answer 31

random: pretest, treatment, posttest
vs.
random: pretest, posttest

Question 32

posttest only

Answer 32

random: treatment, posttest
vs.
random: posttest

Question 33

internal validity

Answer 33

can confidently attribute results to the IV (no lurking/confounding variables)

Question 34

external validity

Answer 34

can confidently generalize results to other people

Question 35

threats to internal validity - selection bias

Answer 35

other things in common in sample

Question 36

threats to internal validity - history

Answer 36

Other confounding factors occurring simultaneously

Question 37

threats to internal validity - maturation

Answer 37

People change over time

Question 38

threats to internal validity - testing

Answer 38

People get better when tests are repeated

Question 39

threats to internal validity - instrumentation

Answer 39

Changes to scoring method

Question 40

threats to internal validity - mortality

Answer 40

attrition, people leaving studies who have similar attributes

Question 41

threats to internal validity - statistical regression

Answer 41

regression toward the mean, bias only includes the most extreme results (ceiling/floor)

Question 42

threats to internal validity - diffusion of treatment/contamination

Answer 42

participants in groups communicate

Question 43

threats to internal and external validity - experimenter expectancy

Answer 43

expectancy affect, experimenter behavior leads subject behavior

Question 44

threats to external validity - multiple treatment interference

Answer 44

Participants receive additional treatments not part of the study

Question 45

threats to external validity - Reactive Arrangements (Hawthorne Effect)

Answer 45

Subjects are aware they are being studied

Question 46

threats to external validity - pretest sensitization

Answer 46

Pretest changes the nature of the treatment, influences performance on posttest