Quiz 4

Question 1

6 test Validity

Answer 1

Face, Content, Predictive, Concurrent, Convergent, Discriminant

Question 2

Internal/External Validity

Answer 2

Internal: the extent to which an experiment accurately measures what it intended to measure (depends on how well the experiment is designed and controlled for relevant extraneous factors

External: an experiment can be generalized to a larger content (good study design)

Question 3

Threats to Internal Validity

Answer 3

History, Maturation, Reactive Pretest, Instrumentation, Statistical Regression, Differential subject selection, Attrition, Interaction of factors

Question 4

Generalizability

Answer 4

Threats to Generalization are threats to external validity! Do patterns from the sample apply to the population?
- Subject selection (does it accurately represent the population)
- Interactive pretest (when a reactive pretest interacts with the dependent variable)
- Reactive Arrangements (effect seen is specific to experimental context; Hawthorne effect: subjects’ behavior changes because they know they are being studied/observation)
- multiple treatment interference

Question 5

Face

Answer 5

Does the test look and sound like it accurately measures the construct (ex: title)

Question 6

Content

Answer 6

Does the test cover the relevant domains of the construct

Question 7

Predictive

Answer 7

does the test predict things it should predict (ex: do lower scores correlate with lower reading proficiency?)

Question 8

Concurrent

Answer 8

Does the test discriminate between relevant groups (ex: are scores significantly lower for kids with reading delays vs those with typical reading development?)

Question 9

Convergent

Answer 9

does the test get similar results to other tests measuring the same or similar constructs (ex: do test scores correlate well with other test scores covering the same topic?

Question 10

Discriminant

Answer 10

does the test get different results than other tests measuring different constructs (ex: do test scores fail to correlate with with scores of different constructs?)

Question 11

Single-Subject Designs

Answer 11

focus is on individual behavior; can include multiple subjects, but they are not analyzed primarily as a group

Question 12

Between-Subjects Group Design

Answer 12

different groups of subjects are exposed to different levels of the independent variables; need to account for group equivalence

• subject randomization
• subject matching

Question 13

Within-Subjects Group Design

Answer 13

same subjects are exposed to different levels of the independent variables; requires fewer subjects; need to account for sequencing effects

• sequence randomization
• counterbalancing

Question 14

Mixed Group Design

Answer 14

Use both between-subject and within-subject variables