Final Flashcards

1
Q

Threats to internal validity (8 points)

A

History, maturation, instrumentation, testing, statistical regression, intact groups, selection, mortality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Threats to external validity (4 points)

A

Selection bias, reactive effects of experimental arrangements, reactive effects of testing, multiple-treatment interference

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How to counter threats to internal validity?

A

Use true experimental designs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the true experimental designs?

A

Pretest-posttest randomized control group design, pretest-only randomized control group design, Solomon randomized four-group design.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Nippold Article (9 points)

A

Focuses on treatment studies. Studies must be duplicable, target the right participants and ensure there is no interference, collect a baseline, include a control group, have matched experimental and control groups, control for test-retest reactivity, show improvements that generalize beyond treatment setting, control for placebo effect, have no conflict of interest.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Gillam and Gillam

A

PICO, Level of evidence, Must weigh internal evidence levels with external evidence levels (student-parent and clinician-agency vs. what the research says)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

PICO

A

Patient, Intervention program, Comparison treatment, Outcome

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Levels of evidence

A

1= RCTs and SRs, 2=Nonrandomized studies, multiple baseline designs, SRs, 3=Studies of multiple cases who receive same treatment, 4=Single case studies, 5=Expert opinion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Social validation

A

Are results meaningful? Can others notice the difference?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Content validity

A

Appropriateness of the content of a measure. Broad sample of content is better than a narrow one, important material should be emphasized, questions should be written to measure the appropriate skills.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Face validity

A

Opinion of experts on measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Criterion validity

A

Comparing results of a test with a meaningful criterion that relates

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Predictive validity

A

The extent to which a test predicts the outcome it is supposed to predict.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Construct validity

A

Using subjective judgements to create a hypothesis that is tested using empirical methods.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Judgmental-empirical validity

A

Indirect evidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Criterion-related validity

A

Direct evidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Correlation coefficients

A

Use with quantitative data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

IRB and Belmont Report

A

Belmont report sets forth basic ethical principles required for research with human subjects. FWA=Federa Wide Assurance. 3 ethical principles are the basis of HHS/45 CFR 46=respect for persons, beneficence, justice. Secretary of Dept of Health and Human Services has oversight for system protecting human subjects.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

3 famous violations of ethics

A

Willowbrook studies, radiation tests on mentally impaired boys, Tuskegee Syphilis study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Monster study

A

Orphans put under psychological stress to induce stuttering

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Test-retest

A

Should only be used when learning/maturation is not possible. Compute correlation coefficient for scores.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Pros and Cons of Reversal

A

Pros of reversal: Demonstrate experimental control, time confounds unlikely (eg maturation). Cons of reversal: Difficult with long-lasting effect treatment, ethics with withdrawal.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Pros and Cons of Multiple Baseline

A

Pros: No need for reversal if using long-lasting effects, Cons: Individual differences, can take a long time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What are SSDs good for?

A

Learning, treatment studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Treatment fidelity/procedural validity

A

Otherwise known as reliability of IV. Calculated using point-by-point or total % agreement. Strategies that monitor and enhance accuracy and consistency of intervention to ensure it is implemented as planned, each component delivered to all participants the same way over time. Can also use a checklist to ensure procedural validity.

26
Q

Reliability definition

A

Test yields consistent results

27
Q

Validity definition

A

Test covers correct content

28
Q

Simple random sample

A

Every member of a population is given an equal chance of being included in a sample

29
Q

Systematic sampling

A

Every nth person is selected

30
Q

Stratified random sampling

A

Participants are randomly selected from each strata proportionally

31
Q

Cluster sampling

A

Researchers draw groups, not individuals. Must use large number of clusters because many times the clusters are more homogenous than the general population

32
Q

Purposive sampling

A

Participants are chosen based on their usefulness in the study.

33
Q

Snowball sampling

A

Used for participants who are hard to find. Tell one participant in the group and they tell more in same group to join study.

34
Q

Measurement scales with examples

A

Nominal (Which L1 spoken), Ordinal (Reading level), Interval (math test), Ratio (weight)

35
Q

Cookies experiment in class

A

t-test

36
Q

Gummy bear experiment in class

A

2-way ANOVA

37
Q

Chi square

A

Used for nominal data. Example of a bivariate analysis.

38
Q

Practical vs statistical significance

A

Stat significant: differences in group means are not due simple to chance. In large samples, the difference can be statistically significant while not being practically significant.

39
Q

Cohen’s d

A

Shows effect size. Calculated by finding the difference of the 2 means and dividing by the size of the standard deviation. Can range from -3 to +3.

40
Q

Labels for Cohen’s d

A

.2=small, .5=medium, .8=large, 1.10=very large, 1.40=extremely large

41
Q

Effect size for correlation?

A

r2

42
Q

Effect size for t-test vs. ANOVA

A

t-test= cohen’s d, ANOVA (F)=treatment sum of squares

43
Q

Meta-analysis

A

Set of statistical methods for combining results of previous studies. Uses mean. Meta-analyses are large and oftentimes reliable but lack the same validity that its component tests.

44
Q

Meta-analyses and effect size

A

Calculating Cohen’s d for all studies to be included permits the averaging of values of d to get a meaningful result. This solves the problem of the different scales of the various included studies’ results (unable to be averaged).

45
Q

SSD’s and ASD

A

SSD’s are good for ASD research. It is unethical for kids with ASD to be without treatment so putting them in a control group in an experimental study is not possible. Also, kids with ASD are very heterogeneous and therefore the experimental and control groups would not be similar.

46
Q

In the study by Koegel and Koegel, what was the independent variable introduced in the B condition?

A

maintenance trials interspersed with acquisition trials

47
Q

In the Kern et al study what was the baseline condition

A

typical morning greeting routine

48
Q

What type of research design was used in the Kern et al. study

A

withdrawal design

49
Q

The study by Koegel and Koegel used a multiple baseline design. What were the intervention conditions replicated across?

A

Academic tasks

50
Q

In the Kern study, what type of reliability was calculated?

A

percent agreement using the point by point method

51
Q

According to Cardon and Azuma, what are the two most common types of SSRDs used in autism intervention research?

A

withdrawal and multiple baseline

52
Q

According to Cardon and Azuma, why is it important to replicate findings across additional labs?

A

to ensure that results are not due to the specific set of researchers and their students

53
Q

What ethical violation occurred in the famous Willowbrook Case?

A

children in a mental hospital were given hepatitis

54
Q

How did Sigafoos, Didden and O’Reilly measure reliability in their study on speech output in children with developmental disabilities?

A

they compared percent agreement between two observers

55
Q

In terms of validity, What is the term for a standard by which a test is judged?

A

criterion

56
Q

Part of the Belmont Report states that researchers should obtain maximum benefits and minimize possible harm. What principle is this?

A

Beneficence

57
Q

You are writing your paper using APA style. What does APA stand for?

A

American Psychological Association

58
Q

According to the Ethics video, how long is it recommended that researchers keep data?

A

5-7 years

59
Q

Romski article

A

Randomized group design, NO CONTROL. This study compared the language performance of young children with developmental delays who were randomly assigned to 1 of 3 parent-coached language interventions. Differences in performance on augmented and spoken word size and use, vocabulary size, and communication interaction skills were examined. Sixty-eight toddlers with fewer than 10 spoken words were randomly assigned to augmented communication input (AC-I), augmented communication output (AC-O), or spoken communication (SC) interventions; 62 children completed the intervention. This trial assessed the children’s symbolic language performance using communication measures from the language transcripts of the 18th and 24th intervention sessions and coding of target vocabulary use. All children in the AC-O and AC-I intervention groups used augmented and spoken words for the target vocabulary items, whereas children in the SC intervention produced a very small number of spoken words. Vocabulary size was substantially larger for AC-O and AC-I than for SC groups.

60
Q

Justice article

A

This study examined the impact of teacher
use of a print referencing style during classroom-based storybook reading sessions conducted over an academic year. Impacts on preschoolers’ early literacy development were examined, focusing specifically on the domain of print knowledge. This randomized, controlled trial examined the effects of a print referencing style on 106 preschool children attending 23 classrooms serving disadvantaged preschoolers. Following random assignment, teachers in 14 classrooms used a print referencing style during 120 large-group storybook reading sessions during a 30-week period. Teachers in 9 comparison classrooms read at the same frequency and with the same storybooks but used their normal style of reading. Children whose teachers used a print referencing style showed larger gains on 3 standardized measures of print knowledge: print concept knowledge, alphabet knowledge, and name writing, with medium-sized effects.

61
Q

Kern article

A

Withdrawal design. ABAB, ABCAC. This study evaluated the effects of individually composed songs on the independent behaviors of two young children with autism during the morning
greeting/entry routine into their inclusive classrooms.
A music therapist composed a song for each child
related to the steps of the morning greeting routine and
taught the children’s teachers to sing the songs during
the routine. The effects were evaluated using a single
subject withdrawal design. The results indicate that the
songs, with modifications for one child, assisted the
children in entering the classroom, greeting the teacher
and/or peers and engaging in play. For one child, the
number of peers who greeted him was also measured,
and increased when the song was used.

62
Q

Koegel and Koegel article

A

The article assesses the effects of task-sequencing variables on the academic performance of an 8-year old
severe stroke victim. Within a multiple baseline design, previously acquired (maintenance) task
trials were systematically interspersed at designated points in treatment among new (acquisition)
task trials. The results showed improvements in both academic responding and subjective ratings
of motivation in each of four treated areas (spelling, reading, word-finding, and memory). Social
validation data obtained from standardized school placement examinations suggested marked improvement in a variety of related areas of academic functioning. Results suggest that children
suffering severe strokes may be capable of learning more than has previously been suspected, and
that behavioral treatments may improve such children’s functioning.