Final Flashcards

1
Q

An evaluation that uses the data collected before a program begins. Examples include pilot projects, baseline surveys, and feasibility studies.

A

Design evaluation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Coefficient of stability: Evaluator administers the same instrument twice, separated by a short period of time. Results are compared, using a statistic such as a correlation coefficient

A

Reliability coefficient/ test-retest reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Evaluator administers two equivalent versions of the same instrument (parallel forms) to the same group of people. Results are compared, using a coefficient of stability.

A

Alternate-form coefficient

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

A nonexperimental research method relying on questionnaires or interview protocols

A

Survey

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

The extent to which researchers can make this statement with confidence

A

Internal validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Study conducted at a single time period, and data are collected from multiple groups

A

Cross-sectional study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Data are collected at two or more points in time

A

Longitudinal study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Design that combines cross-sectional and longitudinal elements by following two or more age groups over time

A

Cohort-sequential design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Two observers’ data are compared to see whether they are consistently recording the same behaviors when they view the same events. Statistical procedures such as correlation or percentage of agreement can be used to establish this type of reliability.

A

Interrater reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Interpretive research approach relying on multiple types of subjective data and investigation of people in particular situations in their natural environment

A

Qualitative research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Use of multiple data sources, research methods, investigators, and/or theories/ perspectives to cross-check and corroborate research data and conclusions

A

Triangulation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

used to determine whether a single observer is consistently recording data over a period of time.

A

Intrarater reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

To what degree does all accumulated evidence support the intended interpretation of scores for the proposed purpose?

A

construct validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

commonly used data collection instruments or procedures designed to measure personality, aptitude, achievement, and performance.

A

Tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Items on the test represent content covered in the program (e.g., did the teacher teach the children that blue on the map means water?). Evaluators can work with content specialists to list the content that is part of the program, and can compare the test items to see whether they correspond.

A

Content-related evidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

a self-report data collection instrument that is filled out by research participants.

A

Questionnaire

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

The researcher takes independent samples from a general population over time and the same questions are asked.

A

Trend study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

a situation where the interviewer asks the interviewee a series of questions

A

Interview

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

indicates that the measure actually reflects current or future behaviors or dispositions.

A

Criterion-related evidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

a situation where a focus group moderator keeps a small and homogeneous group (of 6–12 people) focused on the discussion of a research topic or issue.

A

Focus group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Evaluators need to be aware of the consequences of using data, especially with regard to the potential to worsen inequities.

A

Consequential evidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Researcher watches and records events or

behavioral patterns of people

A

Observation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Observation conducted in real-world situations

A

Naturalistic observation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Observation conducted in lab setting set up by the researcher

A

Laboratory observation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Evaluators need to stay on site for sufficient time to “get the story right.” If a study is conducted over too short a time or interviews are conducted with too few people, it is possible that an evaluator will reach “premature closure”

A

Prolonged and substantial engagement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

the ability to generalize the results of a study to the population from which the research population was drawn.

A

External validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

A word that produces an emotionally charged reaction

A

Loaded term

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

A question that suggests how the participants should

answer

A

leading question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Asking about two or more issues in a single question

A

Double-barreled question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Nonoverlapping response categories

A

Mutually exclusive categories

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Response categories that cover the full range of possible responses

A

Exhaustive categories

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

An ordered set of response choices, such as a 5-point rating scale, measuring the direction and strength of an attitude

A

Rating scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Descriptors placed on points on a rating scale

A

Anchor

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

Participant must select from the two response choices provided with an item

A

Binary forced-choice approach

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

A scaling technique that is used to measure the meaning that participants give to attitudinal objects or concepts and to produce semantic profiles

A

Semantic differential - a scaling technique that is used to measure the meaning that participants give to attitudinal objects or concepts and to produce semantic profiles

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

An item directing the participant to different follow-up questions depending on the initial response

A

Contingency question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

Tendency for a participant to respond in a

particular way to a set of items

A

response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

Evaluators need to be aware of their assumptions, hypotheses, and understandings, and of how these change over the period of the study.

A

Progressive subjectivity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

those incurred to provide a treatment or a service

A

direct costs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

resources lost due to the disorder.

A

indirect costs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

Events that occur during the study other than the experimental treatment effect that can influence the results

A

History threat

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

describing design that is intended to simplify life for everyone by making products, communications, and the built environment more usable by as many people as possible at little or no extra cost

A

Universal design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

naturally occurring physical or psychological changes

A

Maturation threat

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

A monitoring system that would involve community members in determining what indicators of change are important to them

A

Most Significant Change Method

Christian Commission for Development in Bangladesh and Rick Davies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

Administration of a pretest that affects participants’ performance on a posttest (i.e., participants become “testwise”).

A

testing threat

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

Having pretests and posttests that differ in terms of difficulty; this can lead to seeming changes that are really due to the difference in the tests.

A

Instrumentation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

Having extreme groups in a study (i.e., people very high or very low on a particular characteristic); it is possible that changes will be seen on the dependent variable because of this threat.

A

statistical regression

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
48
Q

Differences between the experimental and control groups on important characteristics, other than receipt of the intervention.

A

differential selection

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
49
Q

Differential dropouts of participants from either the experimental or control groups.

A

experimental mortality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
50
Q

treatment was not implemented as intended

A

treatment fidelity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
51
Q

monetary (i.e., dollar) values are estimated for the resources used (i.e., costs) and for the program effects (i.e., benefits), and these two components (costs and benefits) are then compared to determine the worth of a program.

A

cost-benefit analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
52
Q

based on cost and effect data (rather than cost and benefit data as in benefit-cost analysis).

A

cost-effectiveness analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
53
Q

What a concept means in abstract or theoretical terms

A

Conceptual definition of a sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
54
Q

What you will observe and/or measure; links the concept you want to sample to the real world

A

Operational definition of a sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
55
Q

Group to which you wish to generalize your results

A

target

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
56
Q

List of people who match the conceptual definition

A

Experimentally accessible population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
57
Q

List of people in the experimentally accessible population

A

Sampling frame

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
58
Q

Match between accessible population and target population

A

population validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
59
Q

voluntary consent without threat or undue inducement; it includes knowing what a reasonable person would want to know before giving consent (informed), and explicitly agreeing to participate (consent).

A

informed consent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
60
Q

collecting, analyzing, storing, and reporting data in such a way that the data cannot be traced back to the individual who provides them.

A

confidentiality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
61
Q

involves the selection of a sample from a population in a way that allows for an estimation of the amount of possible bias and sampling error.

A

Probability-based sampling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
62
Q

Those in which every member of a population has a known nonzero probability of being included in the sample.

A

Random samples

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
63
Q

Every member of the population has an equal and independent chance of being selected.

A

Simple random sampling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
64
Q

A robust description of the context in which qualitative research is conducted

A

Thick description

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
65
Q

Selection of easily obtainable participants for sample group and usually the cheapest and fastest way of obtaining a sample group; interviewers happen to be available at a program site.

A

Convenience sampling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
66
Q

When will you have a poor strength of treatment?
A. When the participants are sensitized to the posttest.
B. When the evaluator uses different types of measurement for dependent variables.
C. When the treatment “dose” was not strong enough to produce the expected change.
D. When the evaluator systematically conducts an intervention at different times of the day.

A

C

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
67
Q

In evaluation, a limitation of traditional definitions of needs assessment (according to your textbook) is that they focus only on needs and lack any attention to assets?
A. True
B. False

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
68
Q

The assumption that all people within a particular subgroup are similar to each other in terms of their other background characteristics, or similar enough where differences are not identified.

A

Myth of homogeneity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
69
Q

Which of the following is(are) needed to infer causality?
A. X precedes Y
B. X is related to Y
C. Confounding variables can be ruled out as causes
D. All of the above are required.

A

D

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
70
Q
When an extraneous variable systematically varies with the independent variable and influences the dependent variable, it is called:
 A. Another dependent variable
 B. A confounding variable
  C. A moderating variable
 D. An unreliable variable
A

B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
71
Q

Data analysis tends to be an ongoing and iterative (nonlinear) process in qualitative research.

The cyclical process of collecting and analyzing data during a single research study).

A

Interim analysis

72
Q

the difference between the sample and the population.

A

Sampling error

73
Q

A major characteristic of experimental and quasi-experimental designs is an independent variable that can be manipulated.
A. True
B. False

A

True

74
Q

Used in telephone surveys; computer generates a random list of phone numbers.

A

Random - digit dialing

75
Q
If an evaluation is focused on addressing human rights, with what paradigm is it most closely aligned?
 A. Postpositivist
  B. Transformative
 C. Constructivist
 D. Pragmatic
A

B

76
Q

Take every nth name off a list. Suppose you have 1,000 names on the list and you need a 10% sample. You pick a random number between 1 and 10, start there, and then take every 10th name on the list.

A

Systematic sampling

77
Q

Which of the following is NOT a purpose for an evaluation?
A. To identify needed inputs, barriers, and facilitators to program development or implementation.
B. To determine inequities on the basis of gender, race, ethnicity, disability, and other relevant dimensions of diversity.
C. To determine how a program can be made to look positive despite its lack of impact/effect.
D. To demonstrate that accountability requirements are fulfilled.

A

C

78
Q

If there are different groups (strata) that you want to be sure to include, then you can divide the population into subgroups first and then randomly sample from the subgroups.

A

Stratified sampling

79
Q
What are some designs used by the methods branch to determine the effectiveness of an intervention?
  A. Experimental, quasi-experimental, single-group, and survey
 B. Narrative, phenomenological, ethnographic, and case study
 C. Dialectical, transformative, and case study
 D. Gender, race, and class analysis
A

A

80
Q

Use with naturally occurring groups (e.g., classrooms, school districts, city blocks). Units are randomly selected from full list of possible sites. Then you can collect data from the members in the randomly selected unit.

A

Cluster sampling

81
Q

Which of the following is legitimately considered (according to your textbook authors) a type of evaluation?
A. Organizational assessment
B. Participatory evaluation
C. Cost analysis/assessment
D. All of the above are considered legitimate

A

D

82
Q

Use a combination of sampling strategies over the course of the study (e.g., start with cluster sampling, then use simple random sampling within clusters).

A

Multistage sampling

83
Q

Cost Analysis is defined as an evaluation’s determination of whether a program’s effect was worth its cost.
A. True
B. False

A

A

84
Q

Pilot testing data collection instruments is not very important.
A. True
B. False

A

A

85
Q

Choose unusual or special individuals (e.g., highly successful or unsuccessful school principals).

A

Extreme or deviant sampling

86
Q

Identify instances where the phenomenon of interest is strongly represented. Look for rich cases that are not necessarily extreme.

A

Intensity sampling

87
Q

What are some examples of qualitative data collection options as listed by your textbook authors?
A. Observations, interviews, review of artifacts, and focus groups
B. Performance assessments and structured observations
C. Interviews, surveys with random samples, and norm-referenced tests
D. Structured observations, criterion-referenced tests, and portfolios

A

A

88
Q
What are some forms of evidence used to support validity/credibility in qualitative data collection?
 A. Peer debriefing
 B. Member checks
 C. Persistent observations
  D. All of the above
A

D

89
Q

Choose individuals that represent maximum variation of the phenomenon (e.g., teachers in isolated rural, suburban, and inner-city areas).

A

Maximum variation sampling

90
Q

Identify strongly homogeneous cases; find individuals who share relevant characteristics and experiences.

A

Homogeneous sampling

91
Q

What is universal design as discussed by the textbook authors?
A. A way to simplify life for everyone by making products, communications, and the built environment more useable by as many people as possible.
B. A technique for making tests more accessible to disabled people.
C. Use of multiple languages in a data collection instrument
D. All of the above.

A

A

92
Q

In most cases, use homogeneous groups (e.g., if service providers and participants are included in the same focus group, this might yield biased results).

A

Focus group sampling

93
Q

This is the opposite of the extreme or deviant sampling strategy; you want to identify the typical or average

A

Typical case sampling

94
Q

What is INTRArater reliability?
A. It is used to determine whether a single rater or observer is consistent over time.
B. It compares the data of two raters or observers to see whether they are rating the same behavior consistently.
C. It is used to compare two kinds of data collection to see whether they are describing the same event.
D. It is used to compare when different raters are administering similar instruments

A

A

95
Q

Strategy combines the identification of strata of relevant subgroups with purposeful selection from those subgroups.

A

Stratified purposeful sampling

96
Q

Use cases that can make a point dramatically or are important for other reasons. Patton (2002b) says that the key to identifying a critical case is “If it’s true of this one case, it’s likely to be true of all other cases” (p. 243).

A

Critical case sampling

97
Q
An evaluator created a test. In order to test reliability, he had the participants take the test and he analyzed the results to examine the consistency of their responses. What is this an example of?
 A. Repeated measures reliability
 B. Intraparticipant reliability
  C. Internal-consistency reliability
 D. Multi-dimensional reliability
A

C

98
Q

Start with key informants who are then asked to recommend others you should talk with—some who agree with them and some who disagree with them.

A

Snowball or chain sampling

99
Q

Set up criteria to specify what characteristics people in the study need to have.

A

Criterion sampling

100
Q

Reliability and validity are commonly used terms to describe the quality of quantitative data collection. What does validity mean in this situation?
A. Does the instrument measure cultural competence?
B. Does the instrument (as used with the participants) really measure what it is supposed to measure?
C. Does the instrument measure what is it is supposed to measure consistently?
D. Does the instrument reliably measure what it is supposed to measure over time?

A

B

101
Q

If the evaluation is focused on a theoretical construct such as creativity, you need to describe the meaning of that construct, and then identify individuals who theoretically exemplify that construct.

A

Theory-based sampling

102
Q

In multiple regression, when we say that we control for the effects of some variable(s) we are:
A. statistically adjusting or subtracting the effects of a variable to see what a relationship would have been without it
B. actually removing a variable from a model so that it does not interact with the effects of other variables
C. changing the mediating capabilities of an endogenous variable
D. changing the mediating capabilities of an exogenous variable

A

A

103
Q

Look for cases that both confirm and disconfirm emerging hypotheses.

A

Confirming and disconfirming case sampling

104
Q
What kind of data collection is useful when you want people to discuss a particular topic?
 A. Case studies
 B. Interviews
  C. Focus groups
 D. Open-ended questionnaires
A

C

105
Q

Selection of individuals emerges as the study progresses; you do not know a priori who will need to be included.

A

Opportunistic sampling

106
Q

What are some critical issues related to data collection?
A. Language of participants
B. Literacy level of participants
C. Use of a dominant or colonizing language
D. All of the above

A

D

107
Q

Randomly choose individuals from a purposefully defined group.

A

Purposeful random sampling

108
Q
The \_\_\_\_\_\_ sampling strategy chooses unusual or special individuals (e.g., highly successful or unsuccessful school principles)?
 A. Maximum variation sampling
 B. Stratified purposeful sampling
  C. Extreme or deviant sampling
 D. Snowball or chain sampling
A

C

109
Q

Determine whether there is a political reason for including particular areas and individuals for the credibility and perceived usefulness of the study.

A

Politically important case sampling

110
Q

What is the definition of a sampling frame in your textbook (Mertens and Wilson)?
A. The target population of your study
B. List of all the people in the experimentally accessible population.
C. The people you plan to observe
D. None of the above

A

B

111
Q
Which of the following is NOT one of the 13 categories of disabilities in the Individuals with Disabilities Education Improvement Act of 2004?
 A. Emotional disturbance
 B. Speech of language impairment
 C. Visual impairment
  D. Majority-minority group membership
A

D

112
Q

The set of cases selected from the population

A

Sample

113
Q
Which of the following is a type purposeful/theoretical sampling?
 A. Simple random sampling
  B. Critical case sampling
 C. Systematic sampling
 D. Cluster sampling
A

B

114
Q

The full group to which one wants to generalize

A

Population

115
Q
Which major sampling option is more commonly used in the Values Branch?
 A. Probability-based sampling
 B. Multistage sampling
  C. Theoretical/Purposeful sampling
 D. Simple Random Sampling
A

C

116
Q

A numerical index based on sample data

A

Statistic

117
Q
What is the opposite of deviant case or extreme sampling?
  A. Typical case sampling
 B. Homogeneous sampling
 C. Critical case sampling
 D. Snowball sampling
A

A

118
Q

A numerical characteristic of a population

A

Parameter

119
Q
What kind of sampling strategy begins with a random start, includes that element, and then includes every nth name off a list?
 A. Interval sampling
  B. Systematic sampling
 C. Random digit sampling
 D. Multistage sampling
A

B

120
Q

The type of statistical analysis focused on describing, summarizing, or explaining a set of data

A

Descriptive statistics

121
Q

According to your text, the “myth of homogeneity” means assuming that all people within a particular subgroup are similar to each other in terms of their other background characteristics, or at least sufficiently similar that you do not have to focus on those differences.
A. True
B. False

A

True

122
Q

The type of statistical analysis focused on making inferences about populations based on sample data

A

Inferential statistics

123
Q

What is nested sampling?
A. You gather samples using a variety of methods.
B. You use different people from different populations
C. You have identical samples for both the quantitative and qualitative parts of the study.
D. Data are collected from a group using one method; then a subset of that group is selected to provide data using another method.

A

D

124
Q

The theoretical probability distribution of the values of a statistic that would result if you selected all possible samples of a particular size from a population

A

Sampling distribution

125
Q
Which sampling strategy uses cases that can make a point dramatically or are important for other reasons?
 A. Stratified random sampling
  B. Critical case sampling
 C. Homogeneous sampling
 D. Politically important case sampling
A

B

126
Q

The theoretical probability distribution of the means of all possible samples of a particular size selected from a population

A

Sampling distribution of the mean

127
Q

The standard deviation of a sampling distribution

A

Standard error

128
Q

A statistic that follows a known sampling distribution and is used in significance testing

A

Test statistic

129
Q

An evaluation that is allowed to evolve throughout the course of the project. Examples include participatory, qualitative, critical, hermeneutical, bottom-up, collaborative, and transdisciplinary approaches.

A

Emergent evaluation

130
Q

The branch of inferential statistics focused on obtaining estimates of the values of population parameters

A

estimation

131
Q

Use of the value of a sample statistic as one’s estimate of the value of a population parameter

A

Point estimation

132
Q

Placement of a range of numbers around a point estimate

A

Interval estimation

133
Q

Use a word or short phrase to summarize the topic found in a passage of the data.

A

Descriptive codes

134
Q

Use the exact language of the participants as a code.

A

In vivo codes

135
Q

Captures actions in the data and usually ends in “-ing.”

A

Process coding

136
Q

Labels emotions that are expressed by the participants.

A

Emotion coding

137
Q

Can reflect the values, attitudes, or beliefs expressed by participants.

A

Values coding

138
Q

A hypothesis states that there is no difference between the scores of the experimental group and the control group

A

Null hypothesis

139
Q

The hypothesis states that there will be a difference between means in the population.

A

Alternative hypothesis

140
Q

An interval estimate inferred from sample data that has a certain probability of including the true population parameter.

A

Confidence interval

141
Q

A set of data, where the rows are “cases” and the columns are “variables”

A

Data set

142
Q

The analysis guides the design of subsequent stages of a study and leads to further analysis that integrates the data from these stages.

A

Sequential integration

143
Q

Data arrangement in which the frequencies of each unique data value is shown

A

Frequency distribution

144
Q

The branch of inferential statistics focused on determining when the null hypothesis can or cannot be rejected in favor of the alternative hypothesis

A

Hypothesis testing

145
Q

Depicting frequencies and distribution of a quantitative variable

A

Histogram Graph

146
Q

The point at which one would reject the null hypothesis and accept the alternative hypothesis

A

Alpha level

147
Q

The average deviation of data values from their mean in squared units

A

Variance

148
Q

The area on a null hypothesis sampling distribution where the observed value of the statistic, if it fell in this area, would be considered a rare event

A

Critical region

149
Q

The square root of the variance

A

Standard deviation

150
Q

The likelihood of the observed value (or a more extreme value) of a statistic, if the null hypothesis were true

A

Probability value (p value)

151
Q

Conclusion that an observed finding would be very unlikely if the null hypothesis were true

A

statistically significant

152
Q

Used to determine if the difference between the means of two groups is statistically significant

A

Independent samples t test:

153
Q

Claim made when a statistically significant finding seems large enough to be important

A

Practical significance

154
Q

Methods used to gather data in an emergency response situation in order to share information in real time.

A

Rapid evaluation and assessment methods (REAM)

155
Q

An index of magnitude or strength of relationship

A

Effect size indicators

156
Q

Rejection of a true null hypothesis

A

Type 1 error

157
Q

Failure to reject a false null hypothesis

A

Type II error

158
Q

Which of the following is used for group differences evaluation questions?
A. t test for independent samples
B. Pearson product-moment coefficient of correlation
C. Mean and variance
D. Range

A

A

159
Q

What are some strategies for analyzing qualitative data?
A. Engage in continuous and ongoing data analysis
B. Reflectively reading interview transcripts and field notes to get a holistic picture of the research question.
C. Determining codes for the data that suggest emergent concepts
D. All of the above

A

D

160
Q
Who are the researchers who initiated grounded theory as a systematic method?
  A. Glaser and Strauss
 B. Campbell and Shadish
 C. Pope and Wallace
 D. Patton and Stake
A

A

161
Q

One reason that statistical analysis is useful is:
A. It helps you in coding interview transcripts
B. It helps you reduce a large amount of data into more meaningful terms such as an average
C. It is a systematic system for organizing data into relevant categories or themes.
D. It is useful for obtaining a thick description of the data

A

B

162
Q

According to your textbook, generalizability is only a concern in the interpretation of quantitative data
A. True
B. False

A

B

163
Q

According to the authors of your text, it is sometimes appropriate to involve stakeholders in the analysis phase of the evaluation.
A. True
B. False

A

A

164
Q

What are some theoretical frameworks commonly used in qualitative data analysis?
A. Postpositivism
B. Postpragmatism
C. Postmodernism
D. Feminist theory and indigenous theory

A

D

165
Q

According to your text, it is rarely if ever important for evaluators to use a particular theoretical framework lens in analyzing data.
A. True
B. False

A

B

166
Q

What factor(s) might influence whether you decide to analyze your data using software or manually?
A. The amount of time you have available to analyze your data.
B. The amount of data you have collected
C. The training and support available at your institution.
D. All of the above are factors are important to consider.

A

D

167
Q
The \_\_\_\_\_\_ sampling strategy chooses unusual or special individuals (e.g., highly successful or unsuccessful school principles)?
 A. Maximum variation sampling
 B. Stratified purposeful sampling
  C. Extreme or deviant sampling
 D. Snowball or chain sampling
A

C

168
Q

What is the definition of a sampling frame in your textbook (Mertens and Wilson)?
A. The target population of your study
B. List of all the people in the experimentally accessible population.
C. The people you plan to observe
D. None of the above

A

B

169
Q
Which of the following is NOT one of the 13 categories of disabilities in the Individuals with Disabilities Education Improvement Act of 2004?
 A. Emotional disturbance
 B. Speech of language impairment
 C. Visual impairment
  D. Majority-minority group membership
A

D

170
Q
Which of the following is a type purposeful/theoretical sampling?
 A. Simple random sampling
  B. Critical case sampling
 C. Systematic sampling
 D. Cluster sampling
A

B

171
Q
Which major sampling option is more commonly used in the Values Branch?
 A. Probability-based sampling
 B. Multistage sampling
  C. Theoretical/Purposeful sampling
 D. Simple Random Sampling
A

C

172
Q
What is the opposite of deviant case or extreme sampling?
  A. Typical case sampling
 B. Homogeneous sampling
 C. Critical case sampling
 D. Snowball sampling
A

A

173
Q
What kind of sampling strategy begins with a random start, includes that element, and then includes every nth name off a list?
 A. Interval sampling
  B. Systematic sampling
 C. Random digit sampling
 D. Multistage sampling
A

B

174
Q

According to your text, the “myth of homogeneity” means assuming that all people within a particular subgroup are similar to each other in terms of their other background characteristics, or at least sufficiently similar that you do not have to focus on those differences.
A. True
B. False

A

A

175
Q

What is nested sampling?
A. You gather samples using a variety of methods.
B. You use different people from different populations
C. You have identical samples for both the quantitative and qualitative parts of the study.
D. Data are collected from a group using one method; then a subset of that group is selected to provide data using another method.

A

D

176
Q
Which sampling strategy uses cases that can make a point dramatically or are important for other reasons?
 A. Stratified random sampling
  B. Critical case sampling
 C. Homogeneous sampling
 D. Politically important case sampling
A

D