Terms

Question 1

quantitative

Answer 1

to study relationships and cause-effect
deductive approach; tests theory
large samples
numerical data
narrow scope, statistical analysis, fixed

Question 2

positivist (quan)

Answer 2

involves testing theories and hypotheses and generalizing findings to larger population
separate research from researcher
NEED MORE

Question 3

behavioral research (quan)

Answer 3

study the actions or reactions of persons or animals in response to external or internal stimuli

Question 4

naturalistic (qual)

Answer 4

observes and records some behavior or phenomenon in its natural setting while interfering as little as possible

Question 5

qualitative

Answer 5

to examine a phenomenon in rich detail
inductive; generates theory
small sample
contextual data
broad scope, content analysis, flexible

Question 6

ethnographic (qual)

Answer 6

involves an in-depth study of naturally occurring behavior within a culture or group

Question 7

interpretive research

Answer 7

provides descriptive accounts
understand the world or experience of another
Attempt to understand phenomena through accessing the meanings participants assign to them

Question 8

internal validity (quan)

Answer 8

goes with credibility in qual
the extent to which changes in a DV are related directly and only to the targeted IV
happens with extraneous variables

Question 9

Threats to Internal Validity (12)

Answer 9

history (unrelated events during study)
maturation (changes within participants)
testing effect (post test)
instrumentation (unreliable or change in instru)
regression (skewed data)
selection (not equal groups)
mortality (loss of participants)
selection-maturation (diff maturation rates in sample)
experimenter effect (unintentional bias or behavior)
subject effect (attitude effect)
diffusion (treatment group talks to control group)
location

Question 10

credibility (qual)

Answer 10

goes with internal validity in quan
results are believable and trustworthy form the perspective of a participant or subject in the research itself
prolonged engagement, frequent obs, peer deb, triangulation, collect referential adequacy materials, member checks
after: corroboration, referential adequacy, member checks

Question 11

treatment verification

Answer 11

confirmation/verification of IV
Reasons: determines analysis of findings and drawing conclusion, critical to valid interpretation of effects and estimation of generalizability, needed for relicability

Question 12

aptitude-treatment interaction in designs

Answer 12

???concept that some instructional strategies (treatments) are more or less effective for particular individuals depending upon their specific abilities

Question 13

aptitude-treatment interaction in analyses

Answer 13

???should coordinate instructional materials and methods with students’ specific learning characteristics to maximize learning

Question 14

random sampling vs random selection vs random assignment

Answer 14

sampling: implies that every member of a pop has an equal and indep chance of being selected to participate in the sample
selection: how you draw the sample from pop (external validity)
assignment: how you assign the sample to diff groups or treatments in the study (internal validity)

Question 15

systematic sampling

Answer 15

population in list, pick each k-th element

Question 16

convenience sampling

Answer 16

non-probability sampling
willing and available
selected because of their convenient accessibility and proximity to the researcher

Question 17

purposive sampling

Answer 17

(judgmental sample) subjects selected bc of some characteristic for the purpose of the study
Ex: pick 2 of 10 schools bc think the 2 represent typical adolescent Americans

Question 18

external validity (quan)

Answer 18

goes with trans in qual

extent to which the results of study can be generalized (apply findings to population)

Question 19

transferability (qual)

Answer 19

goes with external validity in quan

degree to which the results of qual can be generalized or transferred to other contexts or settings

Question 20

ecological validity

Answer 20

To what extent will the same findings be obtained under other experimental settings (environmental conditions) or other experimental treatments?

Question 21

population validity

Answer 21

To what extent can I apply my results to the targeted population?

Question 22

reliability (quan)

Answer 22

degree of consistency with which it measures whatever it is measuring
goes with dependability in qual
low reliability = high variance
obs score = true score + error
more reliable = less error
consistency or stability of measurement
How well does the instrument measure accurately and consistently?
Can our measure (or other form of observation) be confirmed by further measurements or obser

Question 23

internal consistency reliability

Answer 23

used to assess the consistency of results across items within the test
a measure of reliability used to evaluate the degree to which different test items that probe the same construct produce similar results

Question 24

inter-rater reliability (inter-scorer)

Answer 24

a measure of reliability used to assess the degree to which different raters agree in their assessment decisions

Question 25

validity (quan)

Answer 25

goes with confirmability in qual valid = unbiased knowing if the inferences we make about the relationship between the targeted variables are valid measures what it claims to measure

Question 26

content validity

Answer 26

the extent to which the test's items represent the entire body of content that the test is designed to measure How adequately do the test items represent the entire body of content the test user intends to make inferences about? Also deals with formatting: clarity of printing, type size, clarity of directions, adequate work space, etc

Question 27

criterion validity

Answer 27

relationship between scores from one instrument and scores obtained from another instrument or measure compares test score and an outcome example: SAT score and GPA Types: Predictive and Concurrent

Question 28

construct validity

Answer 28

how well the scale measures the construct it was designed to measure (test is measuring what it is supposed to measure) example: math test tests reading ability instead of math skills

Question 29

parallel-forms reliability

Answer 29

used to assess the consistency of the results of two tests constructed in the same way from the same content domain

Question 30

stability (test-retest reliability)

Answer 30

used to assess the consistency of a measure from one time to another on same test measure of steadiness or sameness of scores over time

Question 31

dependability (qual)

Answer 31

goes with reliability in quantitative if research repeated you would get the same thing the stability or consistency of the inquiry processes used over time Careless mistakes in collecting the data? keep an audit to share for your research based on assumption of repeatability (but not possible in qual... only qual)

Question 32

confirmability (qual)

Answer 32

goes with validity in quantitative degree to which the results could be confirmed or corroborated by others keep data audit that shows data collection and analysis procedures and makes judgments about the potential for bias or distortion

Question 33

sampling unit

Answer 33

element or set of elements considered for selection in some stage of sampling

Question 34

unit of replication

Answer 34

??? unit (usually class or student) where study is replicated

Question 35

unit of analysis

Answer 35

``` the level from which you collect and analyze the data (students, teachers, parents, organizations, etc) function of the research questions or hyp you seek to answer or test ```

Question 36

content analysis (both qual and quan)

Answer 36

word frequencies, space measurements, etc Quan= perform as methodology or used to supplement data in anaylsis Qual= used to gather numerical data. Content analysis used as way to analyze data

Question 37

validity of instrument

Answer 37

does the instrument measure what it claims to measure? | interpretation and meaning of the scores derived from the instrument

Question 38

reliability of instrument

Answer 38

consistency in respondents' responses How to help: Have more than one interviewer interview, repetitive questions, and repeat interview or questions after some time

Question 39

secondary data analysis

Answer 39

use of data that was collected by someone else for some other purpose

Question 40

replication studies

Answer 40

repeating a study using the same methods but with different subjects and experimenters

Question 41

replication-and-extension studies

Answer 41

combine results from prior studies with results from a new study specifically designed to replicate and extend the results of the prior studies

Question 42

meta-analysis (for synthesizing research)

Answer 42

statistical technique that combines effectsize compare findings of a LARGE number of studies and attempt to identify commonalties

Question 43

descriptive research

Answer 43

measure of status, rather than prediction describe "what exists" gather data that describes events and then organize, tabulate, depict, and describe data Often uses visual aids

Question 44

survey research

Answer 44

participants answer questions administered through interview or questionnaires longitudinal (same pop at diff times) or cross-sectional (diff pop at same time)

Question 45

observational research

Answer 45

observe human and animal behavior naturalistic: observe in natural enviro laboratory: more control, less time consuming

Question 46

correlation research

Answer 46

attempts to determine the strength and direction of the relationship between two or more variables

Question 47

prediction research

Answer 47

if two variables correlate, use one variable to predict the other; higher the correlation, the more accurate the prediction

Question 48

ex post facto (causal-comparative research)

Answer 48

research to determine the cause for existing differences in groups of individuals IV already occurred and, therefore, can't be manipulated

Question 49

Ex post facto: Effects type design (Proactive)

Answer 49

focus on examining a presumed cause of some effect Are groups formed bc of presumed cause? Does group membership have an effect on DV? Grouping is on the IV 2 to 1

Question 50

Ex post facto: Cause type design (Retroactive)

Answer 50

Try to identify possible cause of group membership What are the possible causes that led to group membership? Grouping on DV 1 to 2

Question 51

experimental research

Answer 51

an attempt to maintain control over all factors that may affect the result of an experiment then tries to predict what will occur Control, manipulation, and observation and measurement

Question 52

pre-experimental research

Answer 52

(weak) lack threats to internal validity

Question 53

true experimental research

Answer 53

control major threats to internal validity randomly assigned highly recommended for education

Question 54

quasi-experimental research

Answer 54

``` use existing groups equivalent groups no random assignment (susceptible to internal and external validity) CANNOT intervene or change groups commonly used in education ```

Question 55

ethical principles in human subjects research (6)

Answer 55

* Protect participants * Ensure confidentiality and anonymity * Deception? * Research with children- informed consent by parents, do not pretend to be diagnostic or counselors, don't coerce children to participate * Informed consent * Regulation of research (HHS dept and FIT Institutional Review Board)

Question 56

Descriptive and Vote Count Methods for summarizing research

Answer 56

Descriptive= quantification (often frequency analysis) of body of research. Purpose- what extent does existing literature support or reveal interpretable pattern. Elaborate lit review Vote counting= used for drawing qualitative inferences about a focal relationship. summarize results of studies with frequencies or votes. DOES NOT analyze effect size, uses outcomes of tests of hypotheses reported in individual studies