module 15 Flashcards
- Term that you will use for a measurement device (survey, test, and questionnaire).
- Device being used to gather data.
instrument
- Course of action (process of developing, testing, and using the device).
- Refers to the entire process of collecting data in a research investigation.
instrumentation
- Whole process of preparing to collect data.
- Involves not only the selection or design of the instruments but also the procedures and the conditions under which the instruments will be administered.
instrumentation
Kinds of information researchers obtain on the subjects of their research.
data
Obtained by directly or indirectly assessing the subjects of a study.
research data
Provided by the subjects of a study themselves.
self-report data
Provided by other people about the subjects of a study.
informant data
Types of Instruments:
- researcher-completed instrument
- subject-completed instrument
- Education Resources Information Center Database
- Unobtrusive Measure
Provide scores that compare individual scores to the scores of an appropriate reference group.
Norm-Referenced Instruments
Require no intrusion into the normal course of affairs.
Unobtrusive Measures
Based on a specific target for each learner to achieve.
Criterion-Referenced Instruments
Measurement Scales:
nominal, ordinal, interval, ratio
Uses numbers to indicate membership in one or more categories.
nominal scale
Uses numbers to rank or order scores from high to low.
ordinal scale
Uses numbers to represent equal intervals in different segments on a continuum.
interval scale
Uses numbers to represent equal distances from a known zero point.
ratio scale
Ease with which an instrument can be administered, interpreted by the participant, and scored/interpreted by the researcher.
usability
Extent to which a concept is accurately measured in a quantitative study.
Validity
Important consideration in the choice of a research instrument.
validity
Extent to which results permit researchers to draw warranted conclusions about the characteristics of the individuals studied.
validity
Types of Validity:
content, construct, criterion
It looks at whether the instrument adequately covers all the content that it should with respect to the variable.
content validity
Refers to whether you can draw inferences about test scores related to the concept being studied.
construct validity
Meaning that the instrument measures one construct.
Homogeneity
Occurs when the instrument measures concepts similar to that of other instruments
Convergence
Evident when behavior is similar to theoretical propositions of the construct measures in the instrument.
theory evidence
- Any other instrument that measures the same variable.
- Correlations can be conducted to determine the extent to which the different instruments measure the same variable.
criterion validity
Shows that an instrument is highly correlated with instruments measuring similar variables.
Convergent validity
Shows that an instrument is poorly correlated to instruments that measure different variables.
divergent validity
Instrument should have high correlations with future criterions.
predictive validity
Relates to the consistency of a measure.
reliability
A participant completing an instrument meant to measure motivation should have approximately the same responses each time the test is completed.
reliability
Reliable instrument is one that gives consistent results.
reliability
Attributes of Reliability:
Homogeneity (Internal Consistency)
Stability
Equivalence
Assessed using item-to-total correlation, split-half reliability, Kuder Richardson coefficient, and Cronbach’s α.
Homogeneity (Internal Consistency)
Tested using test-retest and parallel or alternate-form reliability testing.
stability
- Assessed through inter-rater reliability.
- Includes a process for qualitatively determining the level of agreement between two or more observers.
Equivalence
