module 15

Question 1

• Term that you will use for a measurement device (survey, test, and questionnaire).
• Device being used to gather data.

Answer 1

instrument

Question 2

• Course of action (process of developing, testing, and using the device).
• Refers to the entire process of collecting data in a research investigation.

Answer 2

instrumentation

Question 3

• Whole process of preparing to collect data.
• Involves not only the selection or design of the instruments but also the procedures and the conditions under which the instruments will be administered.

Answer 3

instrumentation

Question 4

Kinds of information researchers obtain on the subjects of their research.

Answer 4

data

Question 5

Obtained by directly or indirectly assessing the subjects of a study.

Answer 5

research data

Question 6

Provided by the subjects of a study themselves.

Answer 6

self-report data

Question 7

Provided by other people about the subjects of a study.

Answer 7

informant data

Question 8

Types of Instruments:

Answer 8

• researcher-completed instrument
• subject-completed instrument
• Education Resources Information Center Database
• Unobtrusive Measure

Question 9

Provide scores that compare individual scores to the scores of an appropriate reference group.

Answer 9

Norm-Referenced Instruments

Question 10

Require no intrusion into the normal course of affairs.

Answer 10

Unobtrusive Measures

Question 11

Based on a specific target for each learner to achieve.

Answer 11

Criterion-Referenced Instruments

Question 12

Measurement Scales:

Answer 12

nominal, ordinal, interval, ratio

Question 13

Uses numbers to indicate membership in one or more categories.

Answer 13

nominal scale

Question 14

Uses numbers to rank or order scores from high to low.

Answer 14

ordinal scale

Question 15

Uses numbers to represent equal intervals in different segments on a continuum.

Answer 15

interval scale

Question 16

Uses numbers to represent equal distances from a known zero point.

Answer 16

ratio scale

Question 17

Ease with which an instrument can be administered, interpreted by the participant, and scored/interpreted by the researcher.

Answer 17

usability

Question 18

Extent to which a concept is accurately measured in a quantitative study.

Answer 18

Validity

Question 19

Important consideration in the choice of a research instrument.

Answer 19

validity

Question 20

Extent to which results permit researchers to draw warranted conclusions about the characteristics of the individuals studied.

Answer 20

validity

Question 21

Types of Validity:

Answer 21

content, construct, criterion

Question 22

It looks at whether the instrument adequately covers all the content that it should with respect to the variable.

Answer 22

content validity

Question 23

Refers to whether you can draw inferences about test scores related to the concept being studied.

Answer 23

construct validity

Question 24

Meaning that the instrument measures one construct.

Answer 24

Homogeneity

Question 25

Occurs when the instrument measures concepts similar to that of other instruments

Answer 25

Convergence

Question 26

Evident when behavior is similar to theoretical propositions of the construct measures in the instrument.

Answer 26

theory evidence

Question 27

• Any other instrument that measures the same variable.
• Correlations can be conducted to determine the extent to which the different instruments measure the same variable.

Answer 27

criterion validity

Question 28

Shows that an instrument is highly correlated with instruments measuring similar variables.

Answer 28

Convergent validity

Question 29

Shows that an instrument is poorly correlated to instruments that measure different variables.

Answer 29

divergent validity

Question 30

Instrument should have high correlations with future criterions.

Answer 30

predictive validity

Question 31

Relates to the consistency of a measure.

Answer 31

reliability

Question 32

A participant completing an instrument meant to measure motivation should have approximately the same responses each time the test is completed.

Answer 32

reliability

Question 33

Reliable instrument is one that gives consistent results.

Answer 33

reliability

Question 34

Attributes of Reliability:

Answer 34

Homogeneity (Internal Consistency)
Stability
Equivalence

Question 35

Assessed using item-to-total correlation, split-half reliability, Kuder Richardson coefficient, and Cronbach’s α.

Answer 35

Homogeneity (Internal Consistency)

Question 36

Tested using test-retest and parallel or alternate-form reliability testing.

Answer 36

stability

Question 37

• Assessed through inter-rater reliability.
• Includes a process for qualitatively determining the level of agreement between two or more observers.

Answer 37

Equivalence