Methodology

Question 1

Validity

Answer 1

measure what it is intended to

Question 2

Reliability

Answer 2

likelihood to get the same or similar scores across multiple instances of measurement of some variable.

Question 3

Inter-rater reliability

Answer 3

describes the situation where the observations produce the same or similar codes and themes within the analysis of qualitative sources of data.

Question 4

reliability coefficient

Answer 4

reliability associated with quantitative measures is expressed as a decimal,

Question 5

Construct validity

Answer 5

an instrument measures an intended concept or construct.

Question 6

content validity

Answer 6

instrument measures the intended subject matter of the content and takes into account all aspects of a situation.

Question 7

criterion validity

Answer 7

degree that scores on an instrument correlate with scores on a similar instrument measuring the same or similar construct

Question 8

Stability reliability

Answer 8

represents similar performance when data collection using the instrument occurs on different occasions (separated by an adequate amount of time).

Question 9

Equivalent (or alternative) forms reliability

Answer 9

involves using forms of the test that contain different versions of the same items with the results on the two forms consistent over time.

Question 10

Test–retest reliability

Answer 10

represents consistency in scores when respondents complete the test on multiple occasions over a period of time

Question 11

Face validity

Answer 11

involves the examination of an instrument to determine if it measures what it says it is supposed to.

Question 12

Convergent validity

Answer 12

focused upon using statistical measures (correlation) to show that your instrument is well aligned with another instrument that has already proven reliable.

Question 13

anecdotal notes

Answer 13

observations but are usually shorter episodes where the teacher quickly jots a few notes about a student or situation.

Question 14

observations

Answer 14

record exactly what is happening in a specific context within a specified timeframe.

Question 15

Interviews

Answer 15

an opportunity to speak with participants directly

Question 16

Journals

Answer 16

written records that convey data relative to specific attributes within a particular setting context

Question 17

Surveys

Answer 17

represent tools for systematic data collection that do not provide any face-to-face contact with the participants

Question 18

artifacts

Answer 18

school records, assessment data (standardized and teacher-created), and classroom artifacts.

Question 19

attitude scales

Answer 19

offer the researcher the opportunity to collect information on participants’ feelings, attitudes, or evaluations in a measurable unit

Question 20

Nominal data

Answer 20

information that can be classified into categories and that allows the researcher to provide frequency counts of the number of cases that fit into a particular category.

Question 21

ordinal data

Answer 21

involve measurement on a continuum, whereby a rank (order) is indicated.

Question 22

interval data

Answer 22

improve upon the ranks provided by ordinal scales, as within interval data we have the ability to “see” differences, as there are equal units of measure between data points.

Question 23

ratio data

Answer 23

represent the most effective measurement, as this form of data has the properties of interval but also includes a point of origin (or zero score)

Question 24

rating scales

Answer 24

advantageous due to the efficiency and ease of collection.