Unit 4

Question 1

Validity

Answer 1

Validity at its broadest is the degree of which the inferences made by a researcher are supported by the evidence collected via the use of a specific instrument.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 2

Reliability

Answer 2

Reliability at the broadest level is the consistency of measurement that is output by an instrument.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 3

Inter-Rater Reliability

Answer 3

This type of reliability is described as the level of agreement reached when observers (must be 2 or more) when the same subject is being examined (independently of each other), using the same protocols or observation procedures. This type of reliability is why it is important for clear guidelines within a research paper, so that replication can occur.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 4

Stability Reliability

Answer 4

This form of reliability occurs after time passes between the use of a given instrument, but the instrument produces similar results or performance when data collection occurs.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 5

Alternative Forms Reliability

Answer 5

Also known as: Equivalent Forms Reliability

This type of reliability is when different versions of the same item or question are used in multiple places or forms within an instrument that produce similar results that are consistent over time.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 6

Test-Retest Reliability

Answer 6

This type of reliability is characterized by respondents having similar results on the same instrument at multiple occasions over a period of time.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 7

Reliability Coefficient

Answer 7

The Reliability Coefficient is the numerical value that expresses the consistency of the results of a given instrument/assessment.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 8

Construct Validity

Answer 8

This looks at the degree of which a selected instrument measures its intended concept or construct. An excellent examples of construct validity are psychological assessments looking at intelligence in standardized formats, like the Weschler Series tests (Weschler Intelligence Scales for Children or Weschler Adult Intelligence Scales).

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 9

Content Validity

Answer 9

This type of validity is used to determine the degree of in which an instrument measures intended subject matter within the content.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 10

Face Validity

Answer 10

This type of validity occurs when an expert reviews and confirms that an instrument measures the construct/concepts it claims to.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 11

Equivalent Forms Reliability

Answer 11

Also known as: Alternative Forms Reliability

This type of reliability is when different versions of the same item or question are used in multiple places or forms within an instrument that produce similar results that are consistent over time.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 12

Criterion Validity

Answer 12

The given degree in which the scores of a given instrument correlate with scores on a similar instrument that looks at a similar phenomenon. An example would be comparing intelligence tests, like the Weschler Intelligence Scales for Children with the similar construct, the Stanford-Binet Test.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 13

Convergent Validity

Answer 13

This is a measurement through the use of established statistical procedures to demonstrate the alignment between similar instruments. One of those instruments must have proven reliability and validity.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 14

Anecdotal Notes

Answer 14

These are informal notes that describe a situation, event or interaction. These observations are normally brief and do not have the depth of a more formalized observation protocol.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 15

Observations

Answer 15

This is a data collection method in which the researcher acts as an observer directly viewing the events that they are interested in within a particular timeframe. This data collection method is very common for those using ethnographic or phenomenological methodologies.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 16

Questionnaires

Answer 16

Also known as: Surveys

This is a data collection tool that does not require face to face interaction between participants and the researcher. This type of tool will usually ask questions or statements that a participant must answer or respond to.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 17

Interviews

Answer 17

This is a direct interaction between the research and the subject. These interactions can be structured, semi-structured or informal.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 18

Journals

Answer 18

This is a written record of thoughts that convey data via the feelings, thoughts, knowledge or observations made within a particular setting. These are a form of primary source document (particularly in historical applications).

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 19

Surveys

Answer 19

Also known as: Questionnaires

This is a data collection tool that does not require face to face interaction between participants and the researcher. This type of tool will usually ask questions or statements that a participant must answer or respond to.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 20

Artifacts

Answer 20

Any item, document or sample that can be collected from a given research project that will be used to document some aspect of said research. For example items like records, assessment data and classroom assignments.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 21

Attitude Scales

Answer 21

A data collection instrument that is utilized to collect the information of participants around their feelings or attitudes in a measurable way.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 22

Ordinal Data

Answer 22

This type of data is placed on a continuum in a specific rank or order.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 23

Ratio Data

Answer 23

This type of data is numerical and has equal units of measure between data points with the presence of a fixed point of data which is also known as the zero score.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 24

Interval Data

Answer 24

This type of data is numeric. It has equal unites of measurement between each data point.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 25

Nominal Data

Answer 25

This type of data can be classified into categories. It is also useful for establishing frequency counts on the number of interactions that occur within a given category.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.

Question 26

Rating Scales

Answer 26

These are data collection instruments that ask questions of participant in order to rank their attitudes or feelings in a standardized measurable unit.

Definition Reference:

Putman, & Rock, T. (2018). Action Research: Using Strategic Inquiry to Improve Teaching and Learning. SAGE Publications, Inc.