Chapter 3.2 Validity and Reliability

Question 1

Researchers have developed two general criteria for evaluating the quaility of any measurement procedure

Answer 1

validity and reliability

Question 2

Validity of a measurement

Answer 2

to establish validity, you must demonstrate that the measurement procedure is actually measuring what it claims to be measured.

Question 3

Face validity

Answer 3

Its the simplest and least scientific definiton of validity. It concerns the superficial appearance, or face value, of a measurement procedure

Question 4

Concurrent Validity

Answer 4

It is demonstrated when scores obtained from a new measure are directly releted to scores of established measure of the same variable. It establishes consistency between two procedures for measuring the same thing.

Question 5

Predictive Validity

Answer 5

When the measurements of a construct accurately predict behavior according to theory, the measurement procedure has predictive validity

Question 6

Construct Validity

Answer 6

If we can demonstrate that measurements of a variable behave in exactly the same way as the variable itself then a measurement procedure has construct validity. It is an ideal state. There is no possibility for a measurement procedure can be established construct validity absolutely because new research results reported everyday.

Question 7

Convergent Validity

Answer 7

It involves creating two different methods of measuring the same construct and then showing that two methods produce strongly related scores. The goal is the demonstrate that different measurement procedures converge- or join on the same construct.

Question 8

Divergent Validity

Answer 8

It involves demonstrating that we are measuring one specific construct and not combining two different constructs in the same measurement process. The goal is the differentiate between two conceptually distinct constructs by measuring both constructs and then showing that there are little or no relationship between the two measurements

Question 9

Reliability of Measurement

Answer 9

A measurement procedure is reliable if the results of the measurements are identical or near identical when we measure repeatedly to the same individual under the same conditions. Inconsistency in a measurement comes from an error. Error can come from a variety of sources: Observer error, Environmental changes, participant changes etc

Question 10

Test-retest reliability

Answer 10

The reliability obtained by comparing the scores of two successive measurements over a time. Or researher may use modified version of the measurement instrument to obtain two different measurements for the same group it is called parallel forms reliability. Computing a correlation to measure the consistency of the relationship between two sets of scores.

Question 11

Inter-rater reliability

Answer 11

When measurements are obtained by direct observation of behaviors, it is common to use two or more separate observers who records measurements. The degree of agreement is called inter-rater reliability

Question 12

Split-half reliability

Answer 12

To measure degree of consistency, researchers commonly split the set of items in half and a compute a separate score for each half. The degree of agreement between two scores evaluated with a correlation.

Question 13

A measure cannot be valid unless its reliable

Answer 13

but a measure can be reliable without being valid.

Question 14

The accuracy of a measurement is the degree to

Answer 14

which the measurement conforms to be established standard.

Question 15

Measurement process can be valid and reliable even if it is not

Answer 15

accurate.

Question 16

Scatter plot

Answer 16

to show amount of consistency between two scores obtained for each person can be presented in a graph called scatter plot.