U11

Question 1

Measurement

Answer 1

involves rules for assigning numeric values to qualities of objects to designate the quantity of the attribute

Question 2

Errors of Measurement

Answer 2

Even the best instruments have a certain amount of error

Question 3

Calculating Error

Answer 3

Obtained Score = True Score+/- Error

Question 4

Most common factors contributing to Error

Answer 4

situational contaminants
Response set biases
Transitory personal factors
Administration Variations
Item Sampling

Question 5

Reliability

Answer 5

consistency of instrument to measure attributes accurately. 3 Parts:
Stability, Reliability Coefficient and Test-Retest reliability

Question 6

Stability

Answer 6

of a measure is the extent to which the same scores are obtained when the instrument is used with the same people on separate occasions. Assessed through Test-retest reliability procedures

Question 7

Reliability coefficient

Answer 7

a numeric index of a measure’s reliability. Range from 0.00 to 1.00

Closer to 1.00 the more reliable (stable) the measuring instrument

Question 8

Test-retest reliability

Answer 8

the further apart the tests are, the more likely the reliability is to decline.

Question 9

Internal Consistency

Answer 9

for scales that involve summary items, ideally scales are measures of the same critical attribute. Internal consistency reliability is = to the extent that all its subparts measure the same characteristic

Question 10

Split-half technique

Answer 10

scores are separated (positive vs negative), these two scores are used to generate a reliability coefficient. If both are really measuring the same attribute the correlation will be higher

Question 11

Cronbach alpha (Coefficient alpha)

Answer 11

gives estimate of split half correlations for all possible ways of dividing measure into 2 halves. Indexes ranges from 0.00 to 1.00 with closer to 1.00 the more internally consistent the measure.

Question 12

Equivalence

Answer 12

primarily with observational instruments. determines the consistency or equivalence of the instrument by different observers or raters. Can be assessed with the Interrupter Reliability.. estimated by having 2+ observers make simultaneous, independent observations and calculating the differences.

Question 13

Interpretation of Reliability Coefficients

Answer 13

• hypotheses not supported about be d/t unreliability of measuring tool
• a low reliability prevents an adequate testing of research hypothesis
• reliability estimates via different procedures for same instrument are NOT identical
• sample heterogeneity increases reliability coefficient. (instruments are designed to measure differences, also sample homogeneity = decreased reliability coefficient)
• longer instruments (more items) tend to have higher reliability than shorter instruments

Question 14

Validity

Answer 14

degree to which an instrument measures what it is supposed to be measuring
*can have high reliability of instrument with no evidence of validity
(high reliability does not = high validity)
*low reliability IS evidence of low validity
(low reliability = low validity)

Validity coefficient - score greater than or equal to .70 desirable (range .00-1.00)

Question 15

Face validity

Answer 15

wether the instrument looks as though it is measuring the appropriate construct

Question 16

Content Validity

Answer 16

adequate coverage of content area being measured

• crucial in tests of knowledge
• based on judgement

Question 17

Criterion Validity

Answer 17

researchers seek to establish a relationship btw scores on an instrument and some external criterion (if scores correspond the instrument is said to be valid)

Question 18

Construct validity

Answer 18

challenging, what construct is the instrument actually measuring?

Question 19

Interpretation of validity

Answer 19

not an all or nothing characteristic of an instrument.

Question 20

Sensitivity and specificity

Answer 20

Sensitivity is ability of an instrument to correctly identify a case, that is, to correctly screen in or diagnose a condition

Specificity instruments ability to correctly idtenify concusses, that is, to correctly screen out those without the condition.

Question 21

Assessment of qualitative data

Answer 21

Gold Standard criteria for qualitative researchers: to establish trustworthiness of Qualitative date you need Dependability, Credibility, Confirmability and Transferability

Question 22

Credibility

Answer 22

refers to confidence in the truth of data and interpretations of them
To Demonstrate Credibility:
1- prolonged engagement
2 - persistent observation

“If prolonged engagement provides scope, persistent observation provides depth”

Question 23

Triangulation

Answer 23

can increase credibility
*to overcome the intrinsic bias that comes from single-method, single-observer and single-theory studies. more complete and contextualized portrait of the phenomenon under study. 
4 Types of Triangulation:
Data Source 
Investigator
Theory
Method

Question 24

Dependability

Answer 24

data stability over time and over conditions

There can be no credibility in the absence of dependability

Question 25

Confirmability

Answer 25

objectivity or neutrality of the data. Congruence btw 2+ ppl about the datas accuracy, relevance, or meaning

Question 26

Transferability

Answer 26

extent to which findings from data can be transferred to other settings and is thus similar to the concept generalizability.

Question 27

Critiquing data quality

Answer 27

Qual/Quant:

• can I trust the data?
• does the data accurately reflect the true state of the phenomenon?

Quant:

• Reliability and Validity of the measures
• be wary when no info on data quality, or suggest unfavourable reliability/validity
• also wary when hypotheses not confirmed

Qual:
*high alert to info on data quality when only a single researcher collects, analyzes, and interprets all of the data.