Reliability and Validity

Question 0

Internal consistency

Answer 0

Degree of relationship among items and overall test

Test scores should reflect performance on individual items within test

Question 1

Reliability

Answer 1

Repeatability of measurement
Accuracy with which a sample of language at one time represents performance at a different time
Consistency and accuracy !

Question 2

4 types of reliability

Answer 2

Test retest
Rater reliability
Parallel form
Internal consistency

Question 3

Test retest reliability

Answer 3

Administer same test with time inbetween - determines relationship of scores and measures stability of test

Question 4

Rater reliability

Answer 4

Level of agreement among individual ratings

Inter - more than 1 person

Intra - one examiner compares

Question 5

Parallel form of reliability

Answer 5

2 forms of instrument measures same thing (form a and form b of a test)

Question 6

Internal consistency reliability

Answer 6

Parts of test measure what whole test should measure

1) split half : compare first half scores to second half
2) odd even : compare odd answers to even answers

Question 7

Validity

Answer 7

Effectiveness of a test in representing, describing or predicting an attribute of interest

Test is assessing what it intends to assess

Question 8

4 types of validity

Answer 8

Criterion
Content
Construct
Face

Question 9

Criterion validity

Answer 9

Established by use of external criterion

comparing to external standard of truth

Question 10

Content validity

Answer 10

Completeness of test

Tasks involved should correlate with what you’re assessing

Question 11

Construct validity

Answer 11

Measures theoretical construct that it is designed to measure
Evaluated quantitatively
Research and theories

Question 12

2 problems with content validity

Answer 12

Relevance - certain aspect of language is defined

Competence - child’s knowledge of language (effected by speed of responding and task complexity)

Question 13

How to increase reliability

Answer 13

Define behaviors to be observed as explicit as possible

Make judgements on only one behavior at a time

Don’t make summation judgements while observing online

Question 14

Threats to validity

Answer 14

1) productivity: amount produced (language sample)
2) intelligibility: amount understood by listener
3) representativeness: sample should represent a child’s typical behavior
4) reactivity: response of child to differing stimuli

Question 15

Concurrent validity

Answer 15

New/untested measure compared with widely accepted tests

Question 16

Predictive validity

Answer 16

Test used to predict likely performance in some other place/time/task

Question 17

Face validity

Answer 17

Match between the intended purposes and content

Common sense of test