Exam two Flashcards

1
Q

reliability is

A

consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

how close is an individual’s obtained score to his or her true score

A

we can never get to true score because of error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

true score theory says there is a definite score but we cannot get exactly there ever

A

t

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

the closer a number is to one the stronger the reliability

A

t

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

test-retest reliability

A

t

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

alternate or parallel forms reliability

A

Consistency of results among two or more different forms of a test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

split-half reliability

A

one time administration, one group, measured with spearman brown formula

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

types of reliability

A
  1. test retest
  2. alternate or parallel
  3. split half
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

symbol for reliability

A

Rxx

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

formula for reliability

A

Rxx=S squared over Sx

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

X=T+E

A

observed true score error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

SEM is

A

the standard error of measurement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what is good reliability

A
  1. .9 and greater is excellent
  2. .8 to .89 is good
  3. .70 to .79 is adequate
    4.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

low ESM is good for reliability

A

t

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

reliability means

A

variance found in observed scores is similar to true score variance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

content sampling

A

sampled appropriately from known areas of information

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

time sampling

A

the results will be more similar if the test-retest time is smaller

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

interrater scorer differences

A

comparison of scores between raters

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

factors influencing reliability

A
  1. test length (longer over shorter)
  2. range of scores
  3. test difficulty (too hard, too easy)
  4. speed tests (timed tests) (not good for determing reliability)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

mean

A

X with a bar over it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

variance

A

S squared

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

correlation

A

r

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

summation

A

greek E

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

standard deviation

A

SD or SX

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

SEM and confidence limits

A

if a person gets an 100 on an iQ test and they get a three on the sem we can be confident that it should be close to true, we’ll then take 100 add three for 103 and subtract three for 97 which makes us sure it could be between those two, the less sem there is like 1 or 2 to subtract the more confident you can be .

26
Q

what does an sem of 4 mean

A

add and subtract four from whatever the score is, same with any other number

27
Q

validity 2 and 3 apply the most

A
  1. what trait is measured by the test
  2. what behaviors can be predicted by the test scores
  3. what does the test measure
  4. how well does it measure that attribute
28
Q

validity symbol

A

R squared xy

29
Q

v stands for variance

A

t

30
Q

i stands for invalid variance

A

t

31
Q

formula for validity

A

R squared xy=S squared v /S squared x

32
Q

three types of validity

A
  1. content
  2. criterion
  3. construct
33
Q

content validity

A
  1. how adequately a set of items sample some domain

2. sample of items from some universe of items

34
Q

criterion validity

A
  1. how well a test measures or predicts an outcome
  2. test predicts some kind of behavior
  3. how well the test score correlates with some external behavior
35
Q

content validity is concerned with

A
  1. describe the domain
  2. representative sampling
  3. no content bias (don’t overemphasize some things and neglect others)
36
Q

methods for determining content validity

A
  1. expert judges
  2. pretest-postest
  3. correlate scores from similar tests
  4. develop expert rating scales
  5. face validity
37
Q

what is a criterion

A
  1. standard of mastery

2. measure of success

38
Q

characteristics of a good criterion

A
  1. must be reliable
  2. must be relevant
  3. free of bias
39
Q

how to obtain criterion validity

A
  1. validity coefficient
40
Q

for the .89 and .70 and what not you will sqaure the number and whatever is left out is left out.

A

t

41
Q

how to obtain criterion validity

A
  1. validity coefficient

2. multiple predictors

42
Q

construct validity

A
  1. measure some attribute
43
Q

methods of measuring construct validity

A
  1. internal structure
  2. correlative with another similar measure
  3. discriminate validity (not measuring the quality being looked for)
44
Q

validity range

A
  1. > 35 excellent
  2. .21 to .34 good
  3. > .1 1 to .20 useful
45
Q

item is another word for

A

question on a survey

46
Q

an instrument is another word for

A

survey

47
Q

standardization

A

the process of putting different variables on the same scale.

48
Q

Norms

A

A statistical average is called the norm.

49
Q

Z scores

A

transformation of a raw score to an absolute value score

50
Q

parallel forms

A

differing versions of tests or assessments that contain the same information, only in different order.

51
Q

test-retest

A

Repeatability or test–retest reliability is the closeness of the agreement between the results of successive measurements of the same measure carried out under the same conditions of measurement.

52
Q

K-R 20

A

KR-20/KR-20 are measures of test reliability, Kuder-Richardson Formula 20, or KR-20, is a measure reliability for a test with binary variables

53
Q

Spearman brown

A

is a formula relating psychometric reliability to test length and used by psychometricians to predict the reliability of a test after changing the test length.

54
Q

relationship between reliability and validity

A

reliability is if a result is consistent, validity is if a result is coherent with the test

55
Q

Z score looks like

A

Z=x(with a bar over it)-x/S

56
Q

percentiles

A

each of the 100 equal groups into which a population can be divided according to the distribution of values of a particular variable.

57
Q

quartiles

A

each of four equal groups into which a population can be divided according to the distribution of values of a particular variable.

58
Q

deciles

A

each of ten equal groups into which a population can be divided according to the distribution of values of a particular variable

59
Q

stanine

A

any of the nine classes into which a set of normalized standard scores arranged according to rank in educational testing are divided,

60
Q

group norms

A

informal guidelines of behavior and a code of conduct that provides some order and conformity to group activities and operations

61
Q

developmental norms

A

used to assess whether infants, toddlers, children, and/or adolescents are developing cognitive, communication, motor, socioemotional, and adaptive skills at approximately the same rate as their peers.