unit 11: Evaluating Measurements and Data Quality Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

measurement

A

involves rules for assigning numeric values to qualities of objects ti designate the quantity of the attribute
>attributes are not constant
>

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

advantages of measurement

A

it removes the guess work when gathering information
obtain reasonably precise information
measurement is a language of communication
less vague

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

errors of measurement

A

obtained score = true score+/- error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

true score is

A

the true value that would be obtained if it were possible to have an infallible measure of target attribute

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

the error of measurment

A

the difference between true and obtained scores-reflects extraneous factors that affect the measurement and distort the results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

main factors contribute to error measurement

A
>situation contaminants
>response set biases
> transitory personal factors
>administration variation
>item sampling
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

reliability

A

is the consistency with which an instrument measures the attribute

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

stability

A

important factor for stability measures the extent to which the same scores are obtained when the instrument is used with the same people on separate occasions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

test-retest reliabilty

A

assessment of stability researchers administer the same measure to a sample of people on two occasions and then compares the scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

reliability coefficient

A

a numeric index of a measure’s reliability, to objectively determine exactly how small the difference are. (r) range from 0.00-1.00 the higher the # the more reliable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

internal consistency

A

scales that involve summing items usually are evaluated for their internal consistency
>reliability to the extent that all its sub parts measure the same characteristic

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

cronback data/coefficient alpha

A

this method gives an estimate of split-half correlation for all possible ways of dividing the measure into halves, not just odd versus even items

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

equivalnce

A

approach to estimating reliability-used primarily with observational instruments-determines the consistency or equivalence of the instrument by different observers or rater

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

interrater/interobserver reilability

A

degree of error can be assessed, which estimated by having two or more trained observers make simultaneous, independent observation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

interpretation of reliability coefficient

A

are an important indicator of an instrument’s quality,
> reliability estimates vary according to the procedure used to obtain them
>instrument is related to sample heterogeneity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

validity

A

is the degree to which an instrument measures what is supposed to be measuring.
> reliability and validity of an instrument are not totally independent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

face vailidity

A

refers to whether the instrument looks as though it is measuring the appropriate construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

three types of valdility

A

content, criterion, construct

19
Q

content validity

A

is concerned with adequate coverage of the content are being measured
relevant in measuring complex psycho social traits

20
Q

content validity index

A

that indicates the extent of expert agreement, but ultimately the experts’ subjective judgement must be relied on

21
Q

criterion-related validity

A

assessments, researchers seek to establish a relationship between scores on an instrument and some external criterion

22
Q

validity coefficient

A

is a criterion-related validity that computes by using a mathematics formula that correlated scores in the instrument with scores in the criterion variable

23
Q

predictive validity

A

a criterion-related validity that is an instrument’s ability to differentiate between people’s performance or behavior on some future criterion

24
Q

concurrent validity

A

is a criterion-related validity that refers to an instrument’s ability to distinguish among people who differ in their present status on some criterion

25
Q

construct validity

A

is concerned with the following questions: what construct is the instrument actually measuring?
more abstract the more diff to establish a validity of measure
> one approach is known groups technique groups that are expected to differ on the critical attribute are administered the instrument, and group scored are compared
another approach is to construct validation employs a statistical procedure known as factor analysis
employs both logical and empirical

26
Q

interpretation of validity

A

the testing of an instrument’s validity is not proved but rather is supported by an accumulation
>validation is never ending process: the more evidence that can be gathered that an instrument is measuring what is supposed to be measuring, the greater the confidence researcher have in its validity

27
Q

reliability, sensitivity, specificity and validity

A

most important criteria for evaluating quantitative instruments

28
Q

sensitivity

A

is the ability of an instrument to correctly identify a “case” that is to correctly screen in or diagnose a condition

29
Q

specificty

A

is the instrument’s ability to correctly identify non cases, that is, to correctly screen out those without the condition

30
Q

assessment of qualitative data

A
credibility
>prolonged engagement and persistent observation
> triangulation 
>external checks
> searching for dis-confirming evidence
>researcher credibility 
Dependability
confirm-ability
transfer-ability
31
Q

credibility

A

refers to confidence in the truth of the data and interpretation of them
>involves two aspect:
- carrying out the investigation in a way that believably is enhanced
> taking step to demonstrate credibility

32
Q

prolonged engagement and persistent observation

A

is a credibility first and very important step
the investment of sufficient time in data collection activities to have in depth understanding of culture, language, or views of the group under study and to test for misinformation.
building trust and rapport with informants

33
Q

triangulation

A

enhance credibility, refers to the use of multiple referent to draw truthful conclusions
four types of triangulation
-data source triangulation using multiple data sources in a study
-investigator triangulation- using more than one person to collect, analyze or interpret a set of data
-theory triangulation- using multiple perspective to interpret a set of data
- method triangulation using multiple methods to address a research problem

34
Q

external checks

A

peer debriefing and member checks

35
Q

searching of disconfirming

A

is a way to confirm credibility
the search for dis-confirming evidence occurs through purposive sampling but is facilitated through other processes already described, such as prolonged engagement and peer debriefing

36
Q

negative case analysis

A

a process by which researchers revise their hypotheses through the inclusion of cases that appear to disconfirm earlier hypothesis

37
Q

research credibility

A

the faith that can put in the researcher

38
Q

dependability

A

of qualitative data refers to data stability over time and over conditions
one approach is step wise replication-which is conceptually similar to a split half technique, involves having several researchers who can be divided into two teams
another technique relating to dependability is the inquiry audit- a scrutiny of the data and relevant supporting documents by an external reviewer

39
Q

confirmability

A

refers to the objectivity or neutrality of the data, that is, the potential for congruence between two or more independent people about the data’s accuracy, relevance, or meaning.
Inquiry audits- can be used to establish both the dependability and confirmation of the data
audit trail which is a systematic collection of documentation that allows an independent auditor to come to conclusion about the data

40
Q

auditability

A

outside person can follow the researcher’s methods, decisions, and conclusions by maintaining an adequate decision trail

41
Q

decision trail

A

articulates the researchers’ decision rules for categorizing data and making inferences in the analysis

42
Q

transferability

A

refers to the extent to which the findings from the data can be transferred to other settings and is thus similar t the concept of generalizability

43
Q

thick description

A

refers to a rich thorough description of the research setting and if the transactions and processes observed during the inquiry