Measurement Flashcards

1
Q

What are the ordinary concerns of measurement in business?

A
  • Ensuring the units/individuals work on their Key Result Areas (KRA), where performance is measured using Key Performance Indicators (KPI)
  • Securing that members possess and develop behaviours and competencies, or knowledge, skills, abilities and other characteristics (KSAOs)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is measurement?

A

Measurement in the process of assigning numbers to objects in such a way that specific properties of objects are faithfully represented by the properties of numbers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is operationalisation?

A
  • The process of defining concepts into measurable factors

- The definition of a concept will affect the way we measure it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the different types of scales?

A
  • Nominal Scale
  • Ordinal Scale
  • Interval
  • Ratio
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are nominal scales?

A
  • Categorical with no inherent order
  • Assigns a value to an object for identification or classification purposes only
  • Arbitrary scaling - each value can be assigned to any of the categories - size of the number tells nothing about the objects being measured
  • Analysis involved counting and determining modal distribution
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are ordinal scales?

A
  • Categorical with an inherent order/ranking
  • Allows things to be arranged in order based on how much of some concept they possess
  • Does not tell how close or far apart the objects are from each other
  • Analysis can involve counting, measures of central tendency (mode, median and range)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are interval scales?

A
  • Indicates difference in values between points with no 0 point, therefore cannot say anything is double anything else etc
  • Have both nominal and ordinal properties, but they also capture information about differcens in quantities of a concept
  • Unit of measurement is arbitrary - scale does not exactly represent some phenomenon. Zero does not mean absence of the characteristic
  • Temperature in F - 40 isn’t ‘double’ as hot as 20
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are ratio scales?

A
  • Interval with an absolute zero
  • Has all the properties of interval scale with an additional attribute of representing absolute quantities. Zero represents an absence of a concept
  • Represent absolute meaning
  • Analysed through counting, central tendency, variance and dispersion
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What types of measures are there?

A
  • Discrete measures
  • Continuous measures
  • Index measures
  • Composite measures
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are discrete measures?

A
  • Those that only take one of a finite number of values
  • Most often used to represent a classification variable
  • Nominal or ordinal measures
  • Only statistical measure possible is the mode
  • e.g. marital status, gender, ethnicity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are continuous measures?

A
  • those that reflect the intensity of a concept by assigning values that can take on any value along some scale range
  • Mean and dispersion can be measured
  • i.e ratio measures
  • e.g. income, age
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are index measures?

A
  • An index assigns a value based on how much of the concept being measured is associated with an observation
  • Often are formed by putting several variables together
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are composite measures?

A
  • Assign a value to an observation based on a mathematical derivation of multiple variables
  • Summated scales
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are summated scales?

A
  • Composite measures

- Reverse coding - deducting a variables instead of summing it where appropriate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the measures of the quality of measures?

A
  • Reliability
  • Validity
  • Sensitivity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

When is a measure reliable?

A
  • A measure is reliable when it is accurate and different attempts at measuring something converge on the same result
  • Scores vary because of variability in true scores or variability due to measurement errors
  • If errors are responsible for much of the variability in the observed variance in test scores, they will be unreliable
17
Q

What are sources of systematic error?

A
  • Test characteristics and assessment conditions
  • Perceptual errors
  • Deliberate distortion & demand characteristics
  • Characteristics of the test taker
18
Q

What test characteristics and assessment conditions might cause systematic error?

A
  • Poor test items
  • Poor comprehension of test instructions
  • Freedom from distractions
  • Adherence to time limits
19
Q

What is the goal in estimating reliability in measures?

A

Goal is to determine how much of the variability in test scores is due to errors in measurement

20
Q

How can measure reliability be estimated?

A
  • Alternate Forms
  • Test-retest
  • Internal consistency tools
21
Q

How are alternative forms used to establish the reliability of a measure?

A
  • More than one form of a test to measure the same concept is run
  • Forms are administered to different groups to determine reliability coefficient, the extent to which the scores across the forms correlate
  • Alternate test forms are difficult to develop and expensive to administer
  • Difficult to establish that the measures are parallel
22
Q

How is test-retest used to establish the reliability of a measure?

A

A questionnaire is used in a pilot test, then later, the same test is repeated and compared for consistency; administering the same scale or measure to the same respondents at two separate points in time to test for stability

23
Q

What are the problems with using test-retest to establish reliability of a measure?

A
  • Sensitised respondents
  • Attitude change or maturation of subjects
  • Time consuming
  • Costly
24
Q

How are internal consistency tools used to establish the reliability of a measure?

A
  • Looks at the inter-correlations among items

- Internal consistency represents a measure’s homogeneity

25
Q

What are the two steps to internal consistency tools in measuring reliability of a measure?

A
  • Split half method
    • Method of assessing internal consistency by checking the results of one half of a set of scaled items against the results from the other half: used to test equivalence reliability
  • Coefficient alpha
    • Compute the average of all possible split half reliability for a multiple item scale where the coefficient demonstrates whether or not the different items converge
    • Represents the average of all possible split-half reliabilities for a construct
    • 0.85-0.95 is very good reliability
26
Q

How is validity related to measures?

A
  • Of measurement
    • The extent to which a measure represents the intended concept
  • Of decisions
    • The extent to which a measure can predict outcomes
27
Q

What forms of validity are there in regard to measures?

A
  • Face
  • Content
  • Criterion
  • Construct
28
Q

How does face validity relate to the quality of a measure?

A
  • A scale’s content logically reflects what was intended to be measured
  • Relies on census among experts that test items match definition
  • On the surface the scale or test measures what it is supposed to measure
29
Q

How does content validity relate to the quality of a measure?

A
  • Ensures that the scale includes an adequate and represenative set of items that tap a concept
  • The degree that a measure covers the breadth/domain of the concept
  • Refers to how representative the measures are of the construct domain
30
Q

How does criterion validity relate to the quality of a measure?

A
  • The ability of the measure to correlate with established criteria
  • How well does the measure work in practice? Is it practical?
  • Is established when the measure differentiates individuals on criteroin it is expected to predict
  • Represents measures of the outcomes that decisions are designed to produce, and thus the validity of the decisions
  • Classified into either concurent or predictive validity,
    distinguished based on time dimension
31
Q

How does construct validity relate to the quality of a measure?

A
  • The ability of a measure to reliability measure and truthfully represent a unique concept
  • Refers to whether a test provides a valid measure of a specific attribute or concept
  • Testifies to how well the result obtained from the use of the measure fit the theories around which the test is designed
  • Consists of face, content, criertion, convergent and discriminant (independent) validity
32
Q

What is sensitivity in regard to the quality of a measure?

A
  • Refers to an insturments ability to accurately measure variability in a concept
  • Increased by adding more response points or items