measurement

Question 1

define measurement

Answer 1

The act or process of measuring
- An amount, extent, or size
- A system of measures based on a particular standard

Question 2

What are the 2 important steps in measurement?

Answer 2

a. Conceptualization
- Defining abstract ideas with specific characteristics

b. Operationalization
- Specifying how a variable or concept will be measured in a specific study

Question 3

How do you operationalize variables?

Answer 3

putting a variable into valid, precise, and measurable terms.
- Have appropriate codes

Question 4

Define continuous variables

Answer 4

a. Any value is acceptable ( it is not confined to groups)
b. Typically the dependent variable in research design
c. However, independent variables can be dependent as well

Question 5

Define categorical/discrete variables

Answer 5

a. Things that belong in groups
b. Independent variables can be categorical ; dependent variable are usually not

Question 6

What is the general rule of categorization?

Answer 6

a. Quantitative variables fall into one of 4 categories: (NOIR)
i. Nominal
ii. Ordinal
iii. Interval
iv. Ratio

Question 7

What is the purpose of nominal scales?

Answer 7

to assign a label to a variable
i. descriptive
ii. variables are assigned to categories
iii. cannot make inferences on greater or less than

Question 8

What is the purpose of ordinal scales?

Answer 8

suggests a preference (things put in order)
i. ordinal scales are nominal in themselves
ii. magnitude is present (I like x more than y)

1. does not provide much info about how much more or how much less
2. ex. Rank your fav golfer (5 is best)
   - a(1) , b(2), c(3), d(4), e(5)
   a. doesn’t give indication of how much more

Question 9

What is the purpose of interval scales?

Answer 9

assign rank to certain items
i. Contain characteristics of nominal and ordinal
ii. The difference between numerical assignment is meaningful

1. (ex. The difference between 10-20 is 10 but so is the difference between 20-30)
   a. Ex. On a 1-5 scale (5 is best), rank them related to your favorite one
   a(1.5), b(2.3), c(3), d(4.5), e(4.9)

Meaningful difference between ranks

Question 10

What is the purpose of ratio scales?

Answer 10

ranks, but with the inclusion of the absolute zero
i. Zero represents the absence of a trait
ii. Provides meaningful differences
iii. Contains characteristics of other scales

1. Ex. Number of PGA tour wins
   a. Quantify against a value of 0

Question 11

Explain validity

Answer 11

how accurately a method measures what it is intended to measure

Question 12

Explain reliability

Answer 12

consistency of a measurement
i. gives the same result on multiple occasions
ii. need to determine reliability to see how variable result are

Question 13

What are the sub-types of reliability?

Answer 13

a. inter-rater
b. test-retest
c. parallel forms
d. split half
e. internal consistency

Question 14

What are the sub-types of validity?

Answer 14

construct
face
content
criterion

Question 15

Explain inter-rater

Answer 15

comparison of how 2 people rate the same thing

Question 16

Explain test-retest

Answer 16

Individual takes same test at 2 different times
i. Correlate scores
ii. Percent agreement score in categorical data
iii. Significant correlation results in high test-retest reliability
iv. High percent agreement

Important to consider time between tests

Question 17

Explain parallel forms

Answer 17

Use of 2 tests measuring the same thing
i. Compare the results of both tests to see how consistent they are

2 different tests?

Question 18

Explain split half

Answer 18

Divide measure into 2 sections
i. Give participants the half measures
ii. Compare results on both halves

• Useful when you have a longer test
• Also useful when no other measure exists

Question 19

Explain internal consistency

Answer 19

a. Works with items on a test/scale

b. Looks at how unified the items on a questionnaire are
i. You want the items that measure the same construct to be related

c. chronbach alpha coefficients

d. Typically reported in the method section

e. Cut off for reliable scale: >.70

Question 20

How to increase reliability?

Answer 20

a. Increase sample size
b. Eliminate unclear questions
c. Standardize testing conditions and instructions
d. Moderate the degree of difficulty of the tests
e. Minimize the effects of external events
f. Maintain consistent scoring procedures

Question 21

Explain construct validity

Answer 21

a. How well a test measures the concept it was designed to evaluate

b. Making sure the test is measuring the construct it is suppose to
i. Need to consider operational definitions of a concept
ii. Should not measure unrelated constructs
iii. Should be useful in predicting behaviours

c. To establish construct validity:
i. Correlate the new test with established test
ii. Show that people who are different on am of test score differently

Question 22

Explain face validity

Answer 22

Whether a test appears to measure what its supposed to measure
- How the public sees the test
i. Does the participant see the link between the test and what is being measured

High face validity = easily detectable by participant

Question 23

Explain content validity

Answer 23

Assess whether the test is a representative of all aspects of the construct
- Does the test capture all of the behaviours relate to the construct?
i. If it does = high content
ii. If it does not = low content

Question 24

Explain criterion validity

Answer 24

Evaluates how accurately a test measures the outcome it was designed to measure

Question 25

A good test differentiates people based on their ___ ____

Answer 25

true scores

Question 26

A test should measure the ____ and ____ of individual differences

Answer 26

A test should measure the nature and extent of individual differences

Question 27

Why do we test/measure?

Answer 27

a. To help determine outcomes of experiments
b. To diagnose strengths and weaknesses
c. To assist in placing individuals in appropriate programs
d. To assist in selecting applicants
e. To evaluate programs effectiveness

Question 28

What are the 2 types of tests?

Answer 28

a. Standardized
i. Commercially prepared for wide use
ii. Scoring instructions are included

b. Researcher-made
i. Designed by the user for a specific purpose
ii. Scoring instructions are specific to the test

Question 29

What are the 2 achievement tests for referencing?

Answer 29

a. Norm referenced
i. Individuals scores are compared to results from a larger group
ii. Can provide ranks
- Ex. SAT and IQ tests

b. Criterion referenced
i. Individuals scores are compared to defined performance standards
- Performance of others is not applicable
- Ex. Licensing exams

Question 30

What are the 4 data collection methods?

Answer 30

a. Interviews/questionnaires
b. Physiological/biological measures
c. Observational methods
d. Records or available data

Question 31

Explain interviews and questionnaires

Answer 31

Survey, descriptive epidemiological research designs

Interviews
- Data collector questions a subject verbally
- Can be face to face or over the phone
1. face to face
a. Costly
b. Time consuming
c. Fewer respondents
d. Can use illiterate people
e. People may be more willing to cooperate when rapport is established
f. Yield the highest response rates in survey research

2. Phone:
a. Quick
b. Least expensive method
c. Response rate is not as high as face to face but is higher than mailed questionnaires
d. Sampling bias can occur: may exclude people without phones

iii. Questionnaires:
- Paper and pencil and a set of focused questions
- Mail or computer administered
- Grade 3 reading level
a. Does not have a hidden purpose
b. Requests information that respondents presumably have
c. Contains interesting/relevant questions
d. Does not request information that could be obtained by other means
e. Inexpensive
f. Can be sent to a large number of people
g. Allows for complete anonymity
h. No interviewer bias
i. Low response rate compared to interviews
j. Requires literacy

Question 32

What is a likert scale?

Answer 32

a rating scale used to measure opinions, attitudes, or behaviors. It consists of a statement or a question, followed by a series of five or seven answer statements. Respondents choose the option that best corresponds with how they feel about the statement or question (agree / disagree)

To score a likert scale:
i. Items are weighed
ii. Weight of unfavorable items are reversed
iii. Average score is taken

Question 33

What application of testing evaluated validity and reliability of questionnaires?

Answer 33

Psychometrics

Question 34

physiological/biological measurements

pros and cons

Answer 34

use of specialized equipment to determine the physical and biological status of subjects
- chemical (blood glucose)
- physical (weight)
- anatomical (MRI data)

pros:
- objectivity, precision, sensitivity

cons:
- costly, requires specialized training, can affect the variable of interest

Question 35

observational measurements

cautions

Answer 35

watch with a trained eye for certain events/phenomena
primary goal is to record behaviour without interefering with it
may be the only valid way to measure
must be done according to standardized procedures

caution:
- observer effects
- observer bias
- fatigue
- changing definitions

Question 36

records or available data

Answer 36

using existing information and examining it in a new way
access may be difficult
may be a problem with bias

Question 37

dont fit study to _, rather _ to study

1 word

Answer 37

method