test 3 Flashcards
Operationalization
The process of identifying scale devices that correspond to properties of a concept involved in a research process
Scales
A device providing a range of values that correspond to different characteritstics or amounts of a characteristic exhibited in observing a concept
Correspondence rules
Indicate the way a certain value on a scale corresponds to some true value of a concept (provided by scales)
Ordinal scales
Ranking scales allowing things to be arranged based on how much of some concept they possess (can tell you horses finished 1,2,3. But not by how much time they won by) (rankings)
Interval scales
Scales that have both nominal and ordinal properties. Does not exactly represent a phenomenon (0 means worst performance, 10 Is the best)
Represent by how much one thing finished ahead of another (Shows horse rankings and that the third place horse finished 20 secs behind)
Nominal scales
Represent the most elementary level of measurement in which values are assigned to an object for identification or classification purposes only
Qualitative, and used often by researchers (Football players numbers. Can be anything they want and it does not affect who they are as a player. Its just an identification system)
Ratio Scales
Represents absolute meaning. Represents the highest form of measurement
Attribute
An attribute is a single characteristic or fundamental feature of an object, person, situation, or issue
What is an index measure?
An index measure assigns a value based on how much of the concept being measured is associated with an observation
Often formed by putting several variables together
Composite scales?
Composite scales assign a value based on a mathematical derivation of multiple variables
Summated Scale
A summated scale is created by summing the response to each item making up the composite measure
when is a measure reliable?
when different attempts at measuring something converge on the same result
What is the split half measure?
Measures how reliable a study is.
Take half the items from the scale and checking them against the results from the other half
Test retest method
Measures reliability
involves administering the same scale or measure to the same respondents at two separate times to test for stability
What is validity
the accuracy of a measure or the extent to which a score truthfully represents a concept
Three approaches to establishing validity
- Face (content) - refers to the subjective agreement among professionals that a scale logically reflects the concept being measured
- Criterion - “Does my measure correlate with measures of similar concepts or known quantities?”
- Construct - Exists when a measure reliably measures and truthfully represents a unique concept and consists of several components:
3 components of attitude
- Affective component - expresses how much liking someone has toward the relevant matter
- Cognitive component - represents an individual’s awareness of the relevant matter
- behavioral component - represents the action that corresponds to a certain type of attitude
What are category scales?
Rating scales that consist of several response categories, often providing respondents with alternatives to indicate positions on a continuum. (Very good, good, fair, poor)
Likert scale
Individuals generally choose from approximately five, e.g., “strongly agree,” “agree,” “uncertain,” “disagree,” and “strongly disagree”
Sematic differential
A scale type that has respondents describe their attitude using a series of bipolar rating scales
How does my ding dong make you feel?
Sad * * * * * Happy
Turn off * * * * * Turn on
Constant Sum Scores
respondents are asked to divide a fixed number of points among several attributes to indicate their relative importance
The scale is flawed because the last response is completely determined by the way the respondent has scored the other choices
(picking bowl mania back in the old days)
Graphic rating scales
Respondents are allowed to choose any point on the continuum to indicate their attitude
Given an amount of attributes and move the scale based on what they feel. (Measure the length (in millimeters) from one end of the continuum to the point marked by the respondent
Paired comparisons
the respondents are presented with two objects at a time and asked to pick the one they prefer
Works much better when fewer things are being compared
When are open ended questions useful?
When researcher is gaining exploratory research. Gives person being interviewed a chance to warm up
Fixed alternative responses
give respondents specific limited-alternative responses and ask them to choose the one closest to their own viewpoint
Fixed alternative questions
If a researcher is unaware of the potential responses to a question, fixed-alternative questions cannot be used
Unanticipated alternatives emerge when respondents believe that closed answers do not adequately reflect their feelings
Four types of fixed alternative questions
Simple dichotomy - 2 alternatives
Multiple choice - multiple choices
Frequency determination - asks for an amount of occurrence of something
Checklist - Allows for multiple answers
Things to avoid with questioners
Simpler is better Avoid leading and loaded questions Avoid ambiguity: be as specific as possible Avoid double-barreled items Avoid making assumptions Avoid taxing respondents’ memory
Loaded and leaded questions
leaded questions - Threaten the study’s validity and may promote the bandwagon effect
loaded questions - Certain answers to questions are more socially desirable than others
Avoiding ambiguity
Do not use words such as frequent, often, ready etc because they have different meanings to everyone
Double Barreled Items
A question covering several items at once is referred to as a double-barreled question and should always be avoided
unaided recall questions
Questions that do not give a clue to the respondent to remind them of what product/thing is being talked about
Order Bias
Order bias can result from an alternative answer’s position in a set of answers or from the sequencing of questions
Funnel Technique
helps avoid order bias.
Asks general questions before specific questions to get unbiased results
Survey Flow
Refers to the ordering of the questions
Asking a question that does not apply to the respondent or that the respondent is not qualified to answer may be irritating or cause a biased response or even a survey breakoff
Key advantages of survey Technology
- Response quality
- Timing
- Randomized assignment
Key physical features of survey technology
- Tracking interest - a heat map that tracks the part of an image or advertisement that most capture attention
- Status bar - provides a visual indicator of a questioneers length
- Prompting
- Piping - allows responses to a previous question to be inserted into later questions
Stages in the selection of a sample
- Define target population
- Select sampling frame
- Determine if probability or non probability sampling method will be used
- Plan procedure for selecting sampling units
- Determine sample size
- Select actual sample units
- Conduct fieldwork
Sampling frame
A list of elements from which the sample may be drawn (working population)
errors occur when certain sample elements are excluded or when the entire population is not accurately represented in the sampling frame
Online panels
List of people who have agreed to participate in research.
More specific the profile requested, the more expensive the panel is
Statistical error
a difference exists between the value of a sample statistic and the value of the corresponding population parameter
Random sample error
the difference between the sample result and the result of a census conducted using identical procedures
The greater the sample size, the less the error is
less than perfectly representative
Random sampling errors and systematic errors associated with the sampling process
Probability Sampling vs nonprobability
Probability - Simple random sample is the best-known probability sample
Non prob - Probability of a member of population being chosen is unknown (used in market research)
Convenience sampling
Used to obtain a large number of completed questionnaires quickly and economically, or when obtaining a sample through other means is impractical
Judgement sampling
A nonprobability technique in which an experienced individual selects the sample based on his or her judgment (purposive sampling)
Major advantages of quota sampling (3)
Speed of data collection
Lower costs
Convenience
Snowball sampling
Initial Respondents are gotten by probability methods. From there, additional respondents are obtained from information provided by the initial respondents
This technique is used to locate members of rare populations by referrals
Advantages - sample sizes and reduced costs
Systematic Sampling
An initial starting point is selected by a random process; then every nth number on the list is selected
