measurement terms Flashcards
convergent validity
does it least partially measure the concept
face validity:
does it seem plausible
discrimination validity
distinguish between what you’re measuring and how it is different from something else (i.e. government production speed and effectiveness)
consensual validity
is it broadly accepted (consensus)
correlational validity:
good if you don’t have consensus, for a new measure) does it track with other accepted measures? (think convergent but on a large scale and slightly different)
can statistically compare it to other measures of the same concept withe somewhat similar results, theoretical reason why )
predictive validity:
can we use it to guess things we should be able to (measures say this, does it actually happen. are predictions accurate?) if not its a prob.
ex. of failure: polls and Hillary Clinton
2 major threats of Measurement reliability:
subjectivity: Chile example (instructions and 2 dif. people. person deciding = subjectivity) Desk effect, tests for intercodal reliability, lack of precision : samples are imprecise, build a measure of imperfection of sample into analysis, limits ability to predict but necessary
types of measures
objective, subjective
levels:
binary (0 or 1) dummy variables, interval: counts or continuous (#s most familiar with), ordinal: 1st, 2nd (ranking: ex. warmest, don’t know the difference between each level, just their relevance to others
nominal: can’t do math on: colors, names, variables that are stored and theres distinguishment between them
limitations of data
social desirability bias (racism, truth/lie spinner)
measurement-
assigning #s to phenomena for the purpose of analysis
theories, validity, reliability, types
measurement theories:
need to operationalise concepts (often need multiple measures)
almost always contentious (in political analysis)
usually assumed to contain error.
-more is always better in statistics (multiple indicators)
polity:
how democratic a society is, various measures (minority, contestability of elections)
- people have dif. opinions on what democracy is, how to measure it etc. highly contentious
measurement reliability
do we get hte same measure every time (unless it is actually changed?)
ex. either people or the way it is being measured, measure same thing same way and 2 dif. answers.
objective
(something you can point to that no-one can disagree with. ex) how many people like trump measured by who voted for him. it is an actual number, even if imperfect) vs. subjective (one where someone sits with people and evaluated discussion to determine if they like them or not. v. subjective)
social desirability bias
on’t want to admit they’re racist) so questions may have to lead people to admit it
“the spinner” give everyone a spinner, lie/tell the truth (larger part) is how they answer - compare statistical probability of spinner and compare to responses
how to make frequency distributions
tally observations
define classes
consolidate and display
(use software) (see ex. on chalkboard) (rep w/ -plots (“polygons”), histograms , and cumulative frequency polygons
(plot classes on bottom and # of distrib. / frequency on side)
Measures of Central Tendency
values indicating where in the range the data tends to be
mean = average value
median= middle value
mode=most frequent value
Mean= (sum of all observations)/(# of observations)
can take unrealistic values (1.7 kids)
skewed BY OUTLIERS (CEO salaries)
not apporpriate for some variables
median (middle value)
-value of whatver the middle observeation in the range is
if range is even, take mean of 2 middle observations
-unlike mean, it is NOT WARPED BY OUTLIERS
-usually doesn’t take on unrealistic values
-may not mean much if data is multi modal
Mode- occurs most frequemment
can have more than one mode
- often helpful to relax specificity of “most frequent”when discussing multimodal data and/or data with a wide range of values
- not very useful if data is evenly distributed
kurtosis
(tailedness)- more of data resides within tails
can calculate these with software