Research and Assessment Flashcards
What are the three types of research?
1) Qualitative Research
2) Quantitative Research
3) Mixed Methods Research
What is qualitative research?
This type of research looks at characteristics of a population that are not number based, such as culture and social science issues. It can be a written as flexible report, talking about emerging themes.
It’s based on data, interviews, outreach, firsthand observations, and general themes (inductive).
What is inductive reasoning?
This type of reasoning seeks to form a theory based on observations and findings.
It takes specific observations to create a general theory.
(E.g., All tests have been easy so far. Therefore, the next test will be easy.)
What is deductive reasoning?
This form of reasoning seeks to test existing theories or hypothesis to prove it valid/invalid.
It takes a general theory and makes a specific inference from it.
(E.g., All girls like blue. –> Kim is a girl. —> So she likes blue). If this is proven false, the theory is wrong.
What is quantitative research?
This type of research is number-based. It is written in a structured report.
Numerical data is analyzed to explore relationships between variables using statistical procedures (deductive).
What is mixed methods research?
Combines qualitative and quantitative research for a more holistic analysis than using one method alone. Looks as both philosophical and theoretical frameworks.
What is a Case Study Method? Is it qualitative or quantitative?
This research method looks at a specific instance/project/initiative for a detailed examination of it. It can be used as an illustrative example, but it is not used to compare two groups together.
Qualitative
What is a Comparative Analysis? Is it qualitative or quantitative?
This research method compares different variables within the same setting/time frame to see how they are similar/different.
Qualitative
What is a Discourse Analysis? Is it qualitative or quantitative?
This qualitative research method examines verbal, communicative, language, gestures, and written language, and any significant semiotic (signs/symbols) events. It studies how interpretations of the world/society/events/psyche are created based on language/communication.
What are three forms of Discourse Analysis and what are they?
1) Semiotics - studies meaning of symbols
2) Deconstruction - studies relationship between text and meaning
3) Narrative Analysis - Studies stories/interviews/journals to understand chain of events/viewpoints
What is e-Research? Is it qualitative or quantitative?
This form of research examines social interaction in the e-infrastructure. It uses of information technology to support existing and new forms of research.
Qualitative
What is Ethnography? Is it qualitative or quantitative?
This qualitative research methods examines people in their natural setting (think Jane Jacobs). It’s based on firsthand observations of day-to-day activities, interviews, interactions, and exploration within the study area’s natural setting. It examines how things are normally occurring.
What is Field Research? Is it qualitative or quantitative?
This research method requires the person to go into the study area and evaluate their surroundings on a typical day/existing conditions.
Qualitative
What is Grounded Theory? Is it qualitative or quantitative?
This is an inductive reasoning which uses specific data collection and analysis together to create theories based on findings.
Qualitative
What are three steps of Statistical Process?
(1) collect data (e.g., surveys)
(2) describe and summarize the distribution of the values in the data set
(3) interpret through inferential statistics and statistical modeling (i.e., draw general conclusions for the population on the basis of the sample.)
What is NOIR?
NOIR ranks the level of measurement of data types:
Nominal
Ordinal
Interval
Ratio
What is nominal data? Is it qualitative or quantitative?
This data type is categorical (think NAME). Lowest level of measurement.
- Exclusive categories
- Order doesn’t matter
- Qualitative, not numerical (they can be assigned #s but they are only labels)
- Can be categorical or dichotomous (only two values)
- Only central tendency analysis that makes sense is mode
- Can assess frequency and range
Qualitative
What is ordinal data? Is it qualitative or quantitative?
This data type is categorical but has numeric ranking value (think ORDER).
- Difference between categories is unknown, just the order matters
- Zero is arbitrary
- Used to measure attitudes and perceptions
- Likert Scale
- Can be counted and ordered, but not measured
- Can use all nominal data analysis, as well as median, percentile, rank order of coefficients
(e.g., satisfaction level survey ranks 1 to 5, the difference between a level 4 and 5 is not exactly known and may be different to people, we just know that a 5 is more satisfied than 4.)
Qualitative
What is interval data? Is it qualitative or quantitative?
This data type is categorical AND has equal distance between each value (think has a known interval aka distance).
- Difference between values are measurable and equal
- Zero is arbitrary (zero does not mean no value)
- Interval means “space in between”
- Can be negative distance
- All ordinal tests, as well as mean, standard deviation, add/subtract (can’t multiply and divide).
(e.g., temperature, test scores, time, elevation)
Quantitative
What is ratio data? Is it qualitative or quantitative?
This data type is the highest measurement of data (think ratio ends in 0 so there is a zero)
- Zero is absolute, it means none (can multiply/divide)
- The differences are equal and measurable
- All statistical tests are possible
Quantitative
What are qualitative variables?
This type of variable does not have a numeric value. (e.g., household income, level of a pollutant in a river)
What is a quantitative variable?
This type of variable has a numeric value/meaning.
What is a continuous variable?
This type of variable has endless number of values, positive or negative, and can become specific with decimal places.
What is a discrete variable?
This type of variable has a finite number of values, are whole numbers (integers), and cannot be negative. (e.g., number of events, number of people)
What is a dichotomous variable?
This type of variable, also known as binary variable, only has two values. Often coded as 0 or 1. (e.g., yes/no, positive/negative, etc.)
What is a population?
The total of an entity/group.
What is a sample?
A subset of the population. This partial analysis is common in planning due to constraints on getting data on the whole population.
What is Descriptive Statistics?
This describes the characteristics of the distribution of a population or sample.
- Central Tendency: Mode, Mean, Median
- Range of Dispersion: Range, Standard Deviation
(e.g., “on average, AICP test takers in 2018 are 30 years old”). The context will make clear whether the statistic pertains to the population (all values known).
What is Inferential Statistics?
This form of stats uses sample data to draw a conclusion about the entire population.
We determine things about the population based on what is observed in the sample.
For example, we could take a sample of 25 test takers and use their average age to say something about the mean age of all the test takers.
What is distribution?
The overall trend/shape of the data. Can be shown as:
- An ordered table
- Histogram - grouped into bins aka the bars in a bar chart
- Density Plot - a smooth curve
What is symmetry in distribution?
When there is a similar range below or above the mean.
What is skewness in distribution?
When there are more higher or lower values and curve is not symmetrical. Skewed data is undesirable. (think skewed TAIL).
When is data considered Skewed Right?
- Skewed Right = Positive Skew = tail is skewed to the right (curve is shifted left) - more values are above the mean (in the tail)
Mean is higher than the median
When is data considered Skewed Left?
- Skewed Left = Negative Skew = trail is skewed to the left (curve is shifted right) - more values are below the mean (in the tail)
Mean is lower than the median
What is the range of data?
Highest to smallest values
What is kurtosis?
The flatness/peak of the distribution curve.
What does a tall curve mean?
Low level of variance (small range of values).
What does a flat curve mean?
High level of variance among values (wide range).
What is the Gaussian Distribution?
Aka the Normal Distribution, the bell curve is symmetric.
This distribution is symmetric and has the additional property that the spread around the mean can be related to the proportion of observations.
More specifically, 95% of the observations that follow a normal distribution are within two standard deviations from the mean.
What are the types of Central Tendency?
mean, median, and mode
What is a weighted mean?
When greater importance is put on specific values (multiplied).
For example, when computing a measure for the mean income among a number of counties, the value for each county could be multiplied by the number of people of the county, yielding a population-weighted mean.
What is the preferred Measure of Central Tendency to represent data?
Median, outliers can skew mean.
What do Variance and Standard Deviation measure?
They measure how much values are dispersed/spread out from the mean.
What is the difference between Variance and Standard Deviation?
They both measure distribution and are based on the squared difference of the mean, but Standard Deviation is the square root of the Variance to normalize the data (make it the same unit as the original variable).
What is the degree of freedom correction?
This is used when using a sample to estimate the Variance or Standard Deviation. Because a sample of a population has errors and the mean is not exactly known, one is subtracted from the number of instances (n-1) to offset the potential error.
The variance will be slightly larger than when calculated with n.
What is the Coefficient of Variation?
Basically expresses the amount of variation in a dataset as a %.
It’s used to compare different datasets and how varied they are. The lower the better (the less dispersion/variation/risk).
= standard deviation / the mean.
What is a Z-Score?
It basically measures how far a value is “dispersed” from the mean in standard deviation units. There’s a whole chart you use that goes with this.
Z-score = (value - mean) / standard deviation
(e.g., a z-score of more than 2 would mean the observation is more than two standard deviations away from the mean, or, it is an outlier in the sense just defined.)
What is a Hypothesis Test?
A test to reject the null hypothesis or statement about the population.
H<sub>0</sub> = null hypothesis (original theory) H<sub>a</sub> = alternative hypothesis (what you seek to validate by rejected the H<sub>0</sub>)
The alterative hypothesis can be one-sided or two-sided.
What is a one-sided vs. two-sided hypothesis alterative?
Alternative Hypothesis types:
One-sided = can be either larger or smaller than H0 but not both
Two-sided = both directions are considered (larger and smaller)
What is a test statistic?
Is it the process to test the hypothesis test.
A test statistic describes how closely the distribution of your data matches the distribution predicted under the null hypothesis of the statistical test you are using.
What is a sampling error or sampling distribution?
The error from sampling only a portion of the population.
They are the difference between the real values of the population and the values derived by using samples from the population.
What is a systemic error?
It is a model misspecification, which occurs because our model (or assumptions) are wrong. It is unrelated to the sample.