Midterm 1 Flashcards

1
Q

Advantages of open questions

A

respondents can answer in their own terms
allows unusual answers
allows tapping into participant’s knowledge
good for exploring new areas

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

disadvantages of open questions

A

time consuming to record/code
length may put respondents off
inaccuracies in transcription of spoken answers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

coding, and the types of coding

A

deriving themes/categories of behaviour. researcher usually assigns number to code
allows information to be coded quantitatively
–> pre coding and post coding

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

post coding

A

going back to info to look for incidences of theme or category, may be unreliable because of inconsistencies in judgement from different coders

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

pre coding

A

when researcher designs coding grame before administering the survey

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

3 basic principles of coding

A

categories are mutually exclusive
categories are exhaustive (including “other”)
clear rules regarding how codes are applied (ensuring consistency)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

advantages of closed questions

A
easy to process
easy to compare
set of answers help clarify the meaning of the question
quick and easy to complete
reduces risk of bias from recorder
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

disadvantages of closed questions

A

answers lack authenticity/spontaneity
care needs to be taken to prevent overlap in categories
difficult to make answers exhaustive
irritates respondents when answer categories aren’t relatable
reduces conversation/rapport in interviews

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

types of questions

A
  • personal factual questions (age, occupation, how often do you go to the movies? etc. often have to rely on memory to answer)
  • factual questions about entity or event (good when info isn’t available elsewhere, leads to problems because people aren’t careful/systematic observers)
  • questions about beliefs (should Canada maintain military presence abroad?)
  • questions about attitudes (common in structured interviews/questionaires, Likert scale is common)
  • questions about knowledge (who was Canada’s first prime minister?)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

general rules for designing questions

A
  • keep research question in mind (reduces risk of asking irrelevant questions)
  • being specific (what exactly do you need to know?
  • recognize ambiguity (how would you answer it?)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what does it mean to avoid ambiguity?

A
  • avoid “often” and “regularly” as measures of frequency

- clarify words that mean different things to different people (ex: dinner)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what does it mean to avoid long questions?

A

-long questions may be nice for questions asking about behaviour, the longer they take to answer, the more it may facilitate memory recall

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what does it mean to avoid double-barrelled questions?

A

ex: how frequently do you cook and clean? respondent may cook but never clean

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what does it mean to avoid general questions?

A

.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what does it mean to avoid leading questions?

A

.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what does it mean to avoid questions that ask several questions

A

ex: who did you vote for in the 2011 federal election? should be did you vote in the 2011 federal election? if yes, which party did you vote for?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

what does it mean to avoid negatives?

A

confusion can lead to innaccurate answers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

what does it mean to minimize technical values?

A

.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

what does it mean to ensure respondents have requisite knowledge?

A

-if respondents do not know about topic, answers won’t be meaningful

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

what does it mean to ensure symmetry between question and answer set?

A

ex: do you believe in God? strongly agree, agree, disagree, strongly disagree

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

what does it mean to ensure answer set is balanced?

A

equal number of positive responses to negative responses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

what does it mean to not overstretch people’s memories?

A

ex: how many times do you drink in a year? vs how many times do you drink in a week?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

what does it mean to provide “don’t know” options?

A
  • avoids forcing expression of views that aren’t held
  • allows out for those too lazy to do thinking (lower education, later questions in survey are more likely to utilize ‘don’t know’ option
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

what does it mean to consider question order?

A
  • all respondents should receive questions in the same order?
  • researchers should be sensitive to possible effects of order
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

tips on question order

A
  • general questions before specific questions (if specific is before general, aspects of specific answer may be omitted from answer for general because it has already been addressed)
  • opinions/attitudes before behaviour/knowledge (ex: spouse reports doing 20% of housework, influences question ‘is housework shared equally?’)
  • early questions should be related to announced topic
  • important/meaningful questions early to stimulate interest
  • questions that cause embarrassment/anxiety go at the end but not the very end or else the interview will leave a negative impression
  • personal questions that are apparently irrelevant to research question go at the end
  • long questions should be grouped by topic
  • if respondent answers something that will be asked later in the interview, still ask the question because answer might’ve changed
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

vertical vs horizontal answers

A
  • vertical reduces likelihood of confusion

- vertical clearly distinguishes answers from questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

vignette questions

A

-a form of closed question used to examine ethical standards and beliefs by presenting scenario(s) and asking how participants would respond

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

advantages of vignette questions

A
  • anchors responses in realistic scenario, reduces unreflective reply
  • because vignette is about other people, allows for distance between question and respondent, leading to more candid replies
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

disadvantages of vignette questions

A
  • impossible to establish assumptions made by respondent about the scenario
  • difficult to establish how far from respondent’s normative views (ie what people say they’ll do and what they do are different)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

pilot studies

A
  • pilot study cannot use members of sample in true study
  • if study will use closed questions, open questions can generate closed answers
  • can help develop interviewer’s confidence
  • helps identify unuseful question, highlights needed modifications
  • flags questions that make respondents bored/uncomfortable
  • identifies questions most often skipped
  • determines adequacy of instructions
  • offers opportunity to evaluate overall flow
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

using existing questions

A
  • already piloted, tested for reliability/validity
  • allows for comparisons to other research
  • provide insight on best way to approach research
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

the main steps in quantitative research

A

theory, hypothesis, research design, devising measures of concepts, select research site, select research subjects/respondents, administer research instruments/collect data, process data, analyze data, findings/conclusions, write up findings/conclusions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

concept

A

ideas or mental representations of things

  • building blocks of theory
  • represents points around which social research is conducted
  • categories for organization of ideas/observation
  • concept can be interdependent or dependent variable, descriptive or comparative
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

independent variable vs dependent variable

A

something to be explained vs possible explanation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

concept can be descriptive or comparative

A

changes in amount of social mobility in Canada over time vs variations among comparable nations in levels of social mobility

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

why measure concepts?

A
  1. allows for delineation of fine differences between people in terms of characteristic in question (it’s harder to recognize fine distinctions than extreme differences)
  2. Provides consistent device for gauging distinctions (measure’s results shouldn’t be affected by time/person administering the measure)
  3. Provides basis for estimates of the nature/strength of relationship between concepts
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

Indicators

A

stand for or represent concept, necessary to measure concepts (can be indirect, for example absenteeism as an indicator for low job satisfaction)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

two types of definitions of concepts in quantitative research

A
  1. nominal; describes in words like dictionary (crime is any violation of the Criminal Code of Canada)
  2. operational; spells out operations that will be performed to measure concept (to measure crime, this researcher will use statistics provided by police force)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

ways to devise indicators

A

through questions part of the interview/questionnaire (respondents attitudes, personal experiences, behaviours, etc)
developing criteria for classifying observed behaviour (pupil behaviour in classroom)
through use of official statistics (stats canada)
developing classification schemes to analyze written data (analysis of how newspapers characterize sex workers)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

using multiple-item measures in survey research

A

single indicator may misclassify some individuals if wording leads to misunderstanding of meaning
single indicator may not capture all meaning in underlying concept
multiple indicators allow for finer distinctions and sophisticated data analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

reliability

A

concerned with consistency of measures by looking at stability over time, internal reliability, and inter-observer consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

stability over time

A
  • whether results fluctuate as time progresses, assuming that thing being measured isn’t changing
  • most thermometres have this reliability
  • test using Test-retest method
43
Q

internal reliability

A
  • aka consistency
  • multiple measures administered in one sitting should be consistent
  • cronbach’s alpha coefficient
  • split half method
44
Q

cronbach’s alpha coefficient

A

commonly used test in which 1 is perfect internal reliability and 0 is no internal reliability, and .8 is typically considered minimum acceptable level

45
Q

split half method

A

indicators divided into two halves, respondent’s scores should correlate, in which 1 is perfect internal reliability and 0 is no internal reliability

46
Q

inter-observer consistency

A
  • judgements between several researchers in activity involving subjective judgement
  • ex: classifying and categorizing open answers
47
Q

measurement validity

A

whether indicator accurately/properly gauges concept

-face, concurrent, construct, convergent

48
Q

face validity

A

measure appears to reflect concept, essentially intuitive process

49
Q

concurrent validity

A

examining when criterion differs from case to case
-ex: when measuring absenteeism as indicator for low job satisfaction, lack of absenteeism should be seen in those with high job satisfaction

50
Q

construct validity

A

whether concepts relate to each other in a way consistent to what their theories would predict
ex: routine jobs should have lower job satisfaction than jobs with varied activities. if the routine jobs are found to have equal job satisfaction as complex jobs, it lacks construct validity. Either measure was invalid, deduction was misguided, or theory needs revision

51
Q

convergent validity

A
  • validity should be gauged through comparison to other measures of same concept developed through different methods
  • ex problem with convergent approach: measuring crime though police reports or victimization surveys
52
Q

which validities are more important?

A

face and internal are usually the only ones tested

53
Q

if measure is not reliable ….

A

it cannot be valid

54
Q

goal of quantitative researchers

A

to understand social order by making sense of phenomena and evaluate theories and interpretations

55
Q

establishing causality

A

describing why, not just how

good quantitative research inspires confidence in researcher’s causual inferences

56
Q

generalization of findings

A

sample must be as representative as possible in order to be confident results are not unique to the sample
probability sampling largely eliminates bias through random sampling

57
Q

critiques of quantitative research

A
  • fails to distinguish people from ‘world of nature’ (some claim science is only applicable to entities/processes that lack self-reflection)
  • measurement process produces false sense of precision/accuracy
  • reliance on procedure creates disjuncture between research and everyday life (relates of external validity, difference between what people do/say they’ll do)
  • analysis of relationship between variables promotes view of social life as remote from everyday experiences
  • explanations for findings may not be empathetic (ex: poor inner city areas see more unwed mothers with children because women are marrying later in life instead of marriage losing its popularity)
  • assumption of objectivist ontology (assumes reality exists)
58
Q

document

A

can be ‘read’, was not produced for social research

  • analysing documents is unobtrusive and non-reactive
  • removes threat of validity
59
Q

4 criteria for assessing quality of documents

A
  1. Authenticity (genuine and unquestionable origin?)
  2. Credibility (free from error and distortion)
  3. Representativeness (typical of time/place? extent of uniqueness?)
  4. Meaning (clear and comprehensive?)
60
Q

diaries, letters, autobiographies

A
  • often used by historians, not social researchers
  • written by purported author?
  • people who are aware of an audience may not reveal everything on paper (what people don’t write can be of significance)
  • who was able to record/write/read?
  • what has been damaged/destroyed?
61
Q

3 types of household photograph

A

idealization (formal portrait)
natural portrayal (informal snapshot)
demystifcation (subject in atypical, often embarrassing situation)

62
Q

government documents

A

authentic, have meaning

perhaps not credible

63
Q

advantages of secondary analysis

A
  • saves costs and time
  • high quality data (sampling procedures are usually rigorous, often national scope, generated by highly experienced researchers)
  • opportunities for longitudinal analysis
  • subgroup analysis (when samples are large)
  • opportunity for cross-cultural analysis
  • more time for data analysis
  • reanalysis can offer new interpretations
  • wider obligations of social researcher (social research is chronically underanalyzed)
64
Q

disadvantages of secondary analysis

A
  • lack of familiarity with data
  • complexity of data
  • ecological fallacy (occurs when you make conclusions about individual based on analyses of group data)
  • no control over data quality
  • absence of key variables
65
Q

advantages and disadvantages of official statistics

A
  • often based on whole populations rather than samples
  • problem of reactivity is less pronounced
  • possible to chart trends over time
  • but records only those processed by stats collectors (consider crime/suicide rates)
66
Q

unobtrusive method

A

removes observer from behaviour under study
-studying physical traces (like grafitti, paper trail of finance), archive materials (data form governments and ngos), and simple observation (observer has no control over behaviour)

67
Q

types of variables

A

nominal, ordinal, interval/ration

68
Q

nominal variables

A
  • aka categorical, composed of categories with no relationship except that they are different
  • order of categories is arbitrary
69
Q

ordinal variables

A
  • categories that can be ranked
  • can be described as
  • likert scale is common
  • difference between categories is not necessarily equal
  • no unit to measure
70
Q

interval/ration variables

A
  • can be measured by unit
  • difference between categories is equal
  • can have 0 value
  • can be ranked
71
Q

frequency tables

A

provides number and percent of subjects belonging to each category of variable

72
Q

measures of central tendency

A

mean, median, mode; provides typical score in one number

73
Q

mode

A

value that occurs most frequently, applicable to all types of variables, especially nominal data

74
Q

median

A

mid point of scores, if there is an even number of scores the median is the mean of the middle 2 values. applicable to interval/ration and ordinal variables

75
Q

mean

A

average, vulnerable to outliers

76
Q

range

A

difference between the highest and lowest value, vulnerable to outliers

77
Q

standard deviation

A

variation around the mean, vulnerable to outliers

work out the general mean, subtract the mean from every value, square every value, then find the mean of those values

78
Q

bivariate analysis

A

examines relationship between 2 variables, esp through use of contingency tables

79
Q

pearson’s r

A

statistic used to examine relationship between 2 interval/ratio variables
the relationship must be broadly linear

80
Q

statistical significance

A

indication of risk of genralizing sample statistic to population
set up null hypothesis, establish acceptable level of statistical significance, determine statistical significance, decide whether or not to reject the null

81
Q

two types of error

A

type I - true null was rejected

type II - false null wasn’t rejected

82
Q

chi-sqaure test

A

applied to contingency tables

  • measure of likelihood that relationship between variables in sample will also be found in population
  • large chi-square to reject null hypothesis, larger n makes this easier
83
Q

spurious relationship

A

when relationship appears to exist but isn’t real

84
Q

intervening variable

A

suggests relationship between 2 variables is not direct

85
Q

prominent sources of error

A
  • poorly worded questions
  • interviewer error in asking question
  • interviewee misunderstanding question
  • interviewer lapses in memory
  • interviewer error in recording answer
  • mistakes entering data into computer
  • bias caused by innate characteristics of interview(er/ee)
  • intra-interviewer variability
  • inter-interviewer variability
86
Q

advantages of phone surveys

A
  • cheaper and quicker
  • easier to supervise
  • confidentiality is not as much of an obstacle
  • reduces bias because interviewer and interviewee can’t see each other
87
Q

disadvantages of phone surveys

A
  • can only reach those with listed phone number
  • hard to communicate with hearing impaired
  • cannot be sustained for long times (
88
Q

advantages and disadvantages of computer assisted interviewing

A
  • good for filter questions
  • good for randomizing order
  • loss of sponteneity
  • lack of rapport/commitment/motivation
89
Q

research driven diaries

A

record of feelings/actions shortly after they occue

90
Q

advantages and disadvantages of research driven diaries

A
  • accurate data
  • expensive
  • attrition
  • details may not be recorded quickly enough
91
Q

advantages of questionnaires

A
  • cheaper
  • quick
  • easier
  • absence of interviewer effects
92
Q

disadvantages of questionnaires

A
  • cannot explain question
  • greater risk of missing data
  • cannot probe
  • difficult to ask a lot of questions
  • questionnaire can be read as a whole
  • cannot verify who took the survey
93
Q

problems with respondents

A
  • acquiescence (agreeing just to please the interviewer, ex: bodychecking should be banned from hockey)
  • social desirability
  • laziness/boredom
94
Q

sampling

A

the selection of individuals/units of analysis

95
Q

sampling frame

A

list of elements from which sample is chosen

96
Q

3 sources of sampling bias

A
  • not using random sample
  • sampling frame is inadequate
  • non responses
97
Q

types of sampling probability

A

simple random sample, systematic random sampling, stratified random sampling, multi-stage cluster sampling

98
Q

types of non-probability sampling

A

convenience sample, snowball sampling, quota sampling, structured observation and sampling

99
Q

reducing non response

A

-keep calling back, be optimistic, reassure people that you aren’t a salesperson, dress to appeal to wide spectrum of people during in-person interviewing, make sure you are flexible with time

100
Q

3 Questions to ask during bivariate anlaysis

A
  • does the association exist?
  • how strong is the association?
  • in what direction does the association exist?
101
Q

calculating association with bivariate table

A

“percentage down, compare across”

  • an association exists if column percentages change
  • the greater the change, the stronger the relationship
  • to measure maximum difference, find biggest difference in column percentage for any row of the table
102
Q

p

A

probability that results are not due to chance is 95%

103
Q

null hypothesis

A

there is no relationship between 2 variables