Exam 4 Flashcards
What is a questionnaire?
Set of questions used to learn info about an individual, not meant to be aggregated, just want to know about you
What is a survey?
Meant to be aggregated, sampling and analytic process to combine (aggregate) data, don’t care about individual but the whole
What are questionnaires used for?
Info about individual, used to get to know students better, determine eligibility for a study
Why use surveys?
Subjective responses, not time sensitive, can get large samples, inexpensive
What are the types of surveys?
Mail, email, phone
What are the types of written surveys?
Mail, internet, group
What are mail surveys?
Self-administered, instructions and questions must be clearly written, sent through postal service
What are the pros of mail surveys?
Reduced interview bias, cost effective, reduces sampling bias, can complete at own leisure, anonymity
What are the cons of mail surveys?
Participants may not follow or understand questions, literacy/language barriers, sampling bias still likely, not everyone will respond
How to calculate a response rate?
(#of responses/# of initial sample-undelivered responses)X 100
How can you increase response rates?
Multiple mailings, personalization, organized presentation, incentivization: money, gifts, sweepstakes entries
What response rate percentage should you aim for?
50%
What are internet surveys?
Delivered via email or website
What are the advantages of internet surveys?
Tend to be cheaper (no postage), responses sent immediately (no waiting in mail or lost in mail), more convenient, more control over responses (can’t leave questions unanswered)
What are the disadvantages of internet surveys?
Potential to get lost in spam folders, hard to calculate true response rate (unknown how many people see survey), sampling bias (older populations may not be tech savvy)
What are group administered surveys?
Group of people complete survey in the same setting, self-administered, questions should be self-explanatory, can lead to higher response rates, not ideal for every topic
What are interviews?
Questions answered in presence of researcher, participants can ask clarifying questions, allows for more complex and nuanced answers, follow-ups
What are the major types of interviews?
Phone and in-person
What are the advantages of phone interviews?
Not location dependent, relatively anonymous, convenient, controls for some bias
What are the disadvantages of phone interviews?
Not everyone answers their phone, sampling bias, hard to confirm participant is who they say they are
What are the advantages of in-person interviews?
Higher response rate (doesn’t count for avoidance), can confirm participant identity, more control for sampling bias
What are the disadvantages of in-person interviews?
Easy to avoid/ignore researchers, not cost-prohibitive, location restrictions, respondents more likely to give socially desirable answers
What is interview bias?
Interviewers facial expressions, tone, mannerisms, and attire, wording is VERY important
What is wording?
Lot of time and energy put into questions, consider ambiguity and bias
What are open-ended questions?
Allow for more nuance, clarification, explanation and greater diversity of responses, error probability increases, hard to score/analyze, multiple judges can be used to score, want high agreeability between judges
How to calculate agreeability?
(Agreements/ Opportunities for agreement)X 100
What are close-ended questions?
More control over possible answers, no room for clarification/explanation, should be mutually exclusive and exhaustive, multiple ways to administer
What are close-ended questions rating scales?
More sensitive than yes/no, bigger does not equal better, not everyone has same threshold
What are anchor points used for?
Guidance on rating scales |—X———-|
What are closed-ended questions multiple choice?
Available options must be mutually exhaustive and exclusive
What are loaded questions?
Emotionally loaded and non-neutral
Example:
Do you believe that people who desecrate pizzas, our nations most beloved dish with disgusting pineapple on it deserve to rot in jail forever?
What is question structure?
People often form answers before they reach end of questions, conditional information should be placed at the beginning of the sentence
Not a question: Example of good and bad question structure
◊ Bad:
Do you believe possession of stolen property should be punished, even if the person is not aware the property is stole?
◊ Good:
If a person is not aware that the property they have is stole, should possession of stolen property still be punished?
What are leading questions?
Present information in a way to lead the respondent in a specific manner
Example:
Most people believe the most important step to protect the environment is to recycle. Do you agree?
What are double-barreled questions?
Ask more than one question at a time
Example:
Do you find this class to be challenging and rewarding?
What are fallacies? (Example not definition)
Example:
Have you decided to stop abusing your dog by giving him flea and tick prevention?
No: “No, I have not stopped abusing my dog.”
Yes: “I admit, I used to abuse my dog by giving them flea/tick medication but I don’t anymore.”
What is order of questions?
Although an individual question may not be leading, a series of questions in a specific order can be leading
Example:
-Do you believe all people have the right to be present in any public space?
-Do you believe all people have the right to smoke cigarettes if they choose?
-Do you think people should be allowed to smoke in any public place?
What is branching?
Answers to certain questions determine which questions they will see next, done using filter ?’s
What are filter questions?
Used to allow participants to complete surveys faster, avoid unnecessary N/A responses
Example:
Do you consider yourself a smoker?
If answer is yes, go to question 2.
If answer is no, go to question 5.
What should survey appearance be?
Easy to read, inviting, reasonable length, strategically organized
What is a funnel structure?
Start with general, easy, and interesting questions then slowly introduce more challenging complex ones towards the middle
What are demographics in a survey?
Can be used first (act as icebreakers for interviews) or last (viewed as boring, starting with them could deter participant from completing survey)
What are surveys used for in survey appearance?
Personal information might be saved for the end
What are psychological inventories?
Set of questions created to learn about the individuals responses, used for clinical experimental purposes
What is test-retest reliability?
Getting comparable answers from the same individual upon retesting
What are alternative forms of reliability?
How well two versions of a test yield comparable results
What are construct reliability?
The degree to which respondent’s replies are consistent WITHIN an instrument meant to measure a specific characteristic
What is split half reliability?
The degree to which the respondent’s replies to half the items on a measurement tool is related to their responses to the other half of the items
What is face validity?
Does the tool APPEAR to be measuring what it says
What is construct validity?
The extent to which the concepts thought to be measured within the tool are actually being measured, compare to similar measures
What are criterion validity?
How well the measurements of the instrument correlate with other outcomes or behaviors
What is random selection?
Everyone in the population has an equal opportunity of being selected
What is systematic sampling?
Conducted non-randomly but with a purpose and a set of procedures
Example:
Every 10th person on list
What is stratified sampling?
Technique to ensure a sample will be representative of specific subgroups of the population (aka strata)
What is cluster sampling?
Clusters that represent the population are identified and then everyone in those clusters are included
What is quota sampling?
Differing numbers of participants are chosen for each sample from various subgroups of a population identifying convenient sources of subgroup members and soliciting participants from these sources
What is snowball sampling?
Participants are asked to identify other participants
What is non-probability sampling?
Each member of the population is not equally likely to be selected and the outcome could be a bias sample
What was the radioactive materials in pregnant women study?
Vanderbilt 1940’s, radioactive iron supplements were given to pregnant women and the goal was to determine how iron crossed into the placenta
What were the concerns of the radioactive pregnant women study?
Informed consent, benefits, deception
What was the declaration of Helsinki 1964?
Protections of patience health, drive for knowledge cannot negate patient rights, researchers need to be trained and qualified, respect for local laws and ethics
Why did the declaration of Helsinki 1964 matter?
Informed consent, compare to standard treatment, risk/benefits, vulnerable populations, sound scientific inquiry/protocols/disclosures, research ethics committee, patient privacy, public access to databases
What was the first principle of the Belmont report 1979?
Respect for persons:
-Individuals must be treated as people who can make their own decisions and decide what will and what will not happen to them
-Those that are not able to make these decisions themselves must be protected
What was the result of the Nuremberg trial?
Good of society and not able to be done another way, existing animal data, etc. must justify, avoid unnecessary injury/harm (mental & physical), cannot do if death is expected outcome, risk should not outweigh humanitarian benefit, voluntary termination
Has the Nuremberg code been adopted officially as law?
No
What was the second principle of the Belmont report (1979)?
Beneficence:
-Humans should NOT be harmed during course of participation
-Risks vs. Harm
What was the third principle of the Belmont report?
Justice:
-Selection of participants in a study should be done fairly
What is researcher responsibility?
Responsibility of ethical treatment of participants on researcher
What is an institutional review board?
Committee of individuals with diverse backgrounds review proposals for research with human participants
Who makes up an institutional review board?
Professors, healthcare workers, clergy, etc.
What are IRB exemptions?
Research conducted in educational settings, surveys, interviews, and observations of public behavior