Final Exam study Flashcards
Sampling- what is the population, target population, accessible population, and sample
Population: cluster of ppl ur interested in;
Target pop: entire group you want to study (must be scientifically justified and empirically supported);
Accessible pop: the group the researcher can actually measure since there’s all sorts of constraints to reaching the target pop, depends on the context of the research and the researcher’s resources;
Sample: subset of the accessible pop since they won’t all want to be part, the inds who actually take part in the research. It has to be representative of the larger pop.
t/f- the sample can lead to limitations
true
Sampling- What are inclusion and exclusion criteria?
inclusion: guidelines about who can participate (describe characteristics potential participants must possess), must be coherent with the research topic and be scientifically supported,
exclusion: guidelines about who cannot participate, ethical consideration should be given, reduce gathering irrelevant data, you should develop (or use a tested pre-made one) a brief questionnaire to evaluate their eligibility.
what is sampling?
the process of selecting observations that will be analyzed for research purposes. includes reaching out to the accessible population and forming the sample. two main strategies: probabilistic and non-probabilistic
sampling strategies- probabilistic. what is it, name the 4 types
Representivity and generalizability of target pop. random selection- everyone in the accessible pop has equal chances of being invited to participate. Simple random samples, systematic sampling, stratified sampling, cluster sampling.
sampling strategies- strengths (3) and limitations (3) of probabilistic sampling strategies
Strengths: representative samples, generalizability of results, less likely to be biased.
Limitations: resources needed limit feasibility (time, costs), requires high skill/experience because many steps and statistical analyses, many not represent minority groups bc they target generalizability of results and not specific characteristics.
simple random samples- how to do it, probabilistic or non-prob., small or big studies, strength (1), limitations (2)
probabilistic.
develop sampling frame and list all accessible pop members, then number potential participants in an orderly manner, then randomly select inds using a random number table.
- small-scale study.
Strength: easy to understand
Limitation: hard to apply bc you have to know all participants, chance random sampling won’t represent every identity.
systemic sampling- what is it? probabilistic or non, small or big studies, strenght (1), limitation (1)
- probabilistic,
first develop sampling frame and list all accessible pop members, then randomly select inds using a systematic strategy (regular interval btwn participants, randomly selected and represented by ‘K’). - Small studies
Strength: clear and consistent framework
Limitation: limited to small-scale/studies conducted on very specific and known populations
stratified sampling- how to do it, probabilistic or non, strengths (2),
- probabilistic.
first divide accessible pop into subgroups (ex. by gender), then draw a sample from each subgroup using random or systemic sample strategy.
Strengths: makes sure people with certain characteristics are represented equally (esp when characteristics are less common) and will make sure you have at least a few individuals from each group.
cluster sampling- how to do it, probabilistic or non, big or small sample, strength (1), limitations (2)
- probabilistic
first divide the accessible pop into subgroups (‘clusters’, usually determined by shared characteristics), then select random clusters using a random number table, then sample all members from selected clusters. - large pop/large sample.
Strengths: good representivity of sample relative to the target pop
Limitations: may lead to heterogenous (variance), which makes it hard to draw generalizable conclusions and clear results
what are non-probabilistic sampling strategies, name the 4 types
describe, explore, or examine small groups, explore a phenom that is unknown/misunderstood, understand the perspective of particular inds, and develop an in-depth understanding of a phenom based on disscussions with people who live the experiences. The four types are purposive, snowball, quota, and convenience sampling.
what are the () strengths and () limitations of non probabilistic sampling strategies
Strengths: fast and simple, inexpensive, targets people with specific experiences.
Limitations: higher risk of sampling bias, lack of representivity with the target pop, so the results can’t be generalized to target pop.
purposive sampling- how to do it, probabilistic or non
first ID the perspective you seek regarding the topic of interest, then ID diversification criteria to find people with those experiences, then seek inds that respect those criteria and who can discuss the results.
- non-probabilistic
snowball sampling- how to do it, probabilistic or non, strengths (3)
rely on initial participants to identify potential participants (ask them to spread the word to a pop that there is an ongoing study).
- non-probabilistic.
Strengths: reach stigmatized and hard to reach socially excluded groups, reach unfamiliar groups to the researcher, helpful for new researcher who doesn’t know much abt a particular group and how to approach them
quota sampling- how to do it, probabilistic or non,
first ID categories important to study, then create subgroups based on each category, select inds from each category. “quota”: the number of participants wanted from each group. SELECTION OF PARTICIPANTS IS NOT RANDOM AND SHOULD REPRESENT THE GENERAL POP.
- non-probabilistic
convenience sampling- how to do it, probabilistic or non, strengths (2), best for what kind of research
select inds who are easily accessible by physical proximity, availability of researcher, and available resources.
- non-probabilistic
Strenghts: takes less time to prepare, always feasible
- best for exploratory research
what is sampling bias
when the selection of participants may be influenced by acces to invitation to take part in a research, recruitment strategies, personal interest from the participants.
what do experiments do and what are their characteristics. is participant selection random or purposive
test hypotheses in controlled conditions.
- control over variables, control over the environment, control over participants
- selection by random assignment
what are the goals of experiments
determine causal relationships between variables and explain relationships between variables.
what are the variables in experiments (3), define them, what is factor, level, and outcome NEED TO UPDATE WITH SOME INFO
IV: manipulated by researcher to look at its effects on the DV, also called ‘factor’ in experimental studies (usually 1-2). The level is the value of the IV.
DV: and outcomes:
Confounding Variables: aren’t of interest and not measured, could influence the causal relationship ur trying to study, not always aware of it/them, want to eliminate- can harm results and their impacts may be attributed to the IV.
what are the groups in experiments and how are participants assigned to them, what is a ‘test group’
- everything between the groups is the same except their exposure to the stimulus.
Experimental: ‘test group’- exposed to stimulus/treatment/intervention u want to look at,
Control: not exposed to stimulus and is meant to be a point of comparison to find if the stimulus is the cause of the effect or not. - Random assignation: randomly assigned to each group meaning they have equal chances of being assigned to each group and their selection is independent from other participants. AIM to pre-test equivalence of groups and control over ind variables that could influence the results of the study. The groups being similar will reduce the effects of a confounding variable
what are the 2 diff kinds of experiments called
within-subjects/group design, and between-subjects/group design
what does the within-subjects/group design involve, what does it measure, strengths (1), limitations ( UPDATE INFO AND FILL INNNNNNN
- same participants are involved in repeated testing. Groups are called ‘conditions’ and are
what does the between-subjects/group design involve, strengths (3), limitations (5)
more than one group of participants, diff groups take part in diff experiments based on random assignment, then the outcomes of the diff groups are compared. Groups are either experimental or controlled.
Strengths: carryover effects reduced (practice, time effects, etc.), limits fatigue effects, shorter duration of the study .
Limitations: requires large sample, which also requires more financial and human resources, and takes more time to find, recruit, and experiment on;, individual differences are uncontrolled, which can influence the outcomes
quasi-experimental research- what does it do, how are participants assigned, what does it involve, (2) limitations, name the 2 types.
- tests causal relationships between variables,
- purposive recruitment
- usually involves field experiments (experiments that occur in real-life settings)
Limitation/challenge: environment not fully controllable, can’t have a control group because it observes things irl BUT it is still possible to manipulate the IV by looking at people who have the characteristics.
one-group posttest-only- what is it, (2) limitations, what kind of research does it belong to
- DV is measure after the treatment- so no control group
Limitations: lack of control group makes it easy to misinterpret the results, and so you can’t be fully sure about what is causing the outcome. - QUASI EXPERIMENTAL
one-group pretest-posttset- what is it, (3) limitations, what kind of research does it belong to
- single group performs an experiment and the DV is measured before and after.
Limitations: possibility of the effects of special events, maturation, and practice effects.
-QUASI EXPERIMENTAL
Non-experimental research- what is it, how are participants assigned, when is it useful
- does not manipulate an IV
- Purposive assignment (need participants who possess certain characteristics)
- useful when you can’t manipulate the IV and when exploring non-causal relationships
what are the objectives of surveys (5)
- gather large amounts of data, and quickly, get details about a large population, to describe the characteristics of a pop or phenom, and to investigate the opinions and behaviours of a pop. ALSO USEFUL WHEN LIMITED RESOURCES.
what are the diffs between surveys and questionnaires
Surveys: collect data about a pop, is a research method (process), involves statistical analysis and is used to draw conclusions, and takes longer to conduct.
Questionnaire: collects data about one person, is only a tool to gather information, does not involve a formal analysis, answers cannot be generalized to the pop, quickly administered.
how are surveys administers
- self-administered either in hard copy or online, or
- administered by the researcher through a form of interview where the researcher reads the questions and answer options.
what are the (6) strengths and (7) limitations of surveys
Strengths: gather lots of info in short time, reaches large pops, don’t have to do in person so easier to reach more divers profile, cost-effective and less time consuming, versatile so it’s adaptable so many social contexts, and sample is representative so results are generalizable.
Limitations: data collections relies on single instrument so if there’s a problem you can’t go back, forces people to choose btw predetermined questions which can be mis-interpreted, not understood, may not represent their POV, validity of the results (not represent POVs), risks of missing data, Participants often tended to answer based on social desirability (answer questions that make them look good), bias in persons who choose to participate.
name the 3 types of surveys
cross-sectional, longitudinal, and retrospective
what are cross-sectional surveys, what are 3 limitations
administered only once at a particular point in time, doesn’t consider evolution of a phenom and pops- so, (Limitations:) it gives a ‘stagnant’ picture, is difficult to generalize, and difficult to know is results apply long after the assessment
what are longitudinal surveys, what is 1 limitation, name the 3 types
repeated observations through assessment over a long period of time (months-years), follows the same inds over time so there is RISk of attrition (may lose some participants over time, generally 70-80% must stay in the study for results to be accurate).
- Trend survey, panel survey, and cohort survey
what are trend surveys
measures evolution and changes over time such as opinions, characteristics, and behaviours. They administer the same questions at different moments, but the interests are trends and not specific groups so respondents aren’t necessarily the same on each occasion.
- type of longitudinal survey
what are panel surveys, and 2 limitations
audience is surveyed multiple times and it tracks changes in behaviours, attitudes, thoughts, etc. and the relationships between variables. The same persons participate in each assessment so there is high risk of attrition and can’t replace them, and is costly and requires a lot of resources.
- Type of longitudinal survey
what are cohort surveys
tracks changes over time with the same questions, regularly surveys people of a same category of interest but not necessarily the same individuals (doesn’t have to be same people but need to have particular characteristics)
- type of longitudinal survey
what are retrospective surveys
administered only once but ask questions about a series of past events
What are some (4) characteristics of good survey questions
- clear & unambiguous (one idea per question), appropriate wording depending on the population and should be adapted to their capacity to understand the question, as neutral as possible to minimize bias and limit social desirability, and you should obtain feedback/pre-test the questions.
what are (5) steps in designing effective survey questions
- define the goal and purpose of the study,
- get a clear idea of what you want to learn,
- identify relevant questions,
- brainstorm potential questions with a team,
- organize potential questions
what are (3) characteristics of good survey response options, give 2 examples
- be one possible answer,
- close-ended,
- mutually exclusive (an idea cannot be represented in two choices)
- ex. yes/no, likert scales with measure of agreement