Midterm Flashcards

1
Q

Belmont Report Guidelines

A
  1. Beneficence - maximize benefits, minimize harm
  2. Respect for persons - autonomy, informed consent
  3. Justice - fair distribution of benefits and burdens
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Primary literature

A
  • Original work that enhances or introduces knowledge
  • Includes research results, case studies, descriptive and evaluative studies
  • e.g. randomized controlled trial
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Secondary literature

A
  • Summarize, analyze, draw conclusoin from previous work
  • e.g. reviews, meta-analysis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Evaluating Resources

acronym

A

Currency: published, updated, revised
Relevance: info, details, audience
Authority: credentials, peer-reviews
Accuracy: references, match others
Purpose: stated, objective or bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Situational variable

A
  • Describe characteristics of a situation/environment
  • Categorical
  • e.g. temperature in gym
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Response variable

A
  • Responses/behaviours
  • Dependent variable
  • e.g. RT
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Participant/subject variable

A
  • Individual differences, characteristics
  • Numerical
  • Independent variabke
  • e.g. sex
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

3 Fundamental features of science

A
  1. Systematic empiricism
  2. Empirical questions
  3. Public knowledge
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Beliefs/activities that imply science but lack 1+ of the 3 features of science

A

Pseudoscience

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

3 goals of science

A
  1. Describe - observational
  2. Predict - systematic relationship between variable
  3. Explain - mechanisms + causal rltnsp
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Basic vs applied research

A

Basic: global understanding
Applied: address practical problems

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

PICOT

A

Patient pop. of interest
Intervention of interest
Comparison intervention/group
Outcome
Time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Sampling methods

simple random, systematic, cnvenience, cluster

A

Simple random: every member of pop has equal chance of being selected
Systematic: every nth participant
Convencience: nearby and willing
CLuster: divide pop into blocks, then randomly select blocks of participants

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Stratified sampling

A

Divide pop based on characteristics, then sample is taken from strata using random, systematic, or convenienc e smapling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Variables other than the DV

A

Extraneous variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Variable that systematically vary with DV

A

Confound variable
Provide alternative explanation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Difference between experimental and non-experimental rsrch

A

Manipulation of IV only in experimental
Can’t draw causal conclusions with non-exper

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Measures of dispersion

range, standard dev, variance

A

Range: difference between highest and lowest score (outliers can mislead)

Standard deviation: avg distance between scores and mean; square root of variance
* √((⅀(x-m)²)/n)

Variance: mean of squared diffferenced (SD^2)
* calculate the variance by taking the difference between each point and the mean. Then square and average the results.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Descriptive stats

Examples and purpose

A

Describe/summarize data; no causal conclusions
e.g. %, central tendency, dispersion, correlation coefficients

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Inferential stats

A

draw conclusions, determone statistical sig.
Type 1 and 2 errors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Type I vs Type II errors

A

Type I - false psoitive
Type II - false negative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What do the results of a study tell us

A
  • can’t conclude/prove based off a single study
  • Either support, refute, or modify theory
  • scientific evidence, not proof
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Continuous vs categorical levels of measurement

A

Cont - Interval and ratio
Cat - nominal and ordinal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Level of measurement with a meaningful zero

A

Ratio

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Math with levels of measurement
Interval: add and subtract Ratio: +, -, /, x
26
Summarizing levels of measurement
Nominal: mode Ordinal: median and mode Interval + Ratio: all three
27
Sex is an example of what level of measurement
Nominal
28
Place in a race is an example of what level of measurement
Ordinal
29
Temp in celsius is an example of what level of measurement
Interval
30
Temp in Kelvin is an example of what level of measurement
Ratio
31
When do ordinal and interval data overlap
* aggregating multiple items * underlying construct is continuous * Measurement instrument is reliable
32
Why collect as continuous data and then put into categoires?
Otherwise can't get an average Presents fewer analytic choices
33
sum of all scores divided by n
Mean
34
Median
50th percentile/middle score First step: order scores Next: locate middle ((n+1)/2)
35
Bimodal
Tie between 2 for most repeated score (mode) 2 distinct peaks in distribution shape
36
Multimodal
Tie between >2 for most repeated score (mode)
37
Where are central tendencies located on normal distribution
All in middle if perfectly normal
38
Frequency tables
Display distribution of a single variable * Variable listed from highest to lowest on one side, frequency on other
39
Histograms
Graphical display distribution * quantitative variables don't have gaps between bars unless the score has frequency of 0
40
Skewed with peak on the right
negative skew
41
Skewed with peak on the right
negative skew
42
Percent of scores lower than an individual score
Percentile rank Number of scores converted into %
43
Z Score
Difference between individual score and the mean of distribution (x-m), divided by the standard deviation √((⅀(x-m)²)/n)
44
Effect size differences between means
Cohen's d d = (M₁ - M₂) / SD Formally use pooled SD
45
Pooled SD
The average spread of all data points about their group mean (not the overall mean)
46
Graphing correlations between quantitative variables
Line graph if x-axis variable (IV) has small # of values Scatterplot if x-axis variable (IV) has large # of values
47
Linear vs nonlinear relationship | graphing
Linear: pts fit into single, relatively straight line; Pearson's r Nonlinear: pts fit into curved line
48
Pearson's r | Purpose, limitation, steps
* For linear relationships * From -1.00 to +1.00 * Limitation: restriction of range - limited range in sample relative to pop 1. Turn scores into z scores (x and y variables seperately) 2. Multiple x and y z-scores together for each individual 3. Take mean of cross products
49
Bar graphs | Purpose, error bars, stat sig.
* Present and compare mean score of groups when IV is categorical * Error bars for variability (extend one standard error in each direction) * if difference between means is greater than 2 standard errors, there is statistical significance
50
SD of group divided by √n
STandard error
51
Line graphs | Application, error bars
* When IV is continuous (e.g. time) or small # of IV lvls * Use when IV is quantitative * Error bars for standard error
52
Scatterplots
* Correlations between quantitative variables when x-axis (IV) has large # of lvls * Add regression line
53
Multiple-response measures
* Enter seperately, then combine using software * assess internal consistency of the measure using Cronbach's alpha or Cohen's k
54
How to analyze/show difference between means
Bra graph and cohen's d
55
How to analyze/show correlation between quantitative variables
Line graph or scatterplot (check for nonlinearity and restriction of range) Pearson's r
56
Null Hypothesis
* No relationship in the pop., relationship in the sample reflects only sampling error * Occured by chance * No relationship = Cohen's d or Pearson's r is 0
57
Probability of the sample result or a more extreme result if the H₀ were true
P Value
58
Factors of p value
Strength of relationship Size of sample
59
Low p value
Sample or more extreme result would be unlikely if the H₀ were true Reject the null hypothesis Statistically significant
60
Alpha .05
5% chance or less of a result at least as extreme as the sample result if the null hypothesis were true Even when the H₀ is true and alpha is .05, the H₀ will be mistakenly rejected 5% of the time Greater than 5% chance ==> retain the H₀ (fail to reject)
61
Type I error
* Rejecting the H₀ when it is true (false positive) * p value tells probability of making a type I error * Cause: sampling error * Reduce the chance of making Type I error by setting alpha to something less than .05 BUT then this raises probability of making Type II error!
62
File drawer problem
usually only moderate to strong positive relationships are published, leading to published effects showing a stronger relationship than is really in the population
63
p-hacking
various decisions in the research process to increase the chance of a stat. sig. result Set alpha before!!!
64
Type II Error
* retaining the H₀ when it is false (false negative) * Cause: relationship lacks adequate statistical power to detect relationship (e.g. sample is too small) * Reduce the chance of making Type II error by setting alpha to something more than .05 BUT then this raises probability of making Type I error!
65
Statistical Power
* probability of rejecting the null hypothesis given the sample size and expected relationship strength (pearson's r) * Complement of the probability of committing a type II error * Power of .80 is adequate - means there's an 80% chance of rejecting the null hypothesis for the expected relationship strength * To increase statistical power, increase the strength of the relationship or increase the sample size *
66
Calculate probability of committing a TYpe II error given statistical power of .59
1 - .59 = .41
67
4 Moral Principles in scientific rsrch
1. Balance risks vs benefits 2. Act responsibly and with integrity (maintain trust + transperency) 3. Seek justice (fair treatment) 4. Respect right and dignity (autonomy + consent)
68
TCPS rsrch agencies
* CAN institute of health rsrch * Nat sci and Eng. Rsrch council of CAN * Soc sci & humanities Rsrch council of CAN
69
3 Levels of Risk | Federal Policy for the Protection of Human Subjects
1. Exempt rsrch - nonsensitive, standard, public info * Maintain confidentiality * Once approved, exempt from regular, continuous review 2. Expedited Rsrch - no greater than minimal risk * Reviewed by 1 member of IRB, or appointed subcommittee 3. Greater than minimal risk - needs full IRB review
70
Z score | define, distribution
Standard measure of the distance between a single point in the data and the overall mean for that variable z-distribution: * ranges from negative infinity to positive infinity * has a mean of 0 * has a standard deviation of 1
71
T score
* Standard distribution with a mean of 50, and a SD of 10 * without negative values * can use this to scale any variable (e.g. IQ)
72
Percentiles
Use to express z-scores more intuitively Refers to the proportion scoring less than a particular value Obtained from z-table
73
Parameters
Values describing population distribution
74
Population distribution | centre, dispersion
Centre at mu Dispersion indicated by sigma
75
Sample distribution
x-bar = centre of the distribution s = standard deviation/dispersion of the distribution
76
Decision Matrix
state of reality vs decision reached in inferential testing * Type I error * Type II error (beta) * Power
77
Power
* Study’s ability to find a difference if there is one * Correct rejection of the H₀ * 1-beta (type II error) = power * ↑ Power by ... 1. ↑ n 2. ↑ critical alpha 3. ↑ effect size (∆)
78
Null Hypothesis Sig. Testing
1. Directional - upper/lower tailed (X... more/lower than Y) or two-tailed test (X different than Y) 2. Establish rejection regions * two-tailed tests: split the alpha value in half (0.025) so non-rejection region is 0.5 - 0.025 = 0.475 * single-tailed tests: rejection alpha value (0.05) on distribution graph 3. If sample falls within rejection region, reject the null hypothesis and conclude that the alt hypoth. is likely correct
79
Limitations of p value
* Only relevant to specific sample stats * Conditioned on the null hypothesis being true * the false positive rate associated with a p value of .05 is usually around 30%, but can be much higher * silent on the magnitude and range of an effect * Even the most miniscule effect can be statistically significant if the sample size is large enough
80
Limitation of significance testing
* Null hypothesis is rarely true * ST provides a binary decision (yes or no) and a direction of the effect * Mostly interested in the size of the effect * Statistical vs practical significance
81
Statistical Significance ⍺ | define, stat significance
* probability of results due to chance * Represents chance of making Type I error * smaller value = more "unusual" (e.g. sample is different than pop. that its being compared to) * Fail to reject H₀ if p > ⍺ * Reject H₀ if p < ⍺
82
Power Analysis
Calculate expected power before conducting a study based on estimated n, critical ⍺, expected or minimum effect size (from related rsrch) Avoid post-hoc power analysis!!!!!!
83
Effect size
Measure of the strength of a relationship Unrelated to n and statistical significance * Can be statistically significant but trivial effect * Could be statistically insignificant, but notable effects (increase n to gain significance) Cohen's d = mean difference / SD * d = 0.2, small effect * d = 0.5, medium effect * d = 0.8, large effect
84
P value vs alpha
Alpha is arbitrary number/threshold (e.g. finish line) P-value is the actual measurement (e.g. race time)
85
Bayes' Theorem
allows you to calculate exact percentages (conditional probability based on the occurrence of previous outcomes of similar circumstances)
86
Converging operations
Mulitple operational definitions for same construct allows for more general conclusion if multiple measures have consistent scores
87
Levels of measurement with category labels
All of them!
88
Levels of measurement that can rank order
Ordinal, interval, ratio
89
Levels of measurement with = intervals
interval and ratio
90
Test-retest reliability
COnsistency over time For consturcts that are assumed to be consistent over time
91
Internal Consistency | what? why? how?
Responses across the items on a multiple-item measure * if all items represent the underlying construct, then people's scores should be correlated which each other * assessed by collecting and analyzing data * Split-half correlation: split items into two sets, compute score for each set of items, examine relationship between the two sets using Cronbach's alpha
92
Cronbach's alpha | what? why?
mean of all possible split-half correlations for a set of items Used to measure internal consistency
93
What does Cronbach's alpha assess
quantitative judgements
94
What does Cohen's k assess
Categorical judgements
95
Content validity
extent that measure covers the construct check measurement method against coceptual def
96
Criterion Validity | what? concurrent? predicitive? convergent?
Criterion Validity: extent that peoples scores are correlated with other variables (criteria) that are expected to be correlated * Criterion: any varibale that is expected to be correlated with the construct in question * Concurrent validity: when the criterion is measured at the same time as the construct * Predicitive validity: when the criterion is measured at some point in the future (after the construct has been measured) * Convergent validity: other measures of same construct
97
Discriminant Validity
Discriminant Validity: extent to which scores on a measure are NOT correlated with measures of variables that are conceptually distinct (e.g. self-esteem and mood) low correlations = evudence of conceptually distinct construct
98
Utility | efficiency and generality
Is the data precise and reliable, at the lowest possible cost (Efficiency)? Can the method be applied successfully to a wide range of phenomena (Generality)?
99
Measurement errors | parallax, calibration, zero, damage
Parallax error (incorrectly sighting the measurement). * e.g. don't read the measurement right, copy it down wrong Calibration error (if the scale is not accurately drawn) * e.g. scale on a map is wrong Zero error (if the device doesn’t have a zero or isn’t correctly set to zero) Damage (if the device is damaged or faulty). * e.g. bent level
100
Types of error | gross, systematic (3), random
Gross errors: human mistakes in reading instruments and recording and calculating measurement results Systematic Errors * Instrumental: shortcoming, misuse, measurement accuracy * Environmental: external and envrmtl factors * Observational: inaccurate readings, conversion error Random Errors: disturbance about which we are unaware
101
5 causes of type I error
Measurement error Lack of random sample Alpha value too liberal Investigator bias Improper use of one-tailed test
102
Causes of type II error
Measurement error Lack of sufficient power (n too small) Alpha value too conservative Treatment effect not properly applied
103
Social Desirable Responding
saying/doing socially appropriate thing
104
Demand characteristics
subtle cues in the measure that reveal how the researchers expect participants to behave
105
Meaurement Bias | Confirmation, recording, halo, social desirability
Confirmation bias * find what u look for Recording bias * recall * Rely on imperfect record (e.g. memory) * Availability heuristic * Primacy/recency effect Halo effect * extraneous variables affect measures * common in subjective appraisal of ind diffs Social desirability bias * impression management * participants more likely to report positive info to the experimenter
106
Expectancy effects | participant, pygmalion, hathorne, halo, placebo, biosoc, psysoc
* Participant types (good, bad, faithful, apprehensive) * Pygmalion - self-fulfilling prophecy; use doubl-blind * Hawthorne - alter bhvr (pierce!) * Halo - short-term improvement bc of novelt of treatment * Placebo - natural improvement, generalized effect of 'being in treatment', reinteropretation of outcome measures * Biosocial experimenter cues - age, sex, attraction * Psychosocial experimenter cues - warmth, status, etc
107
Reducing expectancy effects
* Standardize experimenter-participant interaction * Use blinding techniques * Use deception (active vs passive) * Convince participant that you can detect lying