Topic 5: Two-Sample Hypothesis Testing Flashcards
Key features of Between subject designs (3)
- Each participant participates in one and only one group
- Comparisions made between the groups
- Random assignment used to assign participants to groups (if true experiment)
Two group designs do not always have to…… for example …..
- compare an experimental group to a control
- fpr example, it can compare two different amounts of an IV (comparision of length of prision centre such as 2 years and 4 years) or compare an “apple vs orange” such as how good people do depending on AM/PM lecture
Ex-Post-Factor (2)
- IV not manipulated (already occured)
- Does not allow cause and effect claims
One sample T test vs Independent sample t-test
- 1 sample: you find the sample distribution and standarize it
- Independent sample: look at the difference between the sample means and compare that diff to 0. *Standaridize the difference
How do we know if variances are equal?
Not equal if one variance is more than 3x the other
Three necessary conditions to use a t-test for independent samples:
- The samples must be independent
- Each population should have a normal distribution. However, this assumption is frequently violated with little harm as long as n>25
- Homogeneity of variance: Both groups must be sampled from populations with similar varince, if not do not pool variance, use adjusted df
Two-Sample t-test for the difference between Means steps:
- State the claim mathematically. Identify the Null and alternative hypotheses
- Specify the level of significance (identify alpha)
- Identify the degrees of freedom and sketch the sampling distribution (df= n1+n2 -2 or df= smaller of n1-1 or n2-1)
- Describe the critical values (t-table)
- Determine the rejection region(s)
- Find the standaridized test statistic with formula below
- Make a desicion to reject or fail to reject null
- interpret the desicion in the context of the original clai
Power (2)
- Probability of rejecting a false H0
probability that you will find difference thats really there - 1-beta
Beta
- The probability of making a type 2 error
1-B
Chance of finding an effect that exist
Influences on power+the disadvantages of each ways (5):
- Increase alpha value increases the ability to find an effect: raising alpha levbel increases our probability of a type 1 error
- One tail test increase power: not appropriate for a non-directional hypothesis, goes against convention as many do 2 tail test without specifying
- Decrease population variance (σ) which is impacted by population SD and sample size: Results are harder to generalize
- Increase sample size increases power as the sampling distribution for means are skinnier: may be hard/expensive to get alot of ppl
- Make your manipulation strong aka effect size: may not be ethical
Effect size + formula (2)
- Magnitude of true difference between null and alternative hypotheses (u1-u2)
- d= l (u1-u2)/σ l
Large effect size means that
your null and HA population dont overlap very much
Delta
Value used in referring to power tables that combines effect size and sample size
variance and SD relationship
SD is the value when variance is sqaure rooted
SD^2= Variance
Standard deviance symbol
σ
Variance symbol
σ2
What does this mean: Estimated power for delta= 1.5, alpha=0.05 and is roughly 0.32?
If the study were to run repeatedly, 32% of the time, the result would be statistically significant
Steps to find out what sample size we need to give us the power to detect a difference (3):
- Start with anticipated effect size (d)
- Determine delta required for desired level of power
- Calaculate n required for that value of delta
Importance of power when evaluating study results
- When a result is statistically significant: Effect size can tell us whether the result is practically significant
- When a result is not statistically significant: May not be that there is no difference, but simply that the study lacked the power to find it
Why does larger sample make distribution narrower when talking about impact of sample size on power
Since the standard deviation of the sampling distribution decreases with increasing n, the curve has a narrower, taller graph as more probability is squeezed toward the middle.
Matched pair (2)
- When participants are measured and equated on some variable and then assigned to each group based on that
- can be experimental or quasi-experimental (non-randomization)
Natural pairs (4)
What it is+ wjat kind of experiment+ ex+ advantage/disadvantage
- When participants are matched based on some biological or social relationship
- Typically quasi-experimental
- Ex: using siblings: may differ in personality but similar genectics and childhood experience.
- The primary advantage of the natural pairs design is that it uses a natural characteristic of the participants to reduce sources of error. The primary limitation of this design is often the availability of participants. The researcher must locate suitable pairs of participants (such as identical twins) and must obtain consent from both participants