Week 5: Comparing Means: Independent and Paired T-test Flashcards

1
Q

What are the 3 types of t-tests? - (3)

A
  1. One-samples t-test
  2. Paired t-test
  3. Independent t-test
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Whats a one-sample t-test?

A

Compares the mean of the sample data to a known value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the assumptions of one-sample t-test? - (4)

A
  • DV = Continous (interval or ratio)
  • Independent scores (no relation between scores on test variable)
  • Normal distribution via frequency histogram (normal shape) and Q-plot (straight line) and non significant Shaprio Wilk
  • Homogenity of variances
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Example of one-sample t-test RQ

A

Is the average IQ of Psychology students higher than that of the general population (100)?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the assumptions of independent samples t-tests (listing all of them) - (7)

A
  1. Independence. – no relationship between the groups
  2. Normal distribution via frequency histogram (normal shape) and Q-plot (straight line) and non significant Shaprio Wilk
  3. Equal variances
  4. Homogeneity of variances (i.e., variances approximately equal across groups) via non significant Levene’s test
  5. DV = Interval or continuous
  6. IV = Categorical
  7. No significant outliers
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is an RQ example of independent samples t-tesT?

A

Do dog owners in the country spend more time walking their
dogs than dog owners in the city?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the assumptions of paired t-test? (listing all) - 3

A

DV is continuous

Related samples: The subjects in each sample, or group, are the same. This means that the subjects in the first group are also in the second group

Normal distribution via frequency histogram (normal shape) and Q-plot (straight line) and non significant Shaprio Wilk

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is an example of RQ of paired t-test?

A

Do cats learn more tricks when given food or praise as positive feedback?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the decision framework for choosing a paired-sample (dependent) t-test? - (5)

A
  1. What sort of measurement = continous
  2. How many predictor variables = one
  3. What type of predictor variables = categorical
  4. How many levels of categorical predictor = two
  5. Same or different participants for each predictor level = same
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the decision framework for choosing independent-t-test? (5)

A
  1. What sort of measurement = continous
  2. How many predictor variables = one
  3. What type of predictor variables = categorical
  4. How many levels of categorical predictor = two
  5. Same or different participants for each predictor level = different
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

If we are comparing differences between means of two groups in independent/paired t-test then all we are doing is

A

predicting an outcome based on membership of two groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Indepdnent and paired t-tests can fit into an ideal of a

A

linear model

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is coding with dummy variables and an example?

A

E.g., coding absence of cloak in terms of numbers (like 0) and pps with clock as 1 even though it is a categorical variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Independent and paired t-tests (comparing difference of two means) fit into idea of general linear model

What does b0 and b1 represent in this general linear model? - (2)

A

*b0 is equal to the mean of group coded as 0 (in this case no cloak)
* b1 is difference between group means

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

The t-distributed is defined by its

A

degrees of freedom - related to the sample size.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

The t distribution has heavier tails for

A

lower degrees of freedom (small N studies)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are the two different t-tests? - (2)

A
  • Independent-means t-test
  • Dependent-means test
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Independent and Paired T-tests have one predictor (X) variable with 2 levels and only …. outcome variable (Y)

A

one

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

When is an independent-means t-test used?

A

When 2 experimental conditions and different participants are assigned to each condition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is independent-means t-test sometimes called as well?

A

independent-samples t-test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

When is a dependent-means t-test used?

A

Used when there are 2 experimental conditions and same participants took part in both conditions of the experiment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is dependent-means t-test sometimes referred to?

A

Matched pairs or paired samples t-test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

For independent and paired t-tests we compare between the sample means that we collected to the difference between sample means that we would expect if

A

there was no effect (i.e., null hypothesis was true)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

In independent and paired t-tests if standard error was small then suggests that sample means of two groups are quite

A

similar

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

In independent and paired t-tests If standard error is large then large differences in sample means more likely then assume one of two things - (2)

A
  • No effect and sample means in population flcutuate by chance and collected two samples that are atypical from population
  • Difference between samples represent genuine difference and typical of respective population - so null hypothesis si incorrect
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Formula of calculating t- test statistic (form depend on whether same or different participants used in each experimental condition)

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Formula of calculating t-statistic shows obtaining t-test statistic by diving the model/effect by the

A

error in the model

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Expected difference in calculating t-test statistic in most cases is

A

0 - expect differences between sample group means we colelcted to be different to 0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

If observed difference between sample means get larger in t-tests then more confident we become that

A

null hypothesis is rejected and two sample means differ because of experimental manipulation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Both independent t-test and paired t-test are … tests based on normal distribution

A

parametric tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Since independent and paired t-tests are parametric tests they assume that the - (2)

A
  • Sampling distribution is normally distributed - in paired it means sampling distribution of differences of scores is normal not the socres itself!
  • Data measured at least interval level
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

Since independent-tests used to test different groups of people it also assumes - (2)

A
  • Variances in populations are roughly equal (homegenity of variance) = Leven’s test
  • Scores are independent since they come from different people
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Diagram of equation of calculating t-statistic from paired t-test and explain - (2)

A
  • Compares mean differences betwen our samples (–D) to the differences we would expect to find between population means (uD) which is divided by standard error of differences (sD / square root N)
  • If H0 is ture, then expect no difference between population means hence uD = 0
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

A small standard error of differences tells us that - (3) in paired-t-test

A

pairs of samples from a population have similar means

(i.e.., the differences between sample means should be very small and big difference between them is unlikely)

sampling distribution of differences is very narrow and centred around 0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

A large standard error of differences tells us that in paired t-test - (2)

A

that sample means can deviate quite a lot from the populatio mean and so differences between pairs of samples can be quite large by chance alone

sampling distribution of differences is more spread out

36
Q

The average difference between person’s socre in condition 1 and condition 2 -(¯D) in paired t-test is an indicator of

A

systematic variation in the data (represents experimental effect)

37
Q

By dividing the average differences in person’s score in condition 1 and 2 in equation of paried t-test statistic it does 2 things- (2)

A

standardizing the average difference between conditions (this just means that we can compare values of t without having to worry about the scale of measurement used to measure the outcome variable);

contrasting the difference between means that we have against the difference that we could expect to get based on how well the samples represent the populations from which they came.

38
Q

If average differences (–D) between our samples is large and standard error of differences is small in paired-t test then we can be confident that

A

the difference we observed in our sample is not a chance result and caused by experimental manipulation

39
Q

How do we normally calculate the standard error?

A

SD divided by square root of sample size

40
Q

How to calcuate the standard error of differences in paired-test?(σ –D)

A

Standard deviation of differences divided by square root of sample size

41
Q

the t-statistic in paired t-test is

A

ratio of systematic variation in experiment (average difference D) and unsystematic variation (standard erro of differences)

42
Q

When would we expect t statistic greater than 1 in paired-t-test equation?

A

If the experimental manipulation creates any kind of effect,

43
Q

When would we expect t statistic less than 1 in paired t-test equation?

A

If the experimental manipulation is unsuccessful then we might expect the variation caused by individual differences to be much greater than that caused by the
experiment

44
Q

In pairered and generally independent t-tests we can compare the obtainee value of t against thmaximum value we would expect to get by chance alone in t distribution with same DFs and if value we obtain exceeds the

A

critical value then conflict if reflects an effect in our IV

45
Q

What does this output mean?

A

Sleep condition scored mean of 65.38 and no sleep had mean of 60.22

46
Q

In Paired Samples Correlation box here we would expect that

A

someone’s score for first condition would be associated in second condition

47
Q

What does this paired samples correlation show?

A

people doing well in first exam likely doing well in second exam regardless of condition they are in and significantly correlated (r= 0.664)

48
Q

What does this SPSS output show?

A

t(19) = 2.72, p = 0.012

49
Q

What does negative t-value mean?

A

First condition had smaller mean than second condition

50
Q

What does 95% confiderence interval of difference mean in SPSS output of paired t-test?- (3)

A
  • 95% of the samples (e.g., if we had 100 samples then 95 of those samples..) the constructucted CIs contain true value (population) of the mean difference
  • CIs tell us boundaries within which true mean difference is likely to lie
  • The true value of mean difference is unlikely to be 0 if Cis does not contain 0
51
Q

How to calculate effect size for independent and paired t-tests?

A

Using cohen’s D

52
Q

Diagram of calculating Cohen’s D Statistic for sleep vs no sleep

A

Minus big mean from small mean divided by smallest SD (control group)

53
Q

What is interpretation of Cohen’s D? - (3)

A
  • Around 0.20 = a small effect
  • Around 0.50 = a medium effect
  • Around 0.80 & above = a large effect
54
Q

What does Cohen’s d of 0.20 represent

A

difference between groups is a 1/5 of SD

55
Q

Diagram of writing up paired t-test result

A
56
Q

To calculate effect size for independent and paired t-tests, beside Cohen’s D, we can also

A

calculate effect size r (above 0.50 is large effect) by converting t-value to r-value

57
Q

With independent t-test there are two different equations that can be used depending on whether the samples

A

contain an equal number of people

58
Q

With independent t-test since different participants participate in different condition, the pairs of scores will differ not just of experimental manipulation but also because of

A

other sources of variance (such as individual differences between participants’ motivation, IQ etc..)

59
Q

With dependent t-test we look at differences between pairs of scores because

A

scores came from same participant and so individual differences were eliminated

60
Q

Equation of independent t-test of equal N sizes for each condition

A
61
Q

Equation of independent t-test of equal N sizes becomes like the final form since - (3)

A
  • We are looking at differences between the overall means of 2 samples and compare with differences we would expect to get between means of 2 populations from which sampels come from
  • If H0 is true, samples drawn from same population
  • Therefore under H0, u1 = u2 therefore u1 - u2 = 0
62
Q

Equation of independent t-test in numbers for equal N sizes

A
63
Q

We use variance of sum law to obtain the estimate of standard error for each … in independent t-test equation for equal N sizes

A

sample group

64
Q

What does variance sum of law state?

A

variance of the sampling distribution is equal to the sum of the variances of the two populations from which the samples
were taken

65
Q

This independent t-test standard error formula combines the

A

standard error for two samples

66
Q

In independent t-test when we want to compare two groups that contain different number of participants then equation … is not appropriate

A
67
Q

For comparing two groups with unequal number of participants in independent t-test then we use the

A

pooled variance estimate t-test

68
Q

The pooled variance estimate t-test is used which takes into account of the

A

differnece in sample size by weighting the variance of each sample

69
Q

Formula of pooled variance estimate t-test - (2)

A

Each variance of sample is multipled by its DF and added together and divided by the sum of weights (sum of two DFs)

Larger samples better than small ones as close to population

70
Q

In formula of pooled variance estimate t-test it weights the variance of each sample by the

A

number of degrees of freedom (N-1)

71
Q

As with dependent t-test we compare obtained value of t in independent sample against the

A

maximum value we would expect to get by chance alone in t distribution with same DFs

72
Q

As with the dependent t-test we can compare the obtained value of t against the maximum
value we would expect to get by chance alone in a t-distribution with the same degrees of freedom

if value we obtain exceeds this critical value then

A

we can be confident that this reflects an effect of our independent variable

73
Q

What does this output show? - in independent t-test - (2)

A

Sleep condition scored an average exam score of 66.200 and no sleep condition earned an average of 58.73

Effect size (Cohen’s D) = Mean of sleep minus mean of no sleep divided by standard deviation of sleep (control grp) = 66.20-58/73/7.12

74
Q

In independent samples t-test we check for Levene’s test for quality of variances which determine whether

A

we got equal variance across the groups or whether the variances are unequal

75
Q

In independent t-test, Levene’s test we are looking for a non-significant p-value which shows that

A

no statistically significant difference in variances between the two groups - report results from equal variances assumed

76
Q

In independent t-test if Levene’s test was significant then it means that

A

variances between the 2 groups are different and they are statistically significantly different - report data from equal variances not assumed

77
Q

What does this output show in independent t-test? - (2)

A
  • Levene’s test is not significant (p = 0.970) so no stats sig differences in variance between two groups
  • t(28) = 2.87, p = 0.008
78
Q

Diagram of reporting independent t-test

A
79
Q

Paired vs independent t-tests - who has better power?

A

Paired t-t ests

80
Q

Since paired-t-tests use same participants across conditions the … is reduced dramatically compared to independent t-test

A

unsystematic variance

81
Q

The non-parametric counterpart of dependent t-test is called

A

Wilcoxon signed rank test

82
Q

The non-parametric tests of the independent t-test is

A

Wilcoxon rank sum test and Mank Whitney test

83
Q

What does this SPSS output of independent-test of Levene’s show

A

homogeneity of variance as assessed by Levene’s Test for Equality of Variances (F = 1.58, p = .219)

84
Q

What does this independent samples t-test output show? (DV = puppes avergae weight gain between 12 and 28 weeks of age and IV= diet A, B)

A

This study found that puppies in diet B had statistically significantly higher average daily weight gain (89.29 ± 9.93 g/day) between 12 and 28 weeks of age compared to puppies in diet A (60.20 ± 6.85 g/day), t(27)= -9.24, p < .001.

85
Q

In Cohen’s D 3 types of SD can be used in the formula … but… - (4)

A
  • Pooled SD (over conditions)
    Averaged SD
    Control group SD
    But they make very small difference
86
Q

Cohen’s d for diet was 4.25

Is this a:
Small effect
Medium effect
Large effect

A

Large effect