week 3 Data Cleaning (text books) Flashcards

to help us learn week 3 lecture and supplementary reading content :-) including: Review research design and decision tree for choosing your analytical technique. Cleaning your data; Data Entry Errors; Missing Data; Outliers; Non-normal distribution; Linearity; Homoscedasticity; Multicollinearity and Singularity so no problem then :-}

1
Q

What is the basic logic used to interpret all inferential statistics?

A

The basic logic used to interpret all inferential statistics is the logic of significance, and the null & alternate hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What do parametric statistics depend on?

A

Parametric statistics depend on normality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the first step in the analysis process?

A

The first step in the analysis process is always to screen the data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Why is data screening the first step in the analysis process?

A
  • To ensure accuracy
  • To check assumptions
  • After the screening process a decision needs to be made as to which statistical test to use
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the 4 steps of data screening / data analysis?

A

Screening the data involves

  1. Checking the accuracy of the data entry
  2. Examining any missing data to access if there is evidence that they might be systematic (i.e. caused by something specific, as opposed to being due to random errors)
  3. Looking for outliers
  4. Checking parametric test assumptions (e.g. normality)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Why is it important to inspect my data file for missing data?

A

I need to consider if there is a variable with a lot of missing data, and if so, ask why; i.e.: Is it random or is there a systematic pattern?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

How do I inspect my data file for missing data?

A

o Run “Descriptives” & find out what percentage of values is missing from each of my variables
o SPSS has a Missing Value Analysis (MVA) procedure to help find patterns in missing data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Why is caution recommended when managing missing values in my statistical analysis?

A

I should choose carefully as it can have dramatic results
This is particularly important if I am including a list of variables & repeating the same analysis for all variables (e.g. correlations among a group of variables, t-tests for a series of dependent variables)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the best way to manage missing values when I come to do my statistical analysis?

A

*Pallant strongly recommends the ‘pairwise’ exclusion of missing data
• ‘exclude cases listwise’ includes cases only if it has full data on all the variables.
• ‘exclude cases pairwise’ is better as it excludes the participant only if they are missing data required for a specific analysis. They will still be included in analysis for which they have necessary information

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What should I never do when managing missing data using SPSS?

A

*I should NEVER run the ‘replace with mean option’ as it can severely distort the results of my analysis, particularly if I have a lot of missing values
• ‘replace with mean’ calculates the mean value for the variable & give every missing case this value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What do Tabachnick & Fidell advise when dealing with missing data?

A

The pattern of missing data is more important than the amount of data missing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

So at what percentage of missing data do we start to grow concerned?

A

o If less than 5% of data are missing in a random pattern from a large data set, the problems are less serious & almost any procedure for handling missing values yields similar results
o If, however, a lot of data are missing from a small to moderately sized data set, problems can be very serious
o Unfortunately, there are as yet no firm guidelines for how much missing data can be tolerated for a sample of a given size

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

How many types of missing data are there?

A

There are 3 types of missing data:

MCAR – missing completely at random
MAR – missing at random (ignorable responses)
MNAR – missing not at random or not-ignorable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What can you tell me about MCAR?

A

MCAR – missing completely at random
The distribution of missing data is unpredictable in MCAR
This is the best of all possible worlds if data must be missing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What can you tell me about MAR?

A

MAR – missing at random (ignorable responses)

The pattern of missing data is predictable from other variables in the data set

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What can you tell me about MNAR?

A

MNAR – missing not at random or not-ignorable

The missingness is related to the variable itself & therefore cannot be ignored

17
Q

What do Tabachnick & Fidell advise when dealing with missing data?

A

The pattern of missing data is more important than the amount of data missing

18
Q

So at what percentage of missing data do we start to grow concerned?

A

o If less than 5% of data are missing in a random pattern from a large data set, the problems are less serious & almost any procedure for handling missing values yields similar results
o If, however, a lot of data are missing from a small to moderately sized data set, problems can be very serious
o Unfortunately, there are as yet no firm guidelines for how much missing data can be tolerated for a sample of a given size

19
Q

How many types of missing data are there?

A

There are 3 types of missing data:

MCAR – missing completely at random
MAR – missing at random (ignorable responses)
MNAR – missing not at random or not-ignorable

20
Q

What can you tell me about MCAR?

A

MCAR – missing completely at random
The distribution of missing data is unpredictable in MCAR
This is the best of all possible worlds if data must be missing

21
Q

What are outliers & how can you identify them?

A
  1. Identify them via box plots or eyeballing histograms
    o If outliers are identified: Standardise them by converting the raw scores to z scores
    o Z scores in excess of +/- 3.29 (p<.001) may be regarded as outliers
    o When N is large (large sample size) a few extreme scores are expected
22
Q

Why are outliers a problem?

A
  • Outliers are a particular problem for parametric tests
  • Outliers are extreme scores which distort the results
  • Outliers drag the mean towards themselves and exert ‘more than their fair share’ of influence over the mean & the results of statistical tests
  • Outliers can be the cause of non-normality
23
Q

What is the temptation when dealing with missing data?

A

• It is tempting to assume data is missing at random, however, we can test it & we should
o It is possible to create dummy variables with 2 groups: cases with missing & cases with non-missing values & perform a test of mean differences between the 2 groups
o If there are no differences, decisions about how to handle missing data are not so critical
o If there are significant differences, & η² is substantial, care is needed to preserve the cases with missing values from other analysis

24
Q

What options does SPSS offer us to deal with Missing Data?

A
SPSS MVA (Missing Values Analysis) is specifically designed to highlight patterns of missing data as well as to replace them in a data set
The resulting Little's MCAR test tells us what to do next
25
Q

What does Little’s MCAR test establish?

A

• Little’s MCAR test establishes whether the data are missing completely at random
o A statistically nonsignificant result is desired.
o MCAR can be inferred where p = greater than .05

26
Q

What are the results we do not wish to see from a Little’s MCAR test?

A

o MAR can be inferred if the MCAR test is statistically significant but missingness is predictable from variables (other than the DV) – this is established using the ‘Separate Variances t Tests’
o MNAR is inferred if the t test shows that missingness is related to the DV

27
Q

Why are outliers a problem?

A
  • Outliers are a particular problem for parametric tests
  • Outliers are extreme scores which distort the results
  • Outliers drag the mean towards themselves and exert ‘more than their fair share’ of influence over the mean & the results of statistical tests
  • Outliers can be the cause of non-normality
28
Q

What are some of the options available to us when dealing with outliers?

A

o Delete them but this changes the nature of the sample (only delete if it’s believed the score is not really from the population of interest (e.g. below average IQ when intended population is average IQ)
o Change outliers so they are only one unit more extreme than the next most extreme score (e.g. change from 45 to 24 where next most extreme score is 23).
 This ensures outlier still exerts influence, but no more than its fair share
o Can transform the data or use nonparametric statistics (as these are based on ranks thus not affected by extreme scores, and do not require normality)

29
Q

What are some of the options available to us when dealing with outliers?

A

o Delete them but this changes the nature of the sample (only delete if it’s believed the score is not really from the population of interest (e.g. below average IQ when intended population is average IQ)
o Change outliers so they are only one unit more extreme than the next most extreme score (e.g. change from 45 to 24 where next most extreme score is 23).
o This ensures outlier still exerts influence, but no more than its fair share
o Can transform the data or use nonparametric statistics (as these are based on ranks thus not affected by extreme scores, and do not require normality)

30
Q

Once we have dealt with our outliers, what does that allow us?

A

Once outliers are dealt with the data may now meet the normality assumptions so parametric tests are possible

31
Q

If we have treated our data, what should we do when writing our results?

A

It is essential to report succinctly that any treatment of outliers in the results section

32
Q

What is the second step in the analysis process (yep, all that was just the first!)?

A

The second step in the analysis process is to decide which statistical test to use

33
Q

In what circumstances would you use non-parametric tests?

A

Use non-parametric tests when:
• The data (scores on the DV) are ordinal rather than interval or ratio
• Sample sizes are small (<10, where it can be virtually impossible to conduct accurate assumption checks
• initial data screening indicates that the parametric assumptions, particularly normality, are violated
• sample sizes are small & unequal
Non-parametric tests are an alternative to dealing with outliers as they are not distorted by them, however, non-parametrics are less accurate