Exploratory Data Anlaysis Flashcards

1
Q

What does EDA stand for

A

exploratory data analyis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the purpose of EDA?

A

convert the available data from their raw form to an informative one in which main features of the data are illuminated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the three things we should always do when performing EDA?

A
  1. use visual displays plus numerical summaries
  2. describe the overall pattern and mention any striking deviations from that pattern
  3. interpret the results we got in context
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the two catagories of variable when examining the distribution of a single variable?

A

catagorical and quantitative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the four types of methods used to summarize distribution of a categorical variable

A
  1. pie chart
  2. bar chart
  3. pictogram (can be misleading)
  4. category (group) percentages
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the three types of methods used to summarize distribution of a quantitative variable

A
  1. histogram
  2. stemplot
  3. descriptive statistics
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

When describing the distribution displayed by a histogram or stemplot, what are the four factors that should be described?

A

Overall pattern:

  1. shape
  2. center
  3. spread

Deviations from the pattern
4. outliers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What do descriptive statistics generally cover?

A

measure of center plus measures of spread

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What descriptive statistics in the numerical summary of a quantitative summary should be included when the distribution is symmetric with no outliers?

A
  1. mean

2. standard deviation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What descriptive statistics should be included for the summary of a quantitative summary when the distribution is skewed

A
  1. five number summary w/median and IQR
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What makes up the five number summary?

A
  1. Min (minimum value)
  2. Q1 (quartile 1)
  3. M (median)
  4. Q3
    Max (max value)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What rule is used for identifying outliers?

A

IQR: Intraquadrant range 1.5 criterion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the two measurements for 1.5IQR Criterion for outliers?

A

below Q1 - 1.5(IQR)

above Q3 + 1.5(IQR)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How do you find 1.5(IQR)

A
  1. Q3 - Q1 = IQR
  2. Q1 - 1.5(IQR)
  3. Q1 + 1.5(IQR)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are three factors to be considered with whether or not to include outliers in your data?

A
  1. Even if it is an extreme value, if it was produced by the same physical/biological process as rest of the data, and is expected to eventually occur again, then it should be included in the data
  2. if outlier was produced under fundamentally different conditions/process from rest of data, outlier can be removed from data if goal is to investigate oly process that produced the rest of the data
  3. may indicate a mistake in data (like typo or measuring error), and should be corrected if possible or removed from data
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Which relationship uses boxplots for examination?

A

C > Q

17
Q

In which distribution shape does the Standard Deviation Rule apply?

A

normal distribution

18
Q

What is the Standard Deviation Rule?

A

tells us what percentage of observations fall within 1, 2 or 3 deviations away from the mean

19
Q

What are the percentage ranges under the Standard Deviation Rule?

A
99.7% = 3rd deviation
95% = 2nd deviation
68% = 1st deviation
20
Q

what is the symbol for mean

A

x with a line over it

21
Q

What is the symbol for median

A

X

22
Q

How is standard deviation calculated? (5 steps)

A
  1. find the mean of the data
  2. find the deviations from the mean (subtract the mean from each observation)
  3. square each of the deviations
  4. find the variance of the data: average each of the devations by adding them up and dividing by (n-1)…. (n = the sample size)
  5. find the SD by finding the square root of the variance
23
Q

What type(s) of graphical display and/or numerical summaries are used for C > Q? (2)

A
  1. boxplots

2. numerical summaries w/conditional percentages

24
Q

What types of graphical display and/or numerical summaries are used for C > C? (2)

A
  1. two-way table

2. conditional percentages

25
Q

What types of graphical display and/or numerical summaries are used for Q > C? (2)

A
  1. scatterplot

2. numerical summary (only if scatterplot displays a linear relationship

26
Q

When describing the relationship displayed by the scatterplot, what 3 items should be considered?

A
  1. overall pattern (direction, form, strength)
  2. deviations from the pattern (outliers)
  3. labeling scatterplot may add insight into relationship
27
Q

What is the correlation coefficient?

A

(r)

measures the direction and strength of the linear relationship

28
Q

Will a strong correlation coefficient prove a linear relationship without reviewing a scatterplot?

A

no, it must be combined with a scatterplot to prove a linear relationship, not just a relationship

29
Q

What is the least squares regression line?

A

the line that has the smallest sum of squared vertical deviations

30
Q

What is the intercept of a line?

A

the value that Y takes when x = 0

31
Q

what is the symbol for intercept

A

a

32
Q

what is the slope of a line?

A

the change in y for every 1 unit increase of x

33
Q

what is the symbol for slope

A

b

34
Q

What is the equation for least squares regression of a line?

A

Y = a + bX

Y = y axis point
a = intercept
b = slope
X = x axis point
35
Q

what is the equation for finding the slope (b) of a line

A

b = r (Sy / Sx)

r = correlation coefficient
Sx = standard deviation of explanatory variable's values
Sy = standard deviation of response variables values
36
Q

What is the formula for line intercept (a)

A

Yw/lineoverit - bXw/lineoverit

37
Q

Why does an observed relationship not imply causation?

A

due to possible of lurking variables

38
Q

What is Simpson’s paradox?

A

when including a lurking variable in the analysis leads us to rethink the direction of the relationship