Untitled Deck Flashcards
What is the SLR model equation?
y = β₀ + β₁x + ε
Defines the relationship between response variable y and explanatory variable x
What is the SLR model for multiple observations?
yᵢ = β₀ + β₁xᵢ + εᵢ
For observations i = 1, 2, …, n
What is the objective of Least Squares Estimation (LSE)?
SS(β₀, β₁) = ∑ᵢ=1ⁿ (yᵢ - (β₀ + β₁xᵢ))²
Minimizes the sum of squared residuals
How is the slope (Beta 1) estimated in linear regression?
β̂₁ = Sₓᵧ / Sₓₓ = ∑ᵢ=1ⁿ (xᵢ - 𝑥̄)(yᵢ - 𝑦̄) / ∑ᵢ=1ⁿ (xᵢ - 𝑥̄)²
Slope estimator in linear regression
What is the formula for estimating the intercept (Beta 0)?
β̂₀ = 𝑦̄ - β̂₁𝑥̄
Intercept estimator in linear regression
What is the alternate form for estimating the slope (Beta 1)?
β̂₁ = (∑ᵢ=1ⁿ xᵢyᵢ - n𝑥̄𝑦̄) / (∑ᵢ=1ⁿ xᵢ² - n𝑥̄²)
Alternate form for calculating the slope
How can the slope (Beta 1) be calculated using correlation?
β̂₁ = r × (sᵧ / sₓ)
Where r = correlation between x and y
What is the formula for calculating sample standard deviation for x?
sₓ = √(1/(n-1) ∑ᵢ=1ⁿ (xᵢ - 𝑥̄)²)
Sample standard deviation for x
What is the formula for calculating sample standard deviation for y?
sᵧ = √(1/(n-1) ∑ᵢ=1ⁿ (yᵢ - 𝑦̄)²)
Sample standard deviation for y
What is the formula for the sample correlation coefficient (r)?
r = Sₓᵧ / √(Sₓₓ Sᵧᵧ) = ∑ᵢ=1ⁿ (xᵢ - 𝑥̄)(yᵢ - 𝑦̄) / √(∑ᵢ=1ⁿ (xᵢ - 𝑥̄)² ∑ᵢ=1ⁿ (yᵢ - 𝑦̄)²)
Sample correlation coefficient
What is the no-intercept SLR model (Beta estimator)?
β̂ = ∑ xᵢyᵢ / ∑ xᵢ²
Used when the regression line passes through the origin