GLM 2- Multiple Regression Flashcards

1
Q

What is a polynomial regression?

A

A statistical method of determining the relationship between an independent variable (x) and a dependent variable (y) and model their relationship as the nth degree polynomial.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

When is a polynomial regression used?

A

When the relationship between two variables is non-linear.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How can a simple regression of Y onto 1 predictor, X1 be written?

A

Y = β0 + β1X1 + ε,

where recall that ε is the error term.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How can a simple regression of Y onto 1 predictor, X1 be written?

A

Y = β0 + β1X1 + ε,

where recall that ε is the error term.

Uppercase Y = random variable y

Multiple regression still involves single intercept B0 which is the value taken by Y when all x’s are set to 0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

How are the estimated parameters of a multiple regression of Y onto X1, . . . , Xp given by?

A

Y^i = B^0 +B^1xi1 + B6

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

For a simple regression, parameters B0 and B1 determine equation for a line. What do they determine in multiple regression?

A

Hyperplane

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is a matrix X an arranged arrangement of?

A

(X)ij = xij

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

A matrix X is of what order?

A

r x c

It has r rows and c columns with i = 1 (row) and j = 1 (column)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

How can a matrix be visualised

A

As a spreadsheet of numbers with rows r and columns c

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are vectors?

A

Special cases of matrices in which one of the dimensions is 1

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is a column vector?

A

A matrix of order (r x1)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is a row vector?

A

Matrix of order (1xc)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is a scalar or element?

A

Matrix of order (1x1)

Scalars are entries in matrix, denoted by non bold letter

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

All symmetric matrices are what?

A

Square

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

A matrix is said to be square if what?

A

r = c.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

A matrix is symmetric, if what?

A

xij = xji , for all i = 1, . . . , r , and j = 1, . . . , c.

17
Q

What matrix is non standardised?

A

Covariance

18
Q

What matrix is standardised?

A

Correlation

19
Q

A square matrix is diagonal if what?

A

If xij = 0, for every i /= j.

20
Q

The diagonal matrix, whose diagonal elements are 1’s is the identity matrix, and is denoted as what?

A

In (I is bold)

21
Q

The multivariate mean is also what?

A

A p-dimensional column vector, ¯x.

¯x = x1 + x2 + . . . + xn.

22
Q

The multivariate mean is also what?

A

A p-dimensional column vector, ¯x.

¯x = x1 + x2 + . . . + xn.

23
Q

Vectors are treated as numbers as long as what?

A

They have the same dimensions

24
Q

How is matrix addition applied?

A

Elementwise, or element by element.

25
Q

How is matrix subtraction applied?

A

Elementwise, or element by element.

26
Q

To transpose a matrix is to what?

A

Invert its dimensions.

27
Q

The transpose of a matrix A of order r × c is the matrix what?

A

AT of order c × r
with (AT )ij = (A)ji.
for every i = 1, . . . , r and j = 1, . . . , c.

28
Q

Transposition is so common that the command in R is just..

A

t(A) for some matrix A.