Final Study Cards Flashcards
What is a scalar valued function?
A scalar valued function is a function which maps R^n onto R
When is a scalar valued function linear?
A scalar valued function is linear if it has the form f(x1,…,xn) = a1x1 + a2x2 + ··· + anxn
i.e., it is affine with b = 0, or equivalently with f(0) = 0.
When is a scalar valued function affline?
A scalar valued function is affline if it has the form f(x1,…,xn) = a1x1 + a2x2 + ···+ anxn + b for some numbers a1,…,an,b (so b = f(0)).
What is the derivative matrix of a vector valued function?
The derivative matrix of a vector valued function f(x) = {f_1(x), f_2(x), f_3(x),…,f_n(x)
is the matrix such that
| f_1/dx_1 f_1/dx_2 f_1/dx_3 … f_1/dx_n|
| f_2/dx_1 f_2/dx_2 f_2/dx_3 … f_2/dx_n|
| f_3/dx_1 f_3/dx_2 f_3/dx_3 … f_3/dx_n|
| …
| f_n/dx_1 f_n/dx_2 f_n/dx_3 … f_n/dx_n|
f_1/dx_1 f_1/dx_2 f_1/dx_3 … f1/dx_n|
What are the two linear approximations for a function F at x using the derivative matrix (where a is a close value)?
f(x) ≈f(a) + ((Df)(a))(x −a)
and
f(a + h) ≈f(a) + ((Df)(a)) h
What is the linearity principle?
for c1,c2 ∈R and v1,v2 ∈R^2 we have f(c1v1 + c2v2) = c1f(v1) + c2f(v2).
When is a function g linear?
When g(cx) = cg(x), g(x + y) = g(x) + g(y)
What is the rotation matrix for R^2?
Aθ =
|cos θ −sin θ|
|sin θ cos θ|
.
What is the identity matrix and what are it’s properties?
The identity matrix is an n x n square matrix such that its entries are equal to
|1 0 0 … 0|
|0 1 0 … 0|
|0 0 1 … 0|
|… |
|0 0 0 … 1|
The special property of the identity matrix is that any m x n matrix A multiplied by its respective n x n identity matrix is equal to A
so A*I_n = A
What are the important properties of matrix multiplication
(MM1) It recovers matrix-vector multiplication: if A is an m ×n matrix, and x ∈ R_n is thought of as an n ×1 matrix, the matrix-matrix product Ax is the same as the matrix-vector product.
(MM2) A(B + C) = AB + AC and (A′ + B′)C′ = A′C′ + B′C′. (These “distributive laws” are the
reason we call it matrix multiplication.)
(MM3) A(BC) = (AB)C, and A(cB) = (cA)B = c(AB) for any scalar c. In particular, taking C
to be an m ×1 matrix that is a column vector v by another name, A(Bv) = (AB)v.
(MM4) If A is an m ×n matrix, then I_mA = A = AI_n, where I_m is the m × m identity matrix and I_n is the n ×n identity matrix.
What are some important assertions about matrix multiplication
AB != BA
AB = AC does not imply B = C
How does one set up and solve a markov chain problem?
First create a matrix M which models the total of each team after each cycle. For the n_th step in the cycle, the number at each position equals to M^n-1th * the original values
What is the multivariable chain rule at a point = (v1,…,vn) ∈ R^n?
(D(f ◦ g))(v) = (Df)(g(v)) (Dg)(v)
What is the definition of an inverse matrix B to a matrix A?
The inverse matrix B is a matrix such that BA = I_n and AB = I_n
If A is invertible, what is Ax = b equal to?
x = (A^-1)(b)
It is important to note that the position of the A is maintained relative to the vector it is multiplying (so x != (b)(A^-1))
What is true of n x n matrices with respect to their inverse?
If A and B are n × n matrices that satisfy AB = In then A is invertible and B is its
inverse; i.e., automatically the other equation BA = In holds.
How can you immediately tell if a set of vectors is not linearly independent?
If it has a vector which is not non-zero
When is a vector non-zero
When it has at least one entry which is not zero
The upper left to lower right diagonal of the inverse of a square matrix is always what
1/The original value of the position in the diagonal (aka the reciprocal)
What is the determinant of an upper or lower triangular matrix?
The product of its diagonal entries
When is a 2x2 matrix inversible?
When it’s determinant is not equal to 0
What is the determinant of a 2x2 matrix
The determinant is ad-bc where the slots are assigned
| a b |
| c d |
When is a matrix A invertible?
A is invertible precisely when Ax = 0 has x = 0 as its only solution, and A is non-invertible precisely when Ax = 0 has a nonzero solution.
What are some important matrix inversion rules?
(i) When A is invertible you can “cancel A” by multiplying both sides by A−1 (but there is a
caveat; see the Warning below):
– Cancelling an invertible matrix on the left: if AB = AC and A is invertible then
B = C. This holds because you multiply both sides on the left by A−1.
– Cancelling an invertible matrix on the right: if BA = CA and A is invertible then
B = C. For this you need to multiply both sides on the right by A−1.
– Warning: our caveat is that if AB = CA, then you cannot cancel A on the left on one
side and on the right on the other, so you cannot conclude in this case that B = C, even
when A is invertible (see Example 18.4.1 below).
(ii) If A and B are both invertible n ×n matrices then AB is also invertible, and (AB)−1 =
B−1A−1 (note the switch of order of multiplication on the right side!); see Example
18.4.3 below for an illustration.