Mathematics and Programming for AI Flashcards
What is the backbone of AI?
mathematics
What are the 3 main branches of mathematics in AI?
linear algebra, calculus, and probability
What is linear algebra?
a type of math that deals with linear equations and their representations using matrices
What are vectors?
quantities that have both magnitude and direction
What are matrices?
Rectangular arrays of numbers, can represent linear transformations, systems of linear equations, coordinates of vectors, etc.
What are linear transformations?
functions that map vectors from one vector space to another while preserving properties of vector addition and scalar multiplication
How does AI represent data using linear algebra?
uses vectors, matrices, and tensors to describe datasets
Which sub-fields of AI use linear algebra?
NPL, ML, DL
What data processing operations are used in AI and why?
mean subtraction, normalization, and PCA & whitening are used before using data sets in ML algorithms
What linear algebra concept is used in ML algorithms?
regression analysis
What is regression analysis?
predicts continuous responses based on relationships between dependent and independent variables
How does DL use linear algebra?
at each step of neural networks: input, neurons, layers, feedforward propagation, and back-propagation
How does NLP utilize linear algebra?
for word2vec and vector similarity checking
What does calculus do?
analyzes the rate of change of quantities like area, volume, and length
What is the difference between differential calculus and integral calculus?
differential breaks down and studies changes while integral joins fragments and studies changes
What describes the instantaneous movement of a certain function?
differentiation
What is differentiation?
process of finding the derivative of a function
What does the instantaneous rate of change of a function refer to?
the slope of the tangent line at each point of the function
What is the derivative?
a function that corresponds to the slope of the tangent line at a specific point on a function
Why is calculus important for AI?
it helps with finding minimum cost and using techniques like gradient descent
What are gradient descent techniques?
techniques to study how outputs change when inputs change
What does gradient descent involve?
finding the derivative of a function
When are partial derivatives used for gradient descent?
when there are multiple inputs
What is the gradient?
a vector that contains all the partial derivatives
