Mathematics and Programming for AI Flashcards
What is the backbone of AI?
mathematics
What are the 3 main branches of mathematics in AI?
linear algebra, calculus, and probability
What is linear algebra?
a type of math that deals with linear equations and their representations using matrices
What are vectors?
quantities that have both magnitude and direction
What are matrices?
Rectangular arrays of numbers, can represent linear transformations, systems of linear equations, coordinates of vectors, etc.
What are linear transformations?
functions that map vectors from one vector space to another while preserving properties of vector addition and scalar multiplication
How does AI represent data using linear algebra?
uses vectors, matrices, and tensors to describe datasets
Which sub-fields of AI use linear algebra?
NPL, ML, DL
What data processing operations are used in AI and why?
mean subtraction, normalization, and PCA & whitening are used before using data sets in ML algorithms
What linear algebra concept is used in ML algorithms?
regression analysis
What is regression analysis?
predicts continuous responses based on relationships between dependent and independent variables
How does DL use linear algebra?
at each step of neural networks: input, neurons, layers, feedforward propagation, and back-propagation
How does NLP utilize linear algebra?
for word2vec and vector similarity checking
What does calculus do?
analyzes the rate of change of quantities like area, volume, and length
What is the difference between differential calculus and integral calculus?
differential breaks down and studies changes while integral joins fragments and studies changes
What describes the instantaneous movement of a certain function?
differentiation
What is differentiation?
process of finding the derivative of a function
What does the instantaneous rate of change of a function refer to?
the slope of the tangent line at each point of the function
What is the derivative?
a function that corresponds to the slope of the tangent line at a specific point on a function
Why is calculus important for AI?
it helps with finding minimum cost and using techniques like gradient descent
What are gradient descent techniques?
techniques to study how outputs change when inputs change
What does gradient descent involve?
finding the derivative of a function
When are partial derivatives used for gradient descent?
when there are multiple inputs
What is the gradient?
a vector that contains all the partial derivatives
How does statistics play a part in AI?
using regression analysis, K-mean, K-NN classification
Why is a basic knowledge of probability and statistics required in AI?
learning results of AI are probabilistic
What does statistics do well at?
predicting weather or economic indicators
Which language was widely used in early applications of AI?
lisp
What other languages are widely used in AI?
prolog, python
What is lisp an abbreviation for?
list processing
When was lisp developed and by who?
McCarthy in 1960
What kind of data types does lisp handle easily?
symbolic data types
Which data structures does lisp use?
lists and trees
Is lisp an interpreted language?
yes
When and by who was prolog developed?
Kowalski in 1972
What kind of language is prolog?
a logic-based programming language
What kind of AI tools is prolog useful for?
NLP and expert system development
Why is prolog good for NLP and expert system development?
knowledge is expressed in descriptive logic and inferred according to rules
Why is python becoming popular for AI programming?
grammar is simple and it can be learned quickly and easily, execution can be checked immediately, and it is platform independent
When and by who was python developed?
Guido van Rossum in 1991
What are the 3 types of languages that programming languages are categorized into?
object-oriented, procedural, and functional
What type of programming language is python?
it has features of all 3 different types
What are some other less commonly used languages for AI?
R and C
What areas is R strong in?
graphic visualization
What are some neural network libraries that are used for deep learning?
TensorFlow and PyTorch
Which language(s) is/are used for rule-based AI?
lisp and prolog
Which language(s) is/are used for neural network AI?
python
