Class Three Flashcards

1
Q

What is AI?

A

Artificial Intelligence (AI) is a branch or Computer Science that uses algorithms and techniques to mimic human intelligence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is ML?

A

Machine Learning (ML) is one of several AI techniques for sophisticated cognitive tasks

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is supervised machine learning?

A

Supervised machine learning is a type of machine learning where the algorithm learns from labeled training data to make predictions or classify new, unseen data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the three approaches to AI?

A

Symbolic, Statistical, and ML (chess game)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is K-Nearest Neighbors (KNN)?

A

K-Nearest Neighbors (KNN) is a supervised machine learning algorithm that classifies data points based on their proximity to the K nearest neighbors in the training set.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the advantages of K-Nearest Neighbors (KNN)?

A

Advantages of KNN include its simplicity, ability to handle multi-class classification, and flexibility in handling both numerical and categorical data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

When should you use K-Nearest Neighbors (KNN)?

A

KNN is suitable when the data has well-defined clusters, and when the decision boundary is expected to be nonlinear or complex.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How does K-Nearest Neighbors (KNN) algorithm determine the class of a data point?

A

KNN determines the class of a data point by majority voting among its K nearest neighbors, where each neighbor contributes one vote.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the limitations of K-Nearest Neighbors (KNN)?

A

Limitations of KNN include its computational complexity for large datasets, sensitivity to the choice of K and distance metric, and the need for proper scaling of features.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is linear regression?

A

Linear regression is a supervised machine learning algorithm used to model the relationship between a dependent variable and one or more independent variables, assuming a linear relationship.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the advantages of linear regression?

A

Advantages of linear regression include its interpretability, simplicity, and the ability to quantify the strength and direction of relationships between variables. Furthermore, you can take large amounts of raw data and transform it into actionable insights, and we can uncover patterns and relationships.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

When should you use linear regression?

A

Linear regression is suitable when there is a linear relationship between the dependent and independent variables, and when the goal is to predict a continuous target variable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the assumptions of linear regression?

A

Linear regression assumes a linear relationship between the dependent and independent variables, independence of errors, homoscedasticity (constant variance of errors), and absence of multicollinearity.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the limitations of linear regression?

A

Limitations of linear regression include its assumption of linearity, sensitivity to outliers, reliance on independence and homoscedasticity assumptions, and inability to capture complex relationships.

Disadvantages:
* Performs poorly when there are non-linear relationships.
* Sensitive to outliers.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is logistic regression?

A

Logistic regression is a supervised machine learning algorithm that models the relationship between the independent and dependent variable and estimates the probability of an event occurring.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are the advantages of logistic regression?

A

Advantages of logistic regression include its interpretability, simplicity, and the ability to estimate class probabilities.

17
Q

How does logistic regression model the relationship between variables?

A

Logistic regression models the relationship between variables by using the logistic function to estimate the probability of an event occurring given the values of the independent variables.

18
Q

What are the limitations of logistic regression?

A

1.Linear relationship assumption

2.Independence of observations

3.Sensitive to Outliers

4.Assumes little to no Multicollinearity

5.No Missing data assumption

19
Q

What are the types of logistic regressions?

A

Binary logistic regression: Dependent variable has only two possible outcomes
(e.g. 0 or 1).

Multinomial logistic regression: Dependent variable has three or more possible outcomes but no specified order.(E.g. Movie marketing strategy)

Ordinal logistic regression: Dependent variable has three or more
possible outcomes but with specified order. (E.g 1-12)

20
Q

What is LDA?

A

LDA stands for Linear Discriminant Analysis. It is a dimensionality reduction and classification technique that aims to find a linear combination of features that maximizes the separation between classes while reducing the dimensionality of the data.
It finds the optimal projection that maximizes the between-class scatter and minimizes the within-class scatter, resulting in a lower-dimensional space that best discriminates between different classes

21
Q

What are the LDA Types?

A

Class-dependent LDA: One separate lower dimensional space is calculated for each class to project its data on it.

Class-independent LDA: Each class will be considered as a separate class against other classes.