AI REVISION 1 Flashcards

1
Q

What is the turing test? and examples

A

The turing test is a test created by Alan turing which was a test that consisted of an interrogator being connected to a person and a machine via a terminal and cannot see either of them, if the machine could trick the interrogator 30% of the time when answering questions the machine was considered intelligent.

Examples -> Siri, chatbot

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is combinatorial explosion?

A

Occurs in numeric problems where the complexity of the problem rapidly increases caused by the increasing number of possible combinations of inputs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is machine learning?

A

Machine learning is a field of study that gives computers ability to learn without being explicitly programmed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is supervised learning vs unsupervised learning

A

Supervised learning relies on labelled input and output training data, whereas unsupervised learning processes unlabelled or raw data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

2 Examples of supervised and unsupervised learning

A

Supervised learning.
1. HandWriting Recognition
2. Traffic Prediction

Unsupervised Learning
1. AD Targeting (e.g. group similar costumers together)
2. Crime Hotspots (e.g. identify areas with high crime rate and report it to police management.)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is clustering?

A

Clustering is an unsupervised technique about grouping similar objects, the input is unlabelled data as mentioned before, and the goal is to find a natural partitioning or groups of similar data points.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is Association rules?

A

Association rules is an unsupervised technique that involves the input being a set of transaction records containing items and the goal is to produce dependency rules to predict occurrence of one variable based on occurrences of another variables.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is data mining?

A

Is the analysis of large quantities of data to discover, valid, non-obvious, useful, and ultimately humans should be able to understand pattern in data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

How is the data split?

A

The data is usually split into two groups, training set and test set (used as estimate of how well the model works)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is model training?

A

Learn the model parameters

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Decision Tree nodes and goal

A

Internal nodes: Decision Rules on features
Leaf nodes: Predicted class label

Ultimate Goal -> Prediction

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Decision tree pros and cons

A

Pros - 1.Easy to interpret and explain decisions, 2. Reasonable training time, 3. Feature scaling not necessary
Cons - 1. Small variations in data can lead to very different trees, 2. over complex trees can lead to overfitting

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is linear regression?

A

Supervised learning technique to estimate a relationship between an input variable X, and output variable X.

aim -> find a line of best fit.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Linear regression pros and cons ->

A

Pros -> 1. easy to interpret
2. easy to train
3. works well even with limited data

Cons ->
1. only applicable if relationship is linear
2. relies on assumptions about the data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is model evaluation?

A

How well does the model do on the validation set.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is model tuning?

A

adjust model hyperparameters

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is overfitting

A

the model fits too well to the training data which negatively impacts performance on unseen data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Why overfitting happens?

A
  1. Training data is limited
  2. Model is too complex
19
Q

How to fix overfitting?

A
  1. Train with more data
  2. Simplify the model.
20
Q

Explain first artificial Neurons

A

Combine binary inputs with some weights and compare it with a fixed threshold t to decide if neuron fires 1 or 0, that is done by multiplying and adding both inputs, e.g. if weight coeff was w1= 2 and w2 = 2 then x1 and x2 would be -> w1*x1 + w2+x2 = … and that results would create a logic gate.

21
Q

What is perceptron

A

Is a learning algorithm that learn the weights to help detect certain input data in business intelligence.

22
Q

Explain the learning algorithm of perceptron

A

The weights are adjusted automatically, as more instances are checked if they are misclassified then the weights are adjusted and eventually the algorithm will converge the set of weights that separates the two classes if the function is linearly separable.

23
Q

What is epoch?

A

Is the training of the neural network with all the training data for one cycle.

24
Q

What is learning rate?

A

is a hyperparameter of the model that controls how much we adjust the weights by each time an error is produced

25
Q

What are issues if learning rate is too high?

A

May jump over a good combination of weights.

26
Q

What are issues if learning rate is too low?

A

Training will take a very long time

27
Q

Pros and cons of neural networks

A

Pros -> 1. Can learn more complicated decision boundaries, 2. Can handle a large number of features.

Cons -> 1. Difficult to interpret
2. Difficult to design neural networks
3. Slow training time.

28
Q

What is the concept of search space?

A

is to find the set of all possible solutions to a problem. e.g. input a problem
return solutions to the problem.

29
Q

Construct a search tree , states, search space, operators, neighbourhood, goal test, path cost.

A

States: Possible states of the problem
Search space: all possible states reachable from the initial state
Operators - a set of actions that move one state to another.
Neighbourhood: All possible states reachable from a given state
Goal test: test if the search reached a state that solves the problem
Path cost: how much it costs to take a certain path.

30
Q

Problems with search tree

A
  1. Tree size it can be combinatorial explosion
  2. Computational expensive.
31
Q

What is a blind search? and their searches, e.g. BFS

A

Is a search where no information about the search space is given.

  1. Breadth first search (BFS)
  2. Depth First Search (DFS)
  3. Uniform Cost Search (UCS)
32
Q

What are the three nodes during search in tree search?

A
  1. Fringe nodes (open nodes which have not been tested but have been discovered)
  2. Visited nodes (Closed nodes which have been explored and tested if they match a goal)
  3. Undiscovered nodes (have not yet been discovered)
33
Q

What are the three nodes during search in tree search?

A
  1. Fringe nodes (open nodes which have not been tested but have been discovered)
  2. Visited nodes (Closed nodes which have been explored and tested if they match a goal)
  3. Undiscovered nodes (have not yet been discovered)
34
Q

What is BFS?

A

Expand root node first and then expand all nodes in level 1 before expanding nodes on level 2
(ENQUEUE-AT-END)

completeness and optimal

35
Q

What is DFS?

A

Expand root node first and explore one branch before exploring another branch.
(ENQUEUE-AT-FRONT)
not completeness and not optimal

36
Q

What is UCS?

A

Expand root node first
always remove the smallest cost node first in the queue
(ENQUEUE-BY-COST)
completeness and optimal

37
Q

What is meant by admissible heuristic?

A

heuristic is only admissible if it never over-estimates the actual cost, e.g by always being either equal or below the actual cost

38
Q

What is A* Search?

A

A* Search is a heuristic search which the aim is to estimate the actual cost to reach the goal state in a search space

(ENQUEUE-BY-ESTIMATED-COST)

Optimal if cost is not over-estimated | Completeness

39
Q

What is the minimax search?

A

The minimax search is a game search done in a search tree which finds the most optimal move for a player.

40
Q

What is the utility function in minimax search? and when do you use it.

A

A method of measuring how good a game state is.

And you propagate utility function values from leaf node to root node.

41
Q

How to find the utility values of a move?

A

For a leaf node is just the utility value of its outcome (of the game).

And for a root node is based on the value of their child nodes.

42
Q

What is alpha-beta pruning?

A

Alpha-Beta pruning is a technique that helps the minimax search to be more efficient, by decreasing the number of nodes that are evaluated by the minimax search algorithm.

43
Q

What does Alpa and Beta mean in the Alpha-Beta Pruning

A

Alpha: the minimum score that MAX is assured of
Beta: The maximum score that MIN is assured of.