Chapter 2 - Supervised Network (Perceptron) Flashcards

1
Q

What are Artificial Neural Networks (ANNs) described as?

A

hey are described as self-learning mechanisms that do not require traditional programming skills

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is a key component of an artificial neural network?

A

It consists of interconnected processors called neurons

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How do neurons in an ANN communicate?

A

They communicate through weighted links that pass signals from one neuron to another

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How many output signals does a neuron produce?

A

A neuron produces only one output signal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the role of weights in ANNs?

A

Weights are a means of long-term memory, and they express the strength or importance of connections

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How does a neural network learn?

A

It learns by repeatedly adjusting the weights

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the main idea behind supervised learning?

A

Training a model on a labeled dataset, where input data is paired with the correct output, allowing the model to learn how to map inputs to outputs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How does a supervised learning model learn?

A

By minimizing the error between its predictions and the actual labels

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the two main phases in supervised learning?

A

Training and testing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Give an example of a supervised learning task.

A

Image classification, spam detection, predictive maintenance, and medical diagnosis are all examples of supervised learning tasks

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the goal of regression?

A

To predict a continuous outcome based on one or more input features

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is linear regression?

A

The simplest form of regression, which models the relationship between the input and output as a straight line

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

How is linear regression visualized?

A

Using scatter plots with a regression line and plots showing the cost function’s surface with gradient descent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Why is linear regression a good starting point for machine learning problems?

A

Because it is simple and interpretable, especially when the relationship between the features and the target is linear

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the limitations of linear regression?

A

It is limited when the relationship between input and output is nonlinear, or when there are complex interactions between features

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is a neuron described as in the context of computing?

A

A simple computing element that receives input signals, computes an activation level, and sends an output signa

17
Q

What is the purpose of an activation function?

A

To introduce non-linearity into the output of a neuron and decide whether it should be activated

18
Q

What is a binary step function?

A

A threshold-based activation function where the neuron is activated if the input is above or below a certain threshold

19
Q

How does the sign activation function work?

A

It is a threshold-based activation function that produces +1 or -1 based on input

20
Q

What are the characteristics of the Sigmoid/Logistic activation function?

A

It produces a smooth gradient, bounds output values between 0 and 1, and enables clear predictions by bringing the output close to 1 or 0 when the input is above 2 or below -2

21
Q

How does a perceptron produce an output?

A

The output is generated by applying an activation function to the weighted sum of inputs plus a bias

22
Q

What are the steps involved in training a perceptron?

A

Initialization, activation, weight training/adjustment, and iteration

23
Q

How is the error calculated in a perceptron?

A

Error is calculated as the difference between the desired output and the actual output

24
Q

How are the weights updated in a perceptron?

A

The weight change is calculated by multiplying the learning rate (alpha), the input, and the error; the current weight is then updated by adding the weight change to it

25
Q

When does the training iteration of a perceptron end?

A

When the perceptron reaches zero error for all possible input-output pairs

26
Q

Can a perceptron learn the XOR operation?

A

The source suggests this as an exercise without providing the answer, but it implies that a simple perceptron cannot learn XOR

27
Q

What is the definition of a linearly separable function in a 3-dimensional space?

A

The source prompts the reader to think about the concept without defining it explicitly