AI Flashcards
What is Zero-shot learning?
Zero-shot learning (ZSL) is a problem setup in machine learning, where at test time, a learner observes samples from classes, which were not observed during training, and needs to predict the class that they belong to.
What is ReLU (Rectified Linear Unit) activation?
If the input is less than or equal to 0 it sets the ouput to 0, else it takes just the input
What is a utility function?
A utility function is a representation to define individual preferences for goods or services beyond the explicit monetary value of those goods or services. In other words, it is a calculation for how much someone desires something, and it is relative.
What does the tanh activation function do?
It caps the output in the range from -1 to 1 where very negative becomes -1 and very positive become 1.
What is essentially the derivate saying in backpropagation in a nueral net?
It is saying how much do i affect the change in the derivative of the next nodes. So for example if there is x = 0 times y = 1 then y will have a 0 gradient because no matter how much you add to y it’s not gonna matter at all because its multiplying by 0.
