Technical Interview Flashcards
What is backpropagation?
A technique for training neural networks that uses gradient desent to calculate the loss function at output and distribute it back through the neural network, resulting in adjusted weights for neurons.
What is a nonparametric model?
A non-parametric model is one with no assumptions about a variable’s distribution. Easier to use but decreased accuracy.
Difference between statistics and machine learning?
Statistics establishes causal relations while machine learning focuses on predictive accuracy.
Support Vector Machine is used to create a line between two groups and is more memory intensive and will take longer to tune.
Random forest is for a semi-supervised learning problem such as dissimilarity measure.
What is an autoencoder?
type of neural network and a form of feature extraction
Bagging and boosting in an ensemble model
Bagging and boosting both will take random samples from the data over and over to help mold better results. In bagging you always have the same probability to appear as data but in boosting it keeps some data to guide the new data set
What is a loss function in a neural network?
The loss function describes the magnitude of error a network made during prediction.
RDBMS
Relational database management system which maintains data records and fields in tables.
Regularization is a technique used for tuning the function by adding an additional penalty term in the error function.
Lasso and ridge regression which can help with overfitting and select which feature are important
What is a perceptron?
An algorithm for supervised learning of binary classifiers(a function which can decide whether or not an input belongs to some specific class