Integrative Programming 5 Flashcards
Linear Regression
a simple algorithm that models linear relationship between inputs and continous numerical output variable
Linear Regression Use Cases
- stock price prediction
- house price prediction
- customer lifeline value prediction
Linear Regression Advantages
- explainable method
- interpretable results by its coefficients
- faster to train other than machine learning models
Linear Regression Disadvantages
- assumes linear relationship between input and output data
- sensitive to outliers
- can underfit small, high-dimensional data
Logistic Regression
an algorith that models linear relationship between input and categorical outputs ( 1 or 0)
Logistic Regresssion Use Cases
- credit risk score prediction
- customer churn prediction
Logistic Regresssion Advantages
- interpretable and explainable
- less prone to overfitting when using regularization
- applicaple for multi-class prediction
Logistic Regresssion Disadvantages
- assumes linear relationship between input and output
- Can overfit small, high-dimensional data
Lasso Regression
Part of the regression family — it penalizes
features that have low predictive outcomes by
shrinking their coeOcients closer to zero. Can
be used for classification or regression
Lasso Regression Use Cases
- predicting house prices
- predicting clinical outcomes based on health data
Lasso Regression Advantages
- less prone to overfitting
- can handle high dimensional data
- no need for feature selection
Lasso Regression Disadvantages
can lead to poor interopreability as it can keep highly correlated variables
Ridge Regression
Part of the regression family — it penalizes
features that have low predictive outcomes by
shrinking their coeOcients closer to zero. Can
be used for classification or regression
Ridge regression
- predictive maintenance for automobiles
- sales revenue prediction
Ridge Regression Advantages
- less prone to overfitting
- best suited where data suffer from multicollinearity
- explainable and interpretable
Ridge Regression Disadvantages
- all predictors are kept in the final model
- doesnt peform feature selection
Ridge Regression Case Uses
- prediction for automobile maintenace
- sales revenue prediction
Decision Tree
make decision rules on the features to produce predictions. It can be used for classification or regressio
Decision Tree Use Cases
- customer churn prediction
- credit score modeling
- disease prediction
Decision Tree Advantages
- explainable and interpretable
- can handle missing values
Decision Tree Disadvantages
- prone to ovefitting
- sensitive to outliers