Machine Learning Concepts – Cheat Sheet

This post covers some of the basic Machine Learning concepts mostly relevant for the AWS Machine Learning certification exam.

Machine Learning Lifecycle

Data Processing and Exploratory Analysis

• To train a model, you need data.
• Type of data that depends on the business problem that you want the model to solve (the inferences that you want the model to generate).
• Process data includes data collection, data cleaning, data split, data exploring, preprocessing, transformation, formatting etc.

Feature Selection and Engineering

• helps improve model accuracy and speed up training
• remove irrelevant data inputs using domain knowledge for e.g. name
• remove features which has same values, very low correlation, very little variance or lot of missing values
• handle missing data using mean values or imputation
• combine features which are related for e.g. height and age to height/age
• convert or transform features to useful representation for e.g. date to day or hour
• standardize data ranges across features

Missing Data

• do nothing
• remove the feature with lot of missing data points
• remove samples with missing data, if the feature needs to be used
• Impute using mean/median value
  • no impact and the dataset is not skewed
  • works with numerical values only. Do not use for categorical features.
  • doesn’t factor correlations between features

• Impute using (Most Frequent) or (Zero/Constant) Values
  • works with categorical features
  • doesn’t factor correlations between features
  • can introduce bias
• Impute using k-NN, Multivariate Imputation by Chained Equation (MICE), Deep Learning
  • more accurate than the mean, median or most frequent
  • Computationally expensive

Unbalanced Data

• Source more real data
• Oversampling instances of the minority class or undersampling instances of the majority class
• Create or synthesize data using techniques like SMOTE (Synthetic Minority Oversampling TEchnique)

Label Encoding and One-hot Encoding

• Models cannot multiply strings by the learned weights, encoding helps convert strings to numeric values.
• Label encoding
  • Use Label encoding to provide lookup or map string data values to a numerical values
  • However, the values are random and would impact the model
• One-hot encoding
  • Use One-hot encoding for Categorical features that have a discrete set of possible values.
  • One-hot encoding provide binary representation by converting data values into features without impacting the relationships
  • a binary vector is created for each categorical feature in the model that represents values as follows:
    • For values that apply to the example, set corresponding vector elements to 1.
    • Set all other elements to 0.
  • Multi-hot encoding is when multiple values are 1

Cleaning Data

• Scaling or Normalization means converting floating-point feature values from their natural range (for example, 100 to 900) into a standard range (for example, 0 to 1 or -1 to +1)

Train a model

• Model training includes both training and evaluating the model,
• To train a model, algorithm is needed.
• Data can be split into training data, validation data and test data
  • Algorithm sees and is directly influenced by the training data
  • Algorithm uses but is indirectly influenced by the validation data
  • Algorithm does not see the testing data during training
• Training can be performed using normal parameters or features and hyperparameters

Supervised, Unsupervised, and Reinforcement Learning

Splitting and Randomization

• Always randomize the data before splitting

Hyperparameters

• influence how the training occurs
• Common hyperparameters are learning rate, epoch, batch size
• Learning rate
  • size of the step taken during gradient descent optimization
  • Large learning rates can overshoot the correct solution
  • Small learning rates increase training time
• Batch size
  • number of samples used to train at any one time
  • can be all (batch), one (stochastic), or some (mini-batch)
  • calculable from infrastructure
  • Small batch sizes tend to not get stuck in local minima
  • Large batch sizes can converge on the wrong solution at random.
• Epochs
  • number of times the algorithm processes the entire training data
  • each epoch or run can see the model get closer to the desired state
• depends on algorithm used

Evaluating the model

After training the model, evaluate it to determine whether the accuracy of the inferences is acceptable.

ML Model Insights

• For binary classification models use accuracy metric called Area Under the (Receiver Operating Characteristic) Curve (AUC). AUC measures the ability of the model to predict a higher score for positive examples as compared to negative examples.
• For regression tasks, use the industry standard root mean square error (RMSE) metric. It is a distance measure between the predicted numeric target and the actual numeric answer (ground truth). The smaller the value of the RMSE, the better is the predictive accuracy of the model.

Cross-Validation

• is a technique for evaluating ML models by training several ML models on subsets of the available input data and evaluating them on the complementary subset of the data.
• Use cross-validation to detect overfitting, ie, failing to generalize a pattern.
• there is no separate validation data, involves splitting the training data into chunks of validation data and use it for validation

Optimization

• Gradient Descent is used to optimize many different types of machine learning algorithms
• Step size sets Learning rate
  • If the learning rate is too large, the minimum slope might be missed and the graph would oscillate
  • If the learning rate is too small, it requires too many steps which would take the process longer and is less efficient

Underfitting

• Model is underfitting the training data when the model performs poorly on the training data because the model is unable to capture the relationship between the input examples (often called X) and the target values (often called Y).
• To increase model flexibility
  • Add new domain-specific features and more feature Cartesian products, and change the types of feature processing used (e.g., increasing n-grams size)
  • Regularization – Decrease the amount of regularization used
  • Increase the amount of training data examples.
  • Increase the number of passes on the existing training data.

Overfitting

• Model is overfitting the training data when the model performs well on the training data but does not perform well on the evaluation data because the model is memorizing the data it has seen and is unable to generalize to unseen examples.
• To increase model flexibility
  • Feature selection: consider using fewer feature combinations, decrease n-grams size, and decrease the number of numeric attribute bins.
  • Simplify the model, by reducing the number of layers.
  • Regularization – technique to reduce the complexity of the model. Increase the amount of regularization used.
  • Early Stopping – a form of regularization while training a model with an iterative method, such as gradient descent.
  • Data Augmentation – process of artificially generating new data from existing data, primarily to train new ML models.
  • Dropout is a regularization technique that prevents overfitting.

Classification Model Evaluation

Confusion Matrix

• Confusion matrix represents the percentage of times each label was predicted in the training set during evaluation
• An NxN table that summarizes how successful a classification model’s predictions were; that is, the correlation between the label and the model’s classification.
• One axis of a confusion matrix is the label that the model predicted, and the other axis is the actual label.
• N represents the number of classes. In a binary classification problem, N=2
  • For example, here is a sample confusion matrix for a binary classification problem:

• • Confusion matrix shows that of the 19 samples that actually had tumors, the model correctly classified 18 as having tumors (18 true positives), and incorrectly classified 1 as not having a tumor (1 false negative).
  • Similarly, of 458 samples that actually did not have tumors, 452 were correctly classified (452 true negatives) and 6 were incorrectly classified (6 false positives).
• Confusion matrix for a multi-class classification problem can help you determine mistake patterns. For example, a confusion matrix could reveal that a model trained to recognize handwritten digits tends to mistakenly predict 9 instead of 4, or 1 instead of 7.

Accuracy, Precision, Recall (Sensitivity) and Specificity

Accuracy

• A metric for classification models, that identifies fraction of predictions that a classification model got right.
• In Binary classification, calculated as (True Positives+True Negatives)/Total Number Of Examples
• In Multi-class classification, calculated as Correct Predictions/Total Number Of Examples

Precision

• A metric for classification models. that identifies the frequency with which a model was correct when predicting the positive class.
• Calculated as True Positives/(True Positives + False Positives)

Recall – Sensitivity – True Positive Rate (TPR)

• A metric for classification models that answers the following question: Out of all the possible positive labels, how many did the model correctly identify i.e. Number of correct positives out of actual positive results
• Calculated as True Positives/(True Positives + False Negatives)
• Important when – False Positives are acceptable as long as ALL positives are found for e.g. it is fine to predict Non-Tumor as Tumor as long as All the Tumors are correctly predicted

Specificity – True Negative Rate (TNR)

• Number of correct negatives out of actual negative results
• Calculated as True Negatives/(True Negatives + False Positives)
• Important when – False Positives are unacceptable; it’s better to have false negatives for e.g. it is not fine to predict Non-Tumor as Tumor; 

ROC and AUC

ROC (Receiver Operating Characteristic) Curve

• An ROC curve (receiver operating characteristic curve) is curve of true positive rate vs. false positive rate at different classification thresholds.
• An ROC curve is a graph showing the performance of a classification model at all classification thresholds.
• An ROC curve plots True Positive Rate (TPR) vs. False Positive Rate (FPR) at different classification thresholds. Lowering the classification threshold classifies more items as positive, thus increasing both False Positives and True Positives.

  

AUC (Area under the ROC curve)

• AUC stands for “Area under the ROC Curve.”
• AUC measures the entire two-dimensional area underneath the entire ROC curve (think integral calculus) from (0,0) to (1,1).
• AUC provides an aggregate measure of performance across all possible classification thresholds.
• One way of interpreting AUC is as the probability that the model ranks a random positive example more highly than a random negative example.

F1 Score

• F₁ score (also F-score or F-measure) is a measure of a test’s accuracy.
• It considers both the precision p and the recall r of the test to compute the score: p is the number of correct positive results divided by the number of all positive results returned by the classifier, and r is the number of correct positive results divided by the number of all relevant samples (all samples that should have been identified as positive). we.

Deploy the model

• Re-engineer a model before integrate it with the application and deploy it.
• Can be deployed as a Batch or as a Service