How to reduce Overfitting?

From our earlier post, we now know the impacts of bias and variance that lead our model to overfit and underfit.
Now let’s dig deeper and see how we can reduce overfitting.

Overfitting reducing method

There are several techniques to avoid overfitting in Machine Learning altogether listed below:

  1. Regularization:
  • L1 lasso
  • L2 ridge
  1. Reduce the number of features
  2. Dropout
  3. Pruning
  4. Cross-validation Sampling (k cross-validation)
  5. Ensembling 
  6. Batch normalization

Here’s an example that will walk you through the overfitting and underfitting concepts:

The following articles also show us ways to handle/reduce overfitting:

Similar Posts

Leave a Reply

Your email address will not be published.