Forward selection

Forward selection uses searching as a technique for selecting the best features. It is an iterative method in which we start with having no feature in the model.

Visualization of forward selection model

The step forward feature selection procedure begins by evaluating all feature subsets that consist of only one input variable. It selects the “best” feature and afterwards, adds all the other features to it individually, and selects a second feature that creates the new best performing model.

C:\Users\SAI\Downloads\forward steps.png
Wrapper method : Workflow of forward feature selection [1]

The process repeats over and over, adding one feature at a time until it meets certain criteria. After adding additional features to the subset, if the machine learning model performance doesn’t improve by more than a specific threshold, then we can stop the search and select this feature subset.


[1] https://trainindata.medium.com/feature-selection-for-machine-learning-a-comprehensive-overview-bd571db5dd2d

Similar Posts

Leave a Reply

Your email address will not be published.