A Novel Elite-Guided Hybrid Metaheuristic Algorithm for Efficient Feature Selection
Zichuan Chen, Bin Fu, Yangjian Yang
Abstract
Feature selection aims to identify a relevant subset of features from the original feature set to enhance the performance of machine learning models, which is crucial for improvig model accuracy. However, this task is highly challenging due to the enormous search space, often requiring the use of meta-heuristic algorithms to efficiently identify near-optimal feature subsets. This paper proposes an improved algorithm based on Northern Goshawk Optimization (NGO), called Elite-guided Hybrid Northern Goshawk Optimization (EH-NGO), for feature selection tasks. The algorithm incorporates an elite-guided strategy within the NGO framework, leveraging information from elite individuals to direct the population's evolutionary trajectory. To further enhance population diversity and prevent premature convergence, a vertical crossover mutation strategy is adopted, which randomly selects two different dimensions of an individual for arithmetic crossover to generate new solutions, thereby improving the algorithm's global exploration capability. Additionally, a boundary control strategy based on the global best solution is introduced to reduce ineffective searches and accelerate convergence. Experiments conducted on 30 benchmark functions from the CEC2017 and CEC2022 test set demonstrate the superiority of EH-NGO in global optimization, outperforming eight compared state-of-the-art algorithms. Furthermore, a novel feature selection method based on EH-NGO is proposed and validated on 22 datasets of varying scales. Experimental results show that the proposed method can effectively select feature subsets that contribute to improved classification performance.