Integration of Specific Local Search Methods in Metaheuristic Algorithms for Optimizing the Feature Selection Process: A Survey
Keywords:Metaheuristic Algorithms; Local Search Methods; Trajectory methods; Combinatorial Optimization; Feature Selection
Metaheuristic algorithms have proven to be quite effective at solving global optimization issues, particularly feature selection difficulties. This class of algorithms often uses a specialized local search technique as an inner component or as a post-processing mechanism to improve the performance of their search process. This paper presents a comprehensive survey of the use of local search methods integrated into metaheuristic algorithms for optimizing the feature selection process. Based on the manner of operation, the local search methods examined in this study were classed as one-way or two-way. In addition, practical suggestions were also discussed to point out possible future directions.
Adamu, A., Abdullahi, M., Junaidu, S. B., & Hassan, I. H. (2021). An hybrid particle swarm optimization with crow search algorithm for feature selection. Machine Learning with Applications, 6, 100108.
Al-betar, M. A. (2016). b -Hill climbing : an exploratory local search. Neural Computing and Applications.
Al-rawashdeh, G., Mamat, R., Hafhizah, N., & Abd, B. (2019). Hybrid Water Cycle Optimization Algorithm With Simulated Annealing for Spam E-mail Detection. IEEE Access, 7, 143721–143734.
Alhamidi, M. R. (2020). Optimal Feature Aggregation and Combination for Two-Dimensional Ensemble Feature Selection.
Alomari, O. A., Tajudin, A., Mohammed, K., & Mohammed, A. A. (2018). A novel gene selection method using modified MRMR and hybrid bat-inspired algorithm with β -hill climbing.
Alzaqebah, M., Alrefai, N., Ahmed, E. A. E., Jawarneh, S., & Alsmadi, M. K. (2020). Neighborhood search methods with moth optimization algorithm as a wrapper method for feature selection problems. International Journal of Electrical and Computer Engineering, 10(4), 3672–3684.
Alzaqebah, M., Jawarneh, S., Mohammad, R. M. A., Alsmadi, M. K., Al-marashdeh, I., Ahmed, E. A. E., Alrefai, N., & Alghamdi, F. A. (2021). Hybrid feature selection method based on particle swarm optimization and adaptive local search method.
Angeline, P. J. (1998). Evolutionary optimization versus particle swarm optimization: Philosophy and performance differences. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 1447, 601–610.
Asghar, A., Mirjalili, S., Faris, H., & Aljarah, I. (2019). Harris hawks optimization : Algorithm and applications. Future Generation Computer Systems, 97, 849–872.
Blot, A., Kessaci, M. É., & Jourdan, L. (2018). Survey and unification of local search techniques in metaheuristics for multi-objective combinatorial optimisation. Journal of Heuristics, 24(6), 853–877.
Blum, C., & Hutchison, D. (2013). LNCS 7919 - Hybrid Metaheuristics (Issue May).
Boussaïd, I., Lepagnot, J., & Siarry, P. (2013). A survey on optimization metaheuristics. Information Sciences, 237(February), 82–117.
Castro, L. N. De, & Zuben, F. J. Von. (2002). Learning and Optimization Using the Clonal Selection Principle. 6(3), 239–251.
Chakrabarti, S., Saha, H. N., University of British Columbia, Institute of Electrical and Electronics Engineers. Vancouver Section, Institute of Engineering & Management, University of Engineering & Management, & Institute of Electrical and Electronics Engineers. (2019). Particle Swarm Optimization for Feature Selection: A Review of Filter-based Classification to Identify Challenges and Opportunities.
Chantar, H., Tubishat, M., Essgaer, M., & Mirjalili, S. (2021). Hybrid Binary Dragonfly Algorithm with Simulated Annealing for Feature Selection. SN Computer Science, 1–11.
Chaudhuri, A., & Sahu, T. P. (2021). Feature selection using Binary Crow Search Algorithm with time varying flight length. Expert Systems with Applications, 168.
Cheng, M., & Prayogo, D. (2014). Symbiotic Organisms Search : A new metaheuristic optimization algorithm. COMPUTERS AND STRUCTURES.
Dhiman, G., & Kumar, V. (2017). Spotted hyena optimizer : A novel bio-inspired based metaheuristic technique for engineering applications. Advances in Engineering Software, 0, 1–23.
Dorigo, M., & Stützle, T. (1999). Chapter 9 THE ANT COLONY OPTIMIZATION METAHEURISTIC : ALGORITHMS , APPLICATIONS , AND ADVANCES.
Elgamal, Z. M., Binti, N., Yasin, M., Tubishat, M., Alswaitti, M., & Mirjalili, S. (2020). An Improved Harris Hawks Optimization Algorithm With Simulated Annealing for Feature Selection in the Medical Field. 8.
Eskandar, H., Sadollah, A., Bahreininejad, A., & Hamdi, M. (2012). Water cycle algorithm – A novel metaheuristic optimization method for solving constrained engineering optimization problems. Computers and Structures, 110–111, 151–166.
Feo, T. ., Resende, M. G. ., & Smith, S. . (1995). Greedy Randomized Adaptive Search Procedures. 109–133.
Geem, Z. W., K, J. H., & Loganathan, G. V. (2001). Optimization Algorithm :
Ghazali, T. (2009). Metaheuristics: From Design to Implementation | Wiley. https://www.wiley.com/en-us/Metaheuristics%3A+From+Design+to+Implementation+-p-9780470278581
Ghosh, K. K., Ahmed, S., Singh, P. K., Geem, Z. W. O. O., Sarkar, R. A. M., & Member, S. (2020). Improved Binary Sailfish Optimizer Based on Adaptive β -Hill Climbing for Feature Selection. 8.
Ghosh, M., Guha, R., Alam, I., Lohariwal, P., Jalan, D., & Sarkar, R. (2020). Binary genetic swarm optimization: A combination of ga and pso for feature selection. Journal of Intelligent Systems, 29(1), 1598–1610.
Ghosh, M., Kundu, T., Ghosh, D., & Sarkar, R. (2019). Feature selection for facial emotion recognition using late hill-climbing based memetic algorithm.
Glover, F. (1986). Future paths for integer programming and links to artificial intelligence. Computers and Operations Research, 13(5), 533–549.
Hansen, P., & Mladenović, N. (2005). Variable Neighborhood Search. Search Methodologies: Introductory Tutorials in Optimization and Decision Support Techniques, 211–238.
Hayyolalam, V., Asghar, A., & Kazem, P. (2020). Engineering Applications of Artificial Intelligence Black Widow Optimization Algorithm : A novel meta-heuristic approach for solving engineering optimization problems ✩. Engineering Applications of Artificial Intelligence, 87(November 2018), 103249.
Holland, J. H. (1984). GENETIC ALGORITHMS AND ADAPTATION. 317–333.
Hoos, H. H., & Stützle, T. (2005). Stochastic Local Search. Stochastic Local Search.
Huda, R. K., & Banka, H. (2020). New efficient initialization and updating mechanisms in PSO for feature selection and classification. Neural Computing and Applications, 32(8), 3283–3294.
Jia, H., Li, J., Song, W., Peng, X., & Lang, C. (2019). Spotted Hyena Optimization Algorithm With Simulated Annealing for Feature Selection. IEEE Access, 7, 71943–71962.
Kabir, M. M., Shahjahan, M., & Murase, K. (2011). A new local search based hybrid genetic algorithm for feature selection. Neurocomputing, 74(17), 2914–2928.
Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization. Proceedings of ICNN’95 - International Conference on Neural Networks, 4, 1942–1948.
Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. (1983). Optimization by simulated annealing. Science, 220(4598), 671–680.
Kohlhardt, M., Bauer, B., Krause, H., & Fleckenstein, A. (1972). Differentiation of the transmembrane Na and Ca channels in mammalian cardiac fibres by the use of specific inhibitors. Pflügers Archiv European Journal of Physiology, 335(4), 309–322.
Liao, T. W., & Kuo, R. J. (2017). SC. Applied Soft Computing Journal.
Mafarja, M. (2019). Boosting Salp Swarm Algorithm by Sine Cosine algorithm and Disrupt Operator for Feature Selection. Expert Systems With Applications, 113103.
Mafarja, M. M., & Mirjalili, S. (2017a). Graphical abstract. Applied Soft Computing Journal.
Mafarja, M. M., & Mirjalili, S. (2017b). Hybrid Whale Optimization Algorithm with simulated annealing for feature selection. 0, 1–11.
Mafarja, M., Qasem, A., Heidari, A. A., Aljarah, I., Faris, H., & Mirjalili, S. (2020). Efficient Hybrid Nature-Inspired Binary Optimizers for Feature Selection. Cognitive Computation, 12(1), 150–175.
Marinaki, M., & Marinakis, Y. (2015). REGULAR RESEARCH PAPER A hybridization of clonal selection algorithm with iterated local search and variable neighborhood search for the feature selection problem. Memetic Computing, 181–201.
Martínez-Estudillo, A. C., Hervás-Martínez, C., Martínez-Estudillo, F. J., & García-Pedrajas, N. (2006). Hybridization of evolutionary algorithms and local search by means of a clustering method. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 36(3), 534–545.
Meena, M. J., Chandran, K. R., Karthik, A., & Samuel, A. V. (2012). Expert Systems with Applications An enhanced ACO algorithm to select features for text categorization and its parallelization. Expert Systems With Applications, 39(5), 5861–5871.
Mernik, M. (2013). Exploration and Exploitation in Evolutionary Algorithms : A Survey. 45(3), 1–33.
Mirjalili, S. (2015a). Advances in Engineering Software The Ant Lion Optimizer. Advances in Engineering Software, 83, 80–98.
Mirjalili, S. (2015b). Moth-Flame Optimization Algorithm : A Novel Nature-inspired Heuristic Paradigm. KNOWLEDGE-BASED SYSTEMS, July.
Mirjalili, S. (2016). Dragonfly algorithm : a new meta-heuristic optimization technique for solving single-objective , discrete , and multi-objective problems. Neural Computing and Applications, 27(4), 1053–1073.
Mirjalili, S. (2018). Hybrid binary ant lion optimizer with rough set and approximate entropy reducts for feature selection. Soft Computing.
Mirjalili, S., Gandomi, A. H., Mirjalili, S. Z., Saremi, S., Faris, H., & Mirjalili, S. M. (2017). Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems. Advances in Engineering Software, 114, 163–191.
Mirjalili, S., & Lewis, A. (2016). Advances in Engineering Software The Whale Optimization Algorithm. 95, 51–67.
Moradi, P., & Gholampour, M. (2016). A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy. Applied Soft Computing Journal, 43, 117–130.
Nekkaa, M., & Boughaci, D. (2015a). Hybrid Harmony Search Combined with Stochastic Local Search for Feature Selection. Neural Processing Letters.
Nekkaa, M., & Boughaci, D. (2015b). REGULAR RESEARCH PAPER A memetic algorithm with support vector machine for feature selection and classification. 59–73.
Oh, I., Lee, J., & Moon, B. (2004). Hybrid Genetic Algorithms for Feature Selection. 26(11), 1424–1437.
Petalas, Y. G., Parsopoulos, K. E., & Vrahatis, M. N. (2007). Memetic particle swarm optimization. Annals of Operations Research, 156(1), 99–127.
Ramos-figueroa, O., Quiroz-castellanos, M., & Mezura-montes, E. (2020). Metaheuristics to solve grouping problems : A review and a case study. Swarm and Evolutionary Computation, 53(January), 100643.
Salcedo-Sanz, S., Pastor-S´anchez, A., Gallo-Marazuela, D., & Portilla-Figueras, A. (2013). A Novel Coral Reefs Optimization Algorithm for Multi-objective Problems. 326–333.