Intelligent optimization: Literature review and state-of-the-art algorithms (1965–2022)

Today, intelligent optimization has become a science that few researchers have not used in dealing with problems in their field. Diversity and flexibility have made the use, efficiency, and usefulness of various nature-inspired optimization methods, such as evolutionary and meta-heuristic algorithms, more evident in such problems. This work first provides a comprehensive overview of all considerations governing various optimization problems with detailed corresponding categories. Then, the most comprehensive review and recent methods (during 1965–2022) are presented in evolution-based, swarm-based, physics-based, human-based, and hybrid-based categories. More than 320 new algorithms have been reviewed. All specifications including authors, year, abbreviation, inspired source, controls, and their application are considered in this regard. Statistical analyzes of papers and publishers, annually and for 57 years, along with their ranking, are also examined in detail. Among the key achievements of the paper include: the most number of algorithms with 47.71% (156 methods) have been from the swarm category, and most of them were published in the five years of 2021 (72, 22.02%), 2020 (39, 11.93%), 2022 (31, 9.48%), 2019 (26, 7.95%), and 2016 (21, 6.42%) respectively; the top five rankings of publishers of reviewed algorithms/papers were also: "Proceedings of the Congress" (33, 10.09%), "Applied Soft Computing" (19, 5.81%), "Expert Systems with Applications" (18, 5.51%), "Knowledge-Based Systems" (12, 3.67%), "Engineering Applications of Artificial Intelligence" (12, 3.67%), "Advances in Engineering Software" (12, 3.67%), " Neural Computing and Applications " (12, 3.67%), and " Information Sciences " (11, 3.36%). The paper's data is available at: https://github.com/ali-ece.