Ant Colony Optimization Based Subset Feature Selection in Speech Processing: Constructing Graphs with Degree Sequences

R. Rajesvary Rajoo, Rosalina Abdul Salam


Feature selection or the process of selecting the most discriminating feature subset is an essential practice in speech processing that significantly affects the performance of classification. However, the volume of features that presents in speech processing makes the feature selection perplexing. Moreover, finding the optimal feature subset is a NP-hard problem (2n). Thus, a good searching strategy is required to avoid evaluating large number of combinations in the whole feature subsets. As a result, in recent years, many heuristic based search algorithms are developed to address this NP-hard problem. One of the several meta heuristic algorithms that is applied in many application domains to solve feature selection problem is Ant Colony Optimization (ACO) based algorithms.  ACO based algorithms are nature-inspired from the foraging behavior of actual ants. The success of an ACO based feature selection algorithm depends on the choice of the construction graph with respect to runtime behavior. While most ACO based feature selection algorithms use fully connected graphs, this paper proposes ACO based algorithm that uses graphs with prescribed degree sequences. In this method, the degree of the graph representing the search space will be predicted and the construction graph that satisfies the predicted degree will be generated. This research direction on graph representation for ACO algorithms may offer possibilities to reduce computation complexity from O(n2) to O(nm) in which m is the number of edges. This paper outlines some popular optimization based feature selection algorithms in the field of speech processing applications and overviewed ACO algorithm and its main variants. In addition to that, ACO based feature selection is explained and its application in various speech processing tasks is reviewed. Finally, a degree based graph construction for ACO algorithms is proposed.


Feature Selection; Speech Processing; Heuristic Algorithms; Ant Colony Optimization; Degree sequences

Full Text:



E. Saraç and S. A. Özel, “An Ant Colony Optimization Based Feature Selection for Web Page Classificationâ€, The Scientific World Journal, vol. 2014 (2014), Article ID 649260, 16 pages,

Bing Xue, Mengjie Zhang, Will N. Browne, Xin Yao, “A Survey on Evolutionary Computation Approaches to Feature Selectionâ€, IEEE Transactions On Evolutionary Computation, vol. 20, No. 4, August 2016.

Sina Tabakhi and Parham Moradi, “Relevance– redundancy feature selection based on ant colony optimizationâ€, Pattern Recognition, vol. 48 (2015) pp. 2798–2811.

Rizwan Mehmood, Waseem Shahzad and Ejaz Ahmed, “Maximum Relavancy Minimum Redundancy Based Feature Subset Selection using Ant Colony Optimizationâ€, Journal of Applied Environmental and Biological Sciences, 7(4)118-130, 2017.

Roiss Alhutaish and Nazlia Omar, “Feature Selection for Multi-Label Document Based on Wrapper Approach through Class Association Rulesâ€, IJASET, vol.7 (2017), no.2.

M. Dorigo, M. Birattari and T.Stutzle, “Ant Colony Optimization: Artificial Ants as Computational Intelligent Techniqueâ€, IEEE Computational Intelligent Magazine, Nov 2006.

M. M Kabir, M. Shahjahan and K Murase, “A new hybrid ant colony optimization algorithm for feature selectionâ€, Expert Systems with Applications, vol. 39 (2012) pp. 3747–3763.

Adubi A. Stephen and Sanjay Misra, “A comparative Study on the Ant Colony Optimization Algorithmsâ€, Electronics, Computer and Computation (ICECCO), 11th International Conference 2014.

Jianbo Jiang, Zhiyong Wu, Mingxing Xu, Jia Jia and Lianhong Cai, “Comparing feature dimension reduction algorithms for GMM-SVM based speech emotion recognitionâ€, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific, Jan 2014.

T. Drugman, “Advances in Glottal Analysis and its Applicationsâ€, PHD THESIS, University of Mons, Belgium, 2011.

LB Asl and VM Nezhad, “Speech Enhancement Using Particle Swarm Optimization Techniquesâ€, Measuring Technology and Mechatronics Automation (ICMTMA), 2010 International Conference on, Changsha City, China, China, March 2010.

T. Hassanzadeh, K. Faez and G Seyfi, “A speech recognition system based on structure equivalent fuzzy neural network trained by firefly algorithmâ€, Biomedical Engineering (ICoBE), 2012 International Conference on, Penang, Malaysia, Feb 2012.

G.K Venayagamoorthy and W. Zha, “Comparison of Nonuniform Optimal Quantizer Designs for Speech Coding With Adaptive Critics and Particle Swarmâ€, IEEE Transactions on Industry Applications, vol.43, Issue: 1, Jan-Feb. 2007.

A. Shahzadi, A. Ahmadyfard and A. Harim, “Speech emotion recognition using nonlinear dynamics featuresâ€, Turkish Journal of Electrical Engineering & Computer Sciences, Turk J Elec Eng & Comp Sci (2015) vol. 23, pp. 2056-2073.

J.S. Lee and C.H. Park, “Hybrid simulated annealing and its application to optimization of hidden Markov models for visual speech recognitionâ€, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 40(4), pp. 1188-96. Aug 2010.

A. V. Ermilov, “Modeling Speech Features Via Simulated Annealing Algorithmâ€, vol (2) (2014), pp. 354-358.

Ahmed Al-Hmouz , Khaled Daqrouq, Rami Al-Hmouz and Jaafar Alghazo, “Feature Reduction Method for Speaker Identification Systems Using Particle Swarm Optimizationâ€, International Journal of Engineering and Technology (IJET), vol 9 (3), Jun-Jul 2017.

Fabíola Araújo, José Filho and Aldebaro Klautau, “Genetic algorithm to estimate the input parameters of Klatt and HLSyn formant-based speech synthesizersâ€, BioSystems, vol. 150 (2016), pp. 190–193..

R. Arefi Shirvan and E. Tahami, “Voice analysis for detecting Parkinson's disease using genetic algorithm and KNN classification methodâ€, Biomedical Engineering (ICBME), 2011 18th Iranian Conference of, 14-16 Dec. 2011.

M.Dorigo and K.Socha, “An introduction to ant colony optimization,†Handbook of Metaheuristic, Brussels: IRIDIA, 2006, vol. 26, no 1. ISSN 1781-3794

Yusuf Hendrawan and Dimas Firmanda Al Riza, “Machine Vision Optimization using Nature-Inspired Algorithms to Model Sunagoke Moss Water Statusâ€, IJASEIT, Vol.6(2016), no.1.

Stephan A. Adubi and Sanjay Misra, “A comparative Study on the Ant Colony Optimization Algorithmsâ€, Conference: 11th International Conference on Electronics, Computer and Computation (ICECCO), 2014.

Dorigo M, Maniezzo V, Colorni A. Ant System: Optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybernet Part B 1996, vol. 26(1), pp. 29–41.

Gambardella L. and M. Dorigo, “Ant-Q: A Reinforcement Learning approach to the traveling salesman problemâ€, Proceedings of ML-95, Twelfth International Conference on Machine Learning, Tahoe City, CA, A. Prieditis and S. Russell (Eds.), Morgan Kaufmann, 252–260, 1995

Dorigo M. and Gambardella LM. “Ant colony system: A cooperative learning approach to the traveling salesman problemâ€, IEEE Trans Evolutionary Comput 1997, vol. 1(1), pp.53–66.

Bullnheimer B, Hartl R, Strauss C, “A new rank-based version of the Ant System: A computational studyâ€, Central European J Operations Res Econom 1999, vol. 7(1), pp. 25–38.

Stützle T. and Hoos HH, “MAX–MIN Ant systemâ€, Future Generation Computer System 2000, vol. 16(8), pp. 889–914.

Mehdi Hosseinzadeh Aghdam. “An Improved Ant Colony Optimization Algorithm And Its Application To Text-Independent Speaker Verification Systemâ€, JAISCR, 2012, vol. 2 (4), pp. 301-315.

H.R. Kanan, K. Faez, and S.M. Taheri, “Feature Selection Using Ant Colony Optimization (ACO): A New Method and Comparative Study in the Application of Face Recognition Systemâ€, P. Perner (Ed.): ICDM 2007, LNAI 4597, pp. 63–76, 2007.

C.Poonkuzhali, R.Karthiprakash, Dr.S.Valarmathy, and M.Kalamani, “An Approach to Feature Selection Algorithm Based On Ant Colony Optimization For Automatic Speech Recognitionâ€, International Journal of Advanced Research in Electrical, Electronics and Instrumentation Engineering, vol. 2(11), November 2013.

Xing Wei and Xiaojin Yang, “Speech Dynamic Time Warping Based on Ant Colony Optimization Algorithmâ€, Consumer Electronics, Communications and Networks (CECNet), Jan 2014.

Lihui DU and Yueguang Li, “Recognition of practical English speech emotion using improved Quantum Ant Colony Algorithmâ€, International Symposium on Computers & Informatics (ISCI 2015).

J.Sirisha Devi and Srinivas Yarramalle, “Multi Objective Optimization Problem resolution based on Hybrid Ant-Bee Colony for Text Independent Speaker Verificationâ€, I.J. Modern Education and Computer Science, vol. 2015 (1), pp. 55-63.

Fooad Jalili and Milad Jafari Barani, “Speech Recognition Using Combined Fuzzy and Ant Colony Algorithmâ€, International Journal of Electrical and Computer Engineering (IJECE), vol. 6(5), October 2016, pp. 2205-2210.

Mansour Sheikhan, “Synthesizing Supra segmental Speech Information Using Hybrid of GA-ACO and Dynamic Neural Networkâ€, 2013 5th Conference on Information and Knowledge Technology (IKT).

H Kim, C I Del Genio, K E Bassler and Z Toroczkai, “Constructing and sampling directed graphs with given degree sequencesâ€, New Journal of Physics, Volume 14, February 2012.

Bolun Chen, Ling Chen and Yixin Chen, “Efficient ant colony optimization for image feature selectionâ€, Signal Processing 93 (2031), pp 1566-1576.



  • There are currently no refbacks.

Published by INSIGHT - Indonesian Society for Knowledge and Human Development