High-Quality Wavelets Features Extraction for Handwritten Arabic Numerals Recognition

M. Suhail Akhtar, Hammad A. Qureshi, Hani Al-Quhayz

Abstract


Arabic handwritten digit recognition is the science of recognition and classification of handwritten Arabic digits. It has been a subject of research for many years with rich literature available on the subject.  Handwritten digits written by different people are not of the same size, thickness, style, position or orientation. Hence, many different challenges have to overcome for resolving the problem of handwritten digit recognition.  The variation in the digits is due to the writing styles of different people which can differ significantly.  Automatic handwritten digit recognition has wide application such as automatic processing of bank cheques, postal addresses, and tax forms. A typical handwritten digit recognition application consists of three main stages namely features extraction, features selection, and classification. One of the most important problems is feature extraction. In this paper, a novel feature extraction approach for off-line handwritten digit recognition is presented. Wavelets-based analysis of image data is carried out for feature extraction, and then classification is performed using various classifiers. To further reduce the size of training data-set, high entropy subbands are selected. To increase the recognition rate, individual subbands providing high classification accuracies are selected from the over-complete tree. The features extracted are also normalized to standardize the range of independent variables before providing them to the classifier. Classification is carried out using k-NN and SVMs. The results show that the quality of extracted features is high as almost equivalently high classification accuracies are acquired for both classifiers, i.e. k-NNs and SVMs.


Keywords


Wavelets analysis, Wavelet packets analysis, Handwritten digits recognition, k-NNs, SVMs

Full Text:

PDF

References


R.-G. Mihalyi, “Handwritten Digit Classification using Support Vector Machines,” 2011.

D. K. Bishnoi and K. Lakhwani, “Advanced approaches of handwritten digit recognition using hybrid algorithm,” Int. J. Commun. Comput. Technol., vol. 1, no. 57, pp. 186–191.

M. Karić and G. Martinović, “Improving Offline Handwritten Digit Recognition Using Concavity-based Features,” Int. J. Comput. Commun. Control, vol. 8, no. 2, pp. 206–219, 2013.

R. Kala, H. Vazirani, A. Shukla, and R. Tiwari, “Offline handwriting recognition using genetic algorithm,” arXiv Prepr. arXiv1004.3257, 2010.

P. Dollár, Z. Tu, H. Tao, and S. Belongie, “Feature mining for image classification,” in 2007 IEEE Conference on Computer Vision and Pattern Recognition, 2007, pp. 1–8.

D. C. Álvarez, F. M. Rodríguez, and X. F. Hermida, “Printed and handwritten digits recognition using neural networks,” in Proceedings of ICSPAT-98 (International Conference on Signal Processing and Applications Technology), 1998.

V. Kapoor and P. Gupta, “Digit Recognition System by using Back Propagation Algorithm,” Int. J. Comput. Appl., vol. 83, no. 8, 2013.

C. Enachescu and C.-D. Miron, “Handwritten digits recognition Using neural computing,” Sci. Bull. the" Petru Maior" Univ. Targu Mures, vol. 6, p. 17, 2009.

C.-L. Liu, K. Nakashima, H. Sako, and H. Fujisawa, “Handwritten digit recognition: benchmarking of state-of-the-art techniques,” Pattern Recognit., vol. 36, no. 10, pp. 2271–2285, 2003.

B. El Kessab, C. Daoui, B. Bouikhalene, M. Fakir, and K. Moro, “Extraction method of handwritten digit recognition tested on the mnist database,” Int. J. Adv. Sci. Technol., vol. 50, pp. 99–110, 2013.

Y. LeCun, C. Cortes, and C. J. C. Burges, “The MNIST Database of handwritten digits,” 2002.

Y. LeCun, “LeNet-5, convolutional neural networks,” URL http//yann. lecun. com/exdb/lenet, vol. 20, 2015.

E. Stromatias, D. Neil, F. Galluppi, M. Pfeiffer, S.-C. Liu, and S. Furber, “Live demonstration: handwritten digit recognition using spiking deep belief networks on SpiNNaker,” in 2015 IEEE International Symposium on Circuits and Systems (ISCAS), 2015, p. 1901.

S. Pan, Y. Wang, C. Liu, and X. Ding, “A discriminative cascade CNN model for offline handwritten digit recognition,” in 2015 14th IAPR International Conference on Machine Vision Applications (MVA), 2015, pp. 501–504.

H. Cecotti, “Active graph based semi-supervised learning using image matching: application to handwritten digit recognition,” Pattern Recognit. Lett., vol. 73, pp. 76–82, 2016.

J. Qiao, G. Wang, W. Li, and M. Chen, “An adaptive deep Q-learning strategy for handwritten digit recognition,” Neural Networks, vol. 107, pp. 61–71, 2018.

R. V. K. Reddy and U. R. Babu, “Efficient Handwritten Digit Classification using User-defined Classification Algorithm,” Int. J. Adv. Sci. Eng. Inf. Technol., vol. 8, no. 3, pp. 970–979, 2018.

J. V. S. Srinivas, P. V. Kumar, and P. Premchand, “Hand Written Digit Recognition Using Elman Neural Network,” Int. J. Eng. Innov. Technol., vol. 2, no. 5, pp. 9–13, 2012.

A. Goltsev and V. Gritsenko, “Investigation of efficient features for image recognition by neural networks,” Neural Networks, vol. 28, pp. 15–23, 2012.

F. Lauer, C. Y. Suen, and G. Bloch, “A trainable feature extractor for handwritten digit recognition,” Pattern Recognit., vol. 40, no. 6, pp. 1816–1824, 2007.

D. J. Romero, L. Seijas, and A. Ruedín, “Directional continuous wavelet transform applied to handwritten numerals recognition using neural networks,” J. Comput. Sci. Technol., vol. 7, 2007.

C.-L. Liu, K. Nakashima, H. Sako, and H. Fujisawa, “Handwritten digit recognition: investigation of normalization and feature extraction techniques,” Pattern Recognit., vol. 37, no. 2, pp. 265–279, 2004.

F. Bortolozzi, A. de Souza Britto Jr, L. S. Oliveira, and M. Morita, “Recent advances in handwriting recognition,” Doc. Anal., pp. 1–31, 2005.

Ø. D. Trier, A. K. Jain, and T. Taxt, “Feature extraction methods for character recognition-a survey,” Pattern Recognit., vol. 29, no. 4, pp. 641–662, 1996.

M. Shi, Y. Fujisawa, T. Wakabayashi, and F. Kimura, “Handwritten numeral recognition using gradient and curvature of gray scale image,” Pattern Recognit., vol. 35, no. 10, pp. 2051–2059, 2002.

L.-N. Teow and K.-F. Loe, “Robust vision-based features and classification schemes for off-line handwritten digit recognition,” Pattern Recognit., vol. 35, no. 11, pp. 2355–2364, 2002.

P. Y. Simard, D. Steinkraus, and J. C. Platt, “Best practices for convolutional neural networks applied to visual document analysis.,” in Icdar, 2003, vol. 3, no. 2003.

G. Y. Chen, T. D. Bui, and A. Krzyzak, “Contour-based handwritten numeral recognition using multiwavelets and neural networks,” Pattern Recognit., vol. 36, no. 7, pp. 1597–1604, 2003.

P. Zhang, T. D. Bui, and C. Y. Suen, “A novel cascade ensemble classifier system with a high recognition performance on handwritten digits,” Pattern Recognit., vol. 40, no. 12, pp. 3415–3429, 2007.

Y. LeCun et al., “Learning algorithms for classification: A comparison on handwritten digit recognition,” Neural networks Stat. Mech. Perspect., vol. 261, p. 276, 1995.

J. Cai and Z.-Q. Liu, “Integration of structural and statistical information for unconstrained handwritten numeral recognition,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 3, pp. 263–270, 1999.

M. Hanmandlu, M. V. Krishna, and P. C. Krishna, “Some Approaches to the recognition of handwritten numerals,” in National Conference on Document Analysis and Recognition, 2001.

R. M. O. Cruz, G. D. C. Cavalcanti, and T. I. Ren, “Handwritten digit recognition using multiple feature extraction techniques and classifier ensemble,” in 17th International Conference on Systems, Signals and Image Processing, 2010, pp. 215–218.

S.-B. Cho, “Neural-network classifiers for recognizing totally unconstrained handwritten numerals,” IEEE Trans. Neural Networks, vol. 8, no. 1, pp. 43–53, 1997.

Z. Dan and C. Xu, “The recognition of handwritten digits based on bp neural network and the implementation on android,” in 2013 Third International Conference on Intelligent System Design and Engineering Applications, 2013, pp. 1498–1501.

M. Wu and Z. Zhang, “Handwritten digit classification using the mnist data set,” Course Proj. CSE802 Pattern Classif. Anal., 2010.

Y.-S. Hwang and S.-Y. Bang, “An efficient method to construct a radial basis function neural network classifier,” Neural networks, vol. 10, no. 8, pp. 1495–1503, 1997.

Y. Li, M. Dong, and J. Hua, “Simultaneous localized feature selection and model detection for Gaussian mixtures,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 5, pp. 953–960, 2009.

J. Dong, A. Krzyzak, and C. Y. Suen, “Fast SVM training algorithm with decomposition on very large data sets,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 4, pp. 603–618, 2005.

F. Colas and P. Brazdil, “Comparison of SVM and some older classification algorithms in text classification tasks,” in IFIP International Conference on Artificial Intelligence in Theory and Practice, 2006, pp. 169–178.




DOI: http://dx.doi.org/10.18517/ijaseit.9.2.6809

Refbacks

  • There are currently no refbacks.



Published by INSIGHT - Indonesian Society for Knowledge and Human Development