Authors : Arunima Banerjee; Nitu Saha; Washim Akram; Saundarya Biswas; Siddhartha Chatterjee

Volume/Issue : Volume 10 - 2025, Issue 7 - July

Google Scholar : https://tinyurl.com/bde35wjf

Scribd : https://tinyurl.com/2yuc8r6y

DOI : https://doi.org/10.38124/ijisrt/25jul782

Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.

Note : Google Scholar may take 30 to 40 days to display the article.

Abstract : Patters are in many typeslike audio/video, character/digit etc. Pattern recognition refers to the task of identifying the pattern in an expert manner. Different researchers have applied different Machine Learning (ML) and Deep Neural Network (DNN) techniques for pattern recognition in different domains. This research is targeted to develop an expert system for hand written digit recognition. In this research a pattern recognition model is presented by using hybrid technique of Convolutional Neural Network (CNN) with three different boosting classifiers. The model is tested with handwritten digit data set downloaded from MNIST and EMNIST. The classification process initiated by applying CNN, used for features extraction and then three standard gradient boosting classification algorithms named Ada-Boosting classifier (ABC), Extreme Gradient Boosting classifier (XGB) and Light Gradient Boosting Machine (LGBM) is applied for classification. The experimental result shows that the integrated method of CNN and LGBM produce best accuracy of 99.51% and 99.7025% with MNIST and EMNIST dataset respectively.

Keywords : Convolutional Neural Network (CNN), Ada-Boosting Classifier, XGBOOST Classifier, Light-GBM Classifier, MNIST and EMNIST Handwritten Digit Dataset.

References :

1. G. Vamvakas, B. Gatos and S. J. Perantonis, “Handwritten character recognition through two-stage foreground sub-sampling,” Pattern Recognition, vol. 43, pp. 2807-2816, 2010.
2. O. Pauplin and J. Jiang, “DBN-based structural learning and optimization for automated handwritten character recognition,” Pattern Recognition Letters , vol. 33, pp. 685-692, 2012.
3. V. N. Jagtap., S. K. Mishra, “Fast Efficient Artificial Neural Network for Handwritten Digit Recognition,” International Journal of Computer Science and Information Technologies, vol. 5, pp. 2302-2306, 2014.
4. M. Y. W. Teow, “Understanding Convolutional Neural Networks Using A Minimal Model for Handwritten Digit Recognition,” IEEE 2nd International Conference on Automatic Control and Intelligent Systems (I2CACIS), pp. 167-172, 2017.
5. A. Dutt and A. Dutt , “Handwritten Digit Recognition Using Deep Learning,” International Journal of Advanced Research in Computer Engineering & Technology (IJARCET), vol. 6, pp. 990-997, 2017.
6. N. Jain, K. Rahul, I. Khamaru, A. K. Jha and A. Ghosh, “Hand Written Digit Recognition using Convolutional Neural Network (CNN),” International Journal of Innovations & Advancement in Computer Science IJIACS, vol. 6, pp. 260-266, 2017.
7. M. Zohra and D. R. Rao, “A Comprehensive Data Analysis on Handwritten Digit Recognition using Machine Learning Approach,” International Journal of Innovative Technology and Exploring Engineering (IJITEE), vol. 8, pp. 1449-1453, 2019.
8. N Sagar., Rajalekshmi J., U. Nikhil. S. , L . Dhrithi ., R. Tushar .B. ,(2019), Comparison Of Machine Learning Techniques for Hand Written Digit Recognition, International Research Journal of Engineering and Technology (IRJET) , 06, 05, 4972-4977
9. Agrawal A. K.,. Shrivas A. K., ,Awasthi V. K. (2021), A Robust Model for Handwritten Digit Recognition using Machine and Deep Learning Technique, 2021 2nd International Conference for Emerging Technology (INCET), 2021, pp. 1-4, doi: 10.1109/INCET51464.2021.9456118.
10. F. Chen, N. Chen, H. Mao and H. Hu, “Assessing Four Neural Networks on Handwritten Digit Recognition Dataset (MNIST),” Chuangxinban Journal Of Computing, pp. 1-4, 2018.
11. S. Mishra, D. Malathi, K. Senthilkumar, “Digit Recognition Using Deep Learning,” International Journal of Pure and Applied Mathematics, vol. 118, pp. 295-302, 2018.
12. Ali Saqib, Shaukat Zeeshan, Azeem Muhammad , Sakhawat Zareen , Mahmood Tariq, ur Rehman Khalil (2019), An efficient and improved scheme for handwritten digit recognition based on convolutional neural network, Springer Nature Switzerland AG 2019
13. Dixit Ritik, Kushwah Rishika, Pashine Samay(2020), Handwritten Digit Recognition using Machine and Deep Learning Algorithms , International Journal of Computer Applications (0975 – 8887), 176 , 42,27-33
14. Agrawal A. K.,Hota H. S. ,Awasthi V. K. (2020), MNIST handwritten digit recognition using deep neural network technique: keras, Review of Business and Technology Research, 17(2), pp – 13-19, ISSN: 1941-9406 (Print), 1941-9414 (CD)
15. Agrawal A. K.,. Awasthi V. K. (2021), Novel Deep Neural Network Model for Handwritten Digit Classification and Recognition, International Journal of Advanced Research in Science, Communication and Technology (IJARSCT),2(2),30-35.
16. Niu Xiao-Xiao, Suen Ching Y. (2012), A novel hybrid CNN–SVM classifier for recognizing handwritten digits, Pattern Recognition 45, 1318–1325
17. Ahlawat Savita , Choudhary Amit(2019), Hybrid CNN-SVM Classifier for Handwritten Digit Recognition , International Conference on Computational Intelligence and Data Science (ICCIDS 2019) , Procedia Computer Science 167, 2554–2560
18. A. Agrawal, A. Shrivas, and V. Awasthi, “An Improved and Customized Hybrid of Deep and Machine Learning Technique Model for Handwritten Digit Recognition”, A Journal of Physical Sciences, Engineering and Technology (2022), vol. 14, no. 01 SPL, pp. 13-19, Jun. 2022.
19. Ren, X., Guo, H., Li, S., Wang, S., Li, J. (2017). A Novel Image Classification Method with CNN-XGBoost Model. In: Kraetzer, C., Shi, YQ., Dittmann, J., Kim, H. (eds) Digital Forensics and Watermarking. IWDW 2017. Lecture Notes in Computer Science(), vol 10431. Springer, Cham. https://doi.org/10.1007/978-3-319-64185-0_28
20. A. Taherkhani, G. Cosma and T.M. McGinnity (2020),AdaBoost-CNN: An adaptive boosting algorithm for convolutional neural networks to classify multi-class imbalanced datasets using transfer learning, Neurocomputing , Volume 404, 3 September 2020, Pages 351-366.
21. Srishti Singh, Amrit Paul, Dr. Arun M,” Parallelization Of Digit Recognition System Using Deep Convolutional Neural Network On CUDA “,2017 IEEE 3rd International Conference on Sensing, Signal Processing and Security (ICSSS), 978-1-5090-4929-5©2017 IEEE,379-383.
22. Weiwei Jiang,” MNIST-MIX: a multi-language handwritten digit recognition dataset”, IOP SciNotes 1 (2020) 025002.
23. Teddy Surya Gunawan,, Ahmad Fakhrur Razi Mohd Noor,, Mira Kartiwi “Development of English Handwritten Recognition Using Deep Neural Network”, Indonesian Journal of Electrical Engineering and Computer Science Vol. 10, No. 2, May 2018, pp. 562-568.
24. Emmanuel Dufourq, Bruce A. Bassett,” EDEN: Evolutionary Deep Networks for Efficient Machine Learning”, arXiv:1709.09161v1 [stat.ML] 26 Sep 2017
25. http://yann.lecun.com/exdb/mnist/
26. https://www.itl.nist.gov/iaui/vip/cs_links/EMNIST/gzip.zip
27. Tiwari Laxmikant, Raja Rohit, Awasthi Vineet, Miri Rohit, Sinha G.R., Alkinani Monagi H., Polat Kemal,”Detection of lung nodule and cancer using novel Mask-3 FCM and TWEDLNN algorithms”,Measurement,vol. 172, 2021, https://doi.or g/10.1016/j.measurement.2020.108882.
28. Verma Pratibha, Sahu Sanat Kumar, Awasthi Vineet Kumar, “Deep Neural Network With Feature Optimization Technique for Classification of Coronary Artery Disease “,Handbook of Research on Computer Vision and Image Processing in the Deep Learning Era, IGI Global, 2023, DOI: 10.4018/978-1-7998-8892-5.ch016
29. sharma hari, brown kate, Awasthi Vineet Kumar,” An interactive weight-based portfolio system using goal programming”, application of mathmetical modelling , machine learning, and intelligent computing for industrial development, CRC press, 2023, ISBN : 978-1-003-38659-9(ebk).
30. Verma Pratibha, Sahu Sanat Kumar, Awasthi Vineet Kumar,An Ensemble Model With Genetic Algorithm for Classification of Coronary Artery Disease, International Journal of Computer Vision and Image Processing (IJCVIP) , IGI Global , vol. 11(3), ,2021, DOI: 10.4018/IJCVIP.2021070105.
31. Verma, P., Awasthi, V.K., Shrivas, A.K., Sahu, S.K. (2022). Stacked Generalization Based Ensemble Model for Classification of Coronary Artery Disease. In: Misra, R., Kesswani, N., Rajarajan, M., Veeravalli, B., Patel, A. (eds) Internet of Things and Connected Technologies. ICIoTCT 2021. Lecture Notes in Networks and Systems, vol 340. Springer, Cham. https://doi.org/10.1007/978-3-030-94507-7_6.
32. Tiwari, L., Awasthi, V., Patra, R.K., Miri, R., Raja, H., Bhaskar, N. (2022). Lung Cancer Detection Using Deep Convolutional Neural Networks. In: Bhateja, V., Khin Wee, L., Lin, J.CW., Satapathy, S.C., Rajesh, T.M. (eds) Data Engineering and Intelligent Computing. Lecture Notes in Networks and Systems, vol 446. Springer, Singapore. https://doi.org/10.1007/978-981-19-1559-8_37
33. Sharma Dinesh K. , Hota H.S, Awasthi Vineet Kumar ,” An integrated K-means-GP approach for US stock fund diversification and its impact due to COVID-19”, International Journal of Computational Economics and Econometrics, Vol. 12 (4), pp 381-404, 2022, https://doi.org/10.1504/IJCEE.2022.126317
34. Verma P., Awasthi V. K. , Sahu S. K., "Classification of Coronary Artery Disease Using Deep Neural Network with Dimension Reduction Technique," 2021 2nd International Conference for Emerging Technology (INCET), Belagavi, India, 2021, pp. 1-5, doi: 10.1109/INCET51464.2021.9456322.
35. Verma, P., Awasthi, V. K., Sahu, S. K., & Shrivas, A. K. (2022). Coronary Artery Disease Classification Using Deep Neural Network and Ensemble Models Optimized by Particle Swarm Optimization. International Journal of Applied Metaheuristic Computing(IJAMC),13(1),1-25. http://doi.org/10.4018/IJAMC.292504.
36. Verma P., Awasthi V. K. , Sahu S. K., “A Novel Design of Classification of Coronary Artery Disease Using Deep Learning and Data Mining Algorithms”, Revue d'Intelligence Artificielle Vol. 35(3), pp. 209-215, 2021.
37. Hota, H.S., Awasthi, V.K., Singhai, S.K. (2018). Comparative Analysis of AHP and Its Integrated Techniques Applied for Stock Index Ranking. In: Sa, P., Sahoo, M., Murugappan, M., Wu, Y., Majhi, B. (eds) Progress in Intelligent Computing Techniques: Theory, Practice, and Applications. Advances in Intelligent Systems and Computing, vol 719. Springer, Singapore. https://doi.org/10.1007/978-981-10-3376-6_14.
38. Ghosh, P., Hazra, S., Chatterjee, S. Future Prospects Analysis in Healthcare Management Using Machine Learning Algorithms. the International Journal of Engineering and Science Invention (IJESI), ISSN (online), 2319-6734.
39. Hazra, S., Mahapatra, S., Chatterjee, S., & Pal, D. (2023). Automated Risk Prediction of Liver Disorders Using Machine Learning. In the proceedings of 1st International conference on Latest Trends on Applied Science, Management, Humanities and Information Technology (SAICON-IC-LTASMHIT-2023) on 19th June (pp. 301-306).
40. Nitu Saha; Rituparna Mondal; Arunima Banerjee; Rupa Debnath; Siddhartha Chatterjee; (2025) Advanced DeepLungCareNet: A Next-Generation Framework for Lung Cancer Prediction. International Journal of Innovative Science and Research Technology, 10(6), 2312-2320. https://doi.org/10.38124/ijisrt/25jun1801.
41. Rupa Debnath; Rituparna Mondal; Arpita Chakraborty; Siddhartha Chatterjee (2025) Advances in Artificial Intelligence for Lung Cancer Detection and Diagnostic Accuracy: A Comprehensive Review. International Journal of Innovative Science and Research Technology, 10(5), 1579-1586. https://doi.org/10.38124/IJISRT/2 5may1339.
42. Hazra,S.,Chatterjee, S.,Mandal, A.,Sarkar, M.,Mandal,B.K.(2023). An Analysis of Duckworth-Lewis-Stern Method in the Context of Interrupted Limited over Cricket Matches. Proceedings of International Conference on Data Analytics and Insights, ICDAI 2023. LNNS, vol 727. Springer, Singapore. https://doi.org/10.1007/978-981-99-3878-0_46.
43. Mandal, K.K., Chatterjee, S., Chakraborty, A., Mondal, S., Samanta, S. (2020). Applying Encryption Algorithm on Text Steganography Based on Number System. In: Maharatna, K., Kanjilal, M., Konar, S., Nandi, S., Das, K. (eds) Computational Advancement in Communication Circuits and Systems. Lecture Notes in Electrical Engineering, vol 575. Springer, Singapore. https://doi.org/10.1007/978-981-13-8687-9_23.
44. Chatterjee, Siddhartha, A Survey on Data Clustering Approaches (June 17, 2018). IOSR Journal of Business and Management (IOSR - JBM), Journal No. 46879, UGC Serial No. 2953, Impact Factor - 3.52, pp 34 - 42, e-ISSN 2278 - 487X,p-ISSN2319-7668,IOSR .,Availableat SSRN: https://ssrn.com/abstract=3586458.
45. Bose, S., Chatterjee, S., Chakraborty, B., Halder, P., & Samanta, S. (2021). An Analysis and Discussion of Human Sentiment Based on Social Network Information. Int. J. HIT. TRANSC: ECCN. Vol, 7(1A), 62-71.