Authors : Aniket Jadhav; Tejas Ulawekar; Shubham Kondhare; Nirbhay Mokal; Rupali Patil

Volume/Issue : Volume 10 - 2025, Issue 3 - March

Google Scholar : https://tinyurl.com/45p59yfs

Scribd : https://tinyurl.com/yjsw75pc

DOI : https://doi.org/10.38124/ijisrt/25mar920

Google Scholar

Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.

Note : Google Scholar may take 15 to 20 days to display the article.

Abstract : Meaningful communication is a basic human need, and yet there are some people who make use of sign language to communicate with the spoken word and encounter serious obstacles. This disconnect can leave us feeling isolated and alienated. Our project aims to solve this issue by creating a system which recognizes few hand signs that real-time converts into spoken as well written text. Our aim is to create a solution that can enable efficient natural language processing and an efficient gesture recognition, which will be based on convolutional Networks (CNN) and deep learning technology. Our text prediction: It improves the translation provided in terms of accuracy and relevance, as well as shortens processing time and communication. CNNs are a type of deep models, and designed to process structured data represented in form of 2D grids or multiarray like digital images. They operate by extracting and understanding features from visual inputs, using a hierarchy of filters that automatically recognize different patterns at increasing levels. Sign language is a critical example of the nuanced gestures these features would enable us to better understand. Our system then generates and can identify these different hand movements quite accurately. This enables these same gestures to be translated effortlessly into both speech and text, thus improving communication for sign language dependent persons. In addition, our solution consists of leading-edge text prediction technologies for optimization in translation. The purpose of these algorithms — increasing the accuracy and relevance of translations while at the same time decreasing both processing times, rendering communication quicker and more natural.

Keywords : Sign Language, Convolutional Neural Networks (CNN), Deep Learning, Gesture Recognition, Text Prediction, Machine Learning, Artificial Intelligence.

References :

1. Maria Papatsimouli, Konstantinos-Filippos Kollias, Lazaros Lazaridis, George Maraslidis, Herakles Michailidis, Panagiotis Sarigiannidis and George F. Fragulis,”Real-Time sign language Translation system” 2022 11th International Conference on Modern Circuits and Systems Technologies (MOCAST) | 978-1-6654-6717-9/22/$31.00©2022IEEE|DOI:10.1109/MOCAST54814.2022.9837666
2. BASHAER A. AL ABDULLAH, GHADA A. AMOUDI, AND HANAN S. ALGHAMDI, "Advancements in Sign Language Recognition: A comprehensive review and future prospects."  IEEE Access, vol. 12, 2024, doi: 10.1109/ACCESS.2024.3457692.
3. Y. Cheng, W. Shang, L. Zhu and D. Zhang, "Design and implementation of ATM alarm data analysis system," 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS), Okayama, Japan, 2023, pp. 1-3.
4. Rajanishree M, Nadeem Ahmed N, Yashvi Panchani, Shreyaa Aravindan1 and Viraj Jadhav Department of Computer Science and Engineering, School of Engineering and Technology, Bengaluru, Karnataka, India.,” Sign Language Conversion to Speech with the Application of KNN Algorithm” 2022 Sixth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) | 978-1-6654-6941-8/22/$31.00 ©2022 IEEE | DOI: 10.1109/I-SMAC55078.2022.998742
5. Siming He Ridley College, St. Catharines, Canada, “Research of a Sign Language Translation System Based on Deep Learning” 2019 International Conference on Artificial Intelligence and Advanced Manufacturing (AIAM).  | 978-1-7281-4691-1/19/$31.00 ©2019 IEEE DOI 10.1109/AIAM48774.2019.00083.
6. Gartner, C. (2021). "The Future of Sign Language Recognition: Bridging the Communication Gap." Technology Review.
7. Kumar, P., Singh, A., & Mahato, H. (2020). "A Comprehensive Study on Sign Language Recognition Systems." Journal of King Saud University - Computer and Information Sciences.
8. J.M.Power, G. W. Grimm, and J.-M. List. "Evolutionary dynamics in the dispersal of sign languages," Roy. Soc. Open Sci., vol. 7, no. 1, Jan. 2020, Art. no. 191100.
9. J. Rowe, "Artificial intelligence and the future of sign language." LinkedIn, 2017. Accessed: Nov. 3, 2021.
10. U. Farooq, M. S. M. Rahim, N. Sabir, A. Hussain, and A. Abid, "Advances in machine translation for sign language: Approaches, limitations, and challenges." Neural Computer Application, vol. 33, no. 21, pp. 14357-14399, Nov. 2021.
11. M.A. Abdel-Fattah, "Arabic sign language perspective." 1. Deaf Snud. Deaf Educ. vol. 10, no. 2.pp. 212-221. Apr. 2005.
12. B. S. Parton, "Sign language recognition and translation: A multidisci. plined approach from the field of artificial intelligence," J. Deaf Stud. Deaf Educ. vol.11. no. 1. pp. 94-101, Oct. 2005.