A Comprehensive Review of Machine Learning and Deep Learning Techniques for Sign Language Recognition.

Main Article Content

Shivani Gupta
https://orcid.org/0009-0008-4865-6785
Dr. Sumit Jain
https://orcid.org/0000-0002-0131-7312
Rakhi Jha

Abstract

Sign language serves as the primary means of communication for the deaf and hard-of-hearing community. However, communication barriers still exist between sign language users and the general population. Recent advances in machine learning (ML) and deep learning (DL) have enabled automated sign language recognition (SLR) systems capable of translating gestures into text or speech. This paper presents a systematic review of ML- and DL-based techniques used for SLR across various languages, including American Sign Language and Arabic Sign Language. The review examines classical machine learning approaches, convolutional neural networks (CNNs), hybrid architectures such as CNN-LSTM and CNN-HMM, and video-based models including 3D CNNs. Comparative analysis indicates that deep learning methods significantly outperform traditional techniques due to their ability to automatically extract spatial and temporal features. However, challenges such as limited datasets, signer variability, computational complexity, and real-time deployment constraints remain significant. This review identifies research gaps and discusses future directions, including multimodal learning, lightweight architectures, and multilingual datasets, to improve the scalability and applicability of SLR systems.

Citations

Downloads

Download data is not yet available.

Article Details

Section

Research Articles

Author Biographies

Shivani Gupta, Parul University, SAGE University Indore

Shivani Gupta is a postgraduate researcher in Computer Science with strong expertise in Artificial Intelligence, Machine Learning, and Data Analytics. Her research interests include IoT-based smart systems, image processing, and intelligent traffic management solutions. She has experience in Python programming, database systems, and research paper writing in IEEE format. She is passionate about developing innovative and impactful technological solutions for real-world problems.

Dr. Sumit Jain, SAGE University Indore

Associate professor, Sage University Indore, India

Rakhi Jha, Parul University

Assistant professor Parul University , Vadodara Gujrat, India

How to Cite

Gupta, S., Jain, S., & Jha, R. (2026). A Comprehensive Review of Machine Learning and Deep Learning Techniques for Sign Language Recognition. Interdisciplinary Journal of AI, Machine Learning & Data Science, 1(2), e002. https://doi.org/10.66261/56qhw573

References

[1] A. M. Buttar, U. Ahmad, A. H. Gumaei, A. Assiri, M. A. Akbar, and B. F. Alkhamees, “Deep learning in sign language recognition: A hybrid approach for the recognition of static and dynamic signs,” Mathematics, vol. 11, no. 17, p. 3729, Aug. 2023. DOI: https://doi.org/10.3390/math11173729

[2] V. Ravikiran, “Real-time sign language recognition and translation using MediaPipe and LSTM-based deep learning,” International Journal of Computer Applications, vol. 187, no. 25, pp. 10–14, Jul. 2025, doi:10.5120/ijca2025925415. DOI: https://doi.org/10.5120/ijca2025925415

[3] A. Moryossef, I. Tsochantaridis, R. Aharoni, S. Ebling, and S. Narayanan, “Real-time sign language detection using human pose estimation,” arXiv preprint arXiv:2008.04637, 2020. DOI: https://doi.org/10.1007/978-3-030-66096-3_17

[4] N. Adaloglou et al., “A comprehensive study on deep learning-based methods for sign language recognition,” IEEE Transactions on Multimedia, vol. 24, pp. 1750–1762, 2022. DOI: https://doi.org/10.1109/TMM.2021.3070438

[5] S. Daga, A. Dusane, and D. Bobby, “With you – Indian sign language detection and alert system,” in Proc. Int. Conf., Pune, India, 2023. DOI: https://doi.org/10.1109/ESCI59607.2024.10497366

[6] S. Kurundkar, A. Joshi, A. Thaploo, S. Auti, and A. Awalgaonkar, “Real-time sign language detection,” in Proc. IEEE Conf., 2023. DOI: https://doi.org/10.1109/ViTECoN58111.2023.10157784

[7] N. Jindal, N. Yadav, N. Nirvan, and D. Kumar, “Sign language detection using convolutional neural network (CNN),” in Proc. IEEE World Conf. Applied Intelligence and Computing, 2022. DOI: https://doi.org/10.1109/AIC55036.2022.9848844

[8] H. Kim et al., “Smart gloves-based triboelectric nanogenerator for sign language detection,” Micro and Nano Systems Letters, vol. 13, p. 11, 2025. DOI: https://doi.org/10.1186/s40486-025-00231-7

[9] P. Verma and K. Badli, “Real-time sign language detection using TensorFlow, OpenCV and Python,” International Journal for Research in Applied Science & Engineering Technology, vol. 10, no. 5, May 2022. DOI: https://doi.org/10.22214/ijraset.2022.43439

[10] A. Deep, A. Litoriya, A. Ingole, V. Asare, S. M. Bhole, and S. Pathak, “Real-time sign language detection and recognition,” 2023. DOI: https://doi.org/10.1109/ASIANCON55314.2022.9908995

[11] S. Misal and U. Gaikwad, “Sign language detection using machine learning,” International Journal of Innovative Science and Research Technology, vol. 9, no. 8, Aug. 2024. DOI: https://doi.org/10.38124/ijisrt/IJISRT24AUG347

[12] B. D. Khuat, D. T. Phung, H. T. T. Pham, A. N. Bui, and S. T. Ngo, “Vietnamese sign language detection using MediaPipe,” in Proc. 10th Int. Conf. Software and Computer Applications (ICSCA), Kuala Lumpur, Malaysia, 2021. DOI: https://doi.org/10.1145/3457784.3457810

[13] D. Kothadiya, C. Bhatt, K. Sapariya, K. Patel, A. B. Gil-González, and J. M. Corchado, “DeepSign: Sign language detection and recognition using deep learning,” Electronics, vol. 11, p. 1780, 2022. DOI: https://doi.org/10.3390/electronics11111780

[14] J. Zhang et al., “Sign language recognition based on dual-path background erasing deep convolutional neural network,” Scientific Reports, vol. 14, 2024. DOI: https://doi.org/10.1038/s41598-024-62008-z

[15] D. Kumari, S. Gupta, and P. Singh, “Isolated video-based sign language recognition using attention-based LSTM networks,” Electronics, vol. 13, no. 7, 2024. DOI: https://doi.org/10.3390/electronics13071229

[16] I. Mansour et al., “Hybrid deep learning models for Arabic sign language recognition using vision transformers,” Informatics, vol. 9, no. 11, 2025. DOI: https://doi.org/10.3390/bdcc9110281

[17] S. T. Abd Al-Latief, “Deep learning for sign language recognition: A comprehensive review,” Journal of Intelligent Systems and Internet of Things, 2024. DOI: https://doi.org/10.2478/jsiot-2024-0006

[18] K. Myagila, “Framework for detecting and recognizing sign language from continuous videos using pose estimation,” Computers & Electrical Engineering, 2025. DOI: https://doi.org/10.1016/j.mlwa.2025.100723

[19] A. Alkhoraif et al., “Ensemble transformer-based word-level sign language recognition using WLASL dataset,” Artificial Intelligence Review, 2025.

[20] S. K. Paul et al., “An Adam-based CNN and LSTM approach for real-time sign language recognition,” Bulletin of Electrical Engineering and Informatics, vol. 13, no. 1, 2023. DOI: https://doi.org/10.11591/eei.v13i1.6059

[21] Y. S. N. Rao et al., “Dynamic sign language recognition and translation through deep learning: A systematic review,” Journal of Theoretical and Applied Information Technology, 2024.

[22] J. Rheiner et al., “High-accuracy CPU real-time American Sign Language recognition using deep learning,” Computers & Electrical Engineering, 2025. DOI: https://doi.org/10.1016/j.mlwa.2025.100650

[23] L. Madhan et al., “Sign language recognition in real time: A deep learning framework for human–computer interaction,” Journal of Information Systems Engineering and Management, 2025. DOI: https://doi.org/10.52783/jisem.v10i44s.8609

[24] I. M. Violet et al., “A comprehensive survey on recent advances and challenges in sign language recognition,” Artificial Intelligence Review, 2025. DOI: https://doi.org/10.1007/s44163-025-00629-7

[25] D. Li, C. Rodriguez, X. Yu, and H. Li, “Word-level deep sign language recognition from video using the large-scale WLASL dataset,” arXiv preprint arXiv:1910.11006, 2019. DOI: https://doi.org/10.1109/WACV45572.2020.9093512

[26] H. Luqman et al., “SignVLM: A pre-trained large video model for sign language recognition,” 2025. DOI: https://doi.org/10.7717/peerj-cs.3112

[27] K. Govindharajalu and P. Anand, “Indian sign language recognition utilizing BERT and LSTM models,” International Journal of Computational and Experimental Science and Engineering, vol. 11, no. 1, 2025. DOI: https://doi.org/10.22399/ijcesen.1276

[28] M. Verma et al., “Sign language detection and recognition using image processing and deep learning techniques,” 2025.

[29] P. Jayanthi, R. K. Sathia Bhama Ponsy, and B. Madhubalasri, “Sign language recognition using deep CNN with normalized keyframe extraction and prediction using LSTM,” Journal of Scientific & Industrial Research, vol. 82, no. 7, pp. 745–755, Jul. 2023. DOI: https://doi.org/10.56042/jsir.v82i07.2375

[30] P. Rawat, P. Kumar, V. K. Tamta, and A. Kumar, “A comprehensive approach to Indian sign language recognition: Leveraging LSTM and MediaPipe holistic for dynamic and static hand gesture recognition,” EAI Endorsed Transactions on AI and Robotics, vol. 4, 2025, doi:10.4108/airo.8693. DOI: https://doi.org/10.4108/airo.8693

Most read articles by the same author(s)