A Comprehensive Review of Machine Learning and Deep Learning Techniques for Sign Language Recognition.
Main Article Content
Abstract
Sign language serves as the primary means of communication for the deaf and hard-of-hearing community. However, communication barriers still exist between sign language users and the general population. Recent advances in machine learning (ML) and deep learning (DL) have enabled automated sign language recognition (SLR) systems capable of translating gestures into text or speech. This paper presents a systematic review of ML- and DL-based techniques used for SLR across various languages, including American Sign Language and Arabic Sign Language. The review examines classical machine learning approaches, convolutional neural networks (CNNs), hybrid architectures such as CNN-LSTM and CNN-HMM, and video-based models including 3D CNNs. Comparative analysis indicates that deep learning methods significantly outperform traditional techniques due to their ability to automatically extract spatial and temporal features. However, challenges such as limited datasets, signer variability, computational complexity, and real-time deployment constraints remain significant. This review identifies research gaps and discusses future directions, including multimodal learning, lightweight architectures, and multilingual datasets, to improve the scalability and applicability of SLR systems.
Downloads
Article Details
Section

This work is licensed under a Creative Commons Attribution 4.0 International License.
All articles published in Interdisciplinary Journal of AI, Machine Learning & Data Science (IJAIMLDS) are licensed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0).
This license allows others to share, copy, distribute, and adapt the work, provided that proper credit is given to the original author(s) and the source.
Authors retain copyright and grant Interdisciplinary Journal of AI, Machine Learning & Data Science (IJAIMLDS) the right of first publication.
How to Cite
References
[1] A. M. Buttar, U. Ahmad, A. H. Gumaei, A. Assiri, M. A. Akbar, and B. F. Alkhamees, “Deep learning in sign language recognition: A hybrid approach for the recognition of static and dynamic signs,” Mathematics, vol. 11, no. 17, p. 3729, Aug. 2023. DOI: https://doi.org/10.3390/math11173729
[2] V. Ravikiran, “Real-time sign language recognition and translation using MediaPipe and LSTM-based deep learning,” International Journal of Computer Applications, vol. 187, no. 25, pp. 10–14, Jul. 2025, doi:10.5120/ijca2025925415. DOI: https://doi.org/10.5120/ijca2025925415
[3] A. Moryossef, I. Tsochantaridis, R. Aharoni, S. Ebling, and S. Narayanan, “Real-time sign language detection using human pose estimation,” arXiv preprint arXiv:2008.04637, 2020. DOI: https://doi.org/10.1007/978-3-030-66096-3_17
[4] N. Adaloglou et al., “A comprehensive study on deep learning-based methods for sign language recognition,” IEEE Transactions on Multimedia, vol. 24, pp. 1750–1762, 2022. DOI: https://doi.org/10.1109/TMM.2021.3070438
[5] S. Daga, A. Dusane, and D. Bobby, “With you – Indian sign language detection and alert system,” in Proc. Int. Conf., Pune, India, 2023. DOI: https://doi.org/10.1109/ESCI59607.2024.10497366
[6] S. Kurundkar, A. Joshi, A. Thaploo, S. Auti, and A. Awalgaonkar, “Real-time sign language detection,” in Proc. IEEE Conf., 2023. DOI: https://doi.org/10.1109/ViTECoN58111.2023.10157784
[7] N. Jindal, N. Yadav, N. Nirvan, and D. Kumar, “Sign language detection using convolutional neural network (CNN),” in Proc. IEEE World Conf. Applied Intelligence and Computing, 2022. DOI: https://doi.org/10.1109/AIC55036.2022.9848844
[8] H. Kim et al., “Smart gloves-based triboelectric nanogenerator for sign language detection,” Micro and Nano Systems Letters, vol. 13, p. 11, 2025. DOI: https://doi.org/10.1186/s40486-025-00231-7
[9] P. Verma and K. Badli, “Real-time sign language detection using TensorFlow, OpenCV and Python,” International Journal for Research in Applied Science & Engineering Technology, vol. 10, no. 5, May 2022. DOI: https://doi.org/10.22214/ijraset.2022.43439
[10] A. Deep, A. Litoriya, A. Ingole, V. Asare, S. M. Bhole, and S. Pathak, “Real-time sign language detection and recognition,” 2023. DOI: https://doi.org/10.1109/ASIANCON55314.2022.9908995
[11] S. Misal and U. Gaikwad, “Sign language detection using machine learning,” International Journal of Innovative Science and Research Technology, vol. 9, no. 8, Aug. 2024. DOI: https://doi.org/10.38124/ijisrt/IJISRT24AUG347
[12] B. D. Khuat, D. T. Phung, H. T. T. Pham, A. N. Bui, and S. T. Ngo, “Vietnamese sign language detection using MediaPipe,” in Proc. 10th Int. Conf. Software and Computer Applications (ICSCA), Kuala Lumpur, Malaysia, 2021. DOI: https://doi.org/10.1145/3457784.3457810
[13] D. Kothadiya, C. Bhatt, K. Sapariya, K. Patel, A. B. Gil-González, and J. M. Corchado, “DeepSign: Sign language detection and recognition using deep learning,” Electronics, vol. 11, p. 1780, 2022. DOI: https://doi.org/10.3390/electronics11111780
[14] J. Zhang et al., “Sign language recognition based on dual-path background erasing deep convolutional neural network,” Scientific Reports, vol. 14, 2024. DOI: https://doi.org/10.1038/s41598-024-62008-z
[15] D. Kumari, S. Gupta, and P. Singh, “Isolated video-based sign language recognition using attention-based LSTM networks,” Electronics, vol. 13, no. 7, 2024. DOI: https://doi.org/10.3390/electronics13071229
[16] I. Mansour et al., “Hybrid deep learning models for Arabic sign language recognition using vision transformers,” Informatics, vol. 9, no. 11, 2025. DOI: https://doi.org/10.3390/bdcc9110281
[17] S. T. Abd Al-Latief, “Deep learning for sign language recognition: A comprehensive review,” Journal of Intelligent Systems and Internet of Things, 2024. DOI: https://doi.org/10.2478/jsiot-2024-0006
[18] K. Myagila, “Framework for detecting and recognizing sign language from continuous videos using pose estimation,” Computers & Electrical Engineering, 2025. DOI: https://doi.org/10.1016/j.mlwa.2025.100723
[19] A. Alkhoraif et al., “Ensemble transformer-based word-level sign language recognition using WLASL dataset,” Artificial Intelligence Review, 2025.
[20] S. K. Paul et al., “An Adam-based CNN and LSTM approach for real-time sign language recognition,” Bulletin of Electrical Engineering and Informatics, vol. 13, no. 1, 2023. DOI: https://doi.org/10.11591/eei.v13i1.6059
[21] Y. S. N. Rao et al., “Dynamic sign language recognition and translation through deep learning: A systematic review,” Journal of Theoretical and Applied Information Technology, 2024.
[22] J. Rheiner et al., “High-accuracy CPU real-time American Sign Language recognition using deep learning,” Computers & Electrical Engineering, 2025. DOI: https://doi.org/10.1016/j.mlwa.2025.100650
[23] L. Madhan et al., “Sign language recognition in real time: A deep learning framework for human–computer interaction,” Journal of Information Systems Engineering and Management, 2025. DOI: https://doi.org/10.52783/jisem.v10i44s.8609
[24] I. M. Violet et al., “A comprehensive survey on recent advances and challenges in sign language recognition,” Artificial Intelligence Review, 2025. DOI: https://doi.org/10.1007/s44163-025-00629-7
[25] D. Li, C. Rodriguez, X. Yu, and H. Li, “Word-level deep sign language recognition from video using the large-scale WLASL dataset,” arXiv preprint arXiv:1910.11006, 2019. DOI: https://doi.org/10.1109/WACV45572.2020.9093512
[26] H. Luqman et al., “SignVLM: A pre-trained large video model for sign language recognition,” 2025. DOI: https://doi.org/10.7717/peerj-cs.3112
[27] K. Govindharajalu and P. Anand, “Indian sign language recognition utilizing BERT and LSTM models,” International Journal of Computational and Experimental Science and Engineering, vol. 11, no. 1, 2025. DOI: https://doi.org/10.22399/ijcesen.1276
[28] M. Verma et al., “Sign language detection and recognition using image processing and deep learning techniques,” 2025.
[29] P. Jayanthi, R. K. Sathia Bhama Ponsy, and B. Madhubalasri, “Sign language recognition using deep CNN with normalized keyframe extraction and prediction using LSTM,” Journal of Scientific & Industrial Research, vol. 82, no. 7, pp. 745–755, Jul. 2023. DOI: https://doi.org/10.56042/jsir.v82i07.2375
[30] P. Rawat, P. Kumar, V. K. Tamta, and A. Kumar, “A comprehensive approach to Indian sign language recognition: Leveraging LSTM and MediaPipe holistic for dynamic and static hand gesture recognition,” EAI Endorsed Transactions on AI and Robotics, vol. 4, 2025, doi:10.4108/airo.8693. DOI: https://doi.org/10.4108/airo.8693