Authors : Abdul Rehman; Mohammad Zaidan Waseem; Abdul Rafey; Ali Abbas Hussaini; Hina Parveen; Nida Khan

Volume/Issue : Volume 10 - 2025, Issue 4 - April

Google Scholar : https://tinyurl.com/ymvtu3rh

Scribd : https://tinyurl.com/p22r8jhm

DOI : https://doi.org/10.38124/ijisrt/25apr1476

Google Scholar

Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.

Note : Google Scholar may take 15 to 20 days to display the article.

Abstract : Human drivers bring a unique mix of skills, instincts, and emotions to the road, shaped by their individual driving habits. However, driver drowsiness poses a serious threat to road safety, making it critical to develop effective detection systems to prevent accidents. Past efforts to identify unusual driver behavior often focused on analyzing the driver’s face or vehicle movements using computer vision techniques. While these methods provided some insights, they struggled to capture the full complexity of driver behavior. With the rise of deep learning, researchers have increasingly turned to neural networks to better understand and detect driver drowsiness. This paper presents a fresh approach using vision transformers and YOLOv5 architectures to recognize signs of drowsiness. We propose a customized YOLOv5 model, pre-trained to detect and extract the driver’s face as the Region of Interest (ROI). To overcome the limitations of earlier systems, we incorporate vision transformers for binary image classification. Our model was trained and tested on the public UTA-RLDD dataset, achieving impressive results with 96.2% training accuracy and 97.4% validation accuracy. To further evaluate its performance, we tested the framework on a custom dataset of 39 participants under various lighting conditions, where it achieved a solid 95.5% accuracy. These experiments highlight the strong potential of our approach for real-world use in smart transportation systems, paving the way for safer roads.

Keywords : Drowsiness Detection, Image Classification , Vision Transformers (VIT) ,Yolov5, Face Detection.

References :

1. “Nhtsa       report(accessed    on 4 august           2021).”  [Online]. Available: https://www.nhtsa.gov
2. J. Yu, S. Park, S. Lee, and M. Jeon, “Driver drowsiness detection using condition-adaptive representation learning framework,” IEEE Transactions on Intelligent Transportation Systems, vol. 20, no. 11, pp. 4206– 4218, 2019.
3. Y. S. S. E. Viswapriya, Singamsetti Balabalaji, “A machine-learning approach for driver-drowsiness detection based on eye-state,” INTER-NATIONAL JOURNAL OF ENGINEERING RESEARCH & TECHNOL- OGY (IJERT), vol. 10, April 2021.
4. M. M. Hasan, C. N. Watling, and G. S. Larue, “Physiological signalbased drowsiness detection using machine learning: Singular and hybrid signal approaches,” Journal of Safety Research, 2021.
5. D. K. D. K.Mirunalini, “Drowsiness detection using deep neural network,” Turkish Journal of Computer and Mathematics Education, vol. 12, no. 9, pp. 317–326, 2021.
6. M. Gromer, D. Salb, T. Walzer, N. M. Madrid, and R. Seepold, “Ecg sensor for detection of driver’s drowsiness,” Procedia Computer Science, vol. 159, pp. 1938–1946, 2019, knowledge-Based and Intelligent Information & Engineering Systems: Proceedings of the 23rd International Conference KES2019.
7. M. Zhu, H. Li, J. Chen, M. Kamezaki, Z. Zhang, Z. Hua, and S. Sugano, “Eeg-based system using deep learning and attention mechanism for driver drowsiness detection,” in 2021 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops), 2021, pp. 280–286.
8. M. Song, L. Li, J. Guo, T. Liu, S. Li, Y. Wang, Qurat ul ain, and J. Wang, “A new method for muscular visual fatigue detection using electrooculogram,” Biomedical Signal Processing and Control, vol. 58, p. 101865, 2020.
9. L. R. Femilia Hardina Caryn, “Driver drowsiness detection based on drivers’ physical behaviours: A systematic literature review,” Computer Engineering and Applications, vol. 10, no. 3, 2021.
10. H. U. R. Siddiqui, A. A. Saleem, R. Brown, B. Bademci, E. Lee, F. Rustam, and S. Dudley, “Non-invasive driver drowsiness detection system,” Sensors, vol. 21, no. 14, 2021.
11. L. Thulasimani, P. P, and P. S P, “Real time driver drowsiness detection using opencv and facial landmarks,” Int. J. of Aquatic Science, vol. 12, no. 2, pp. 4297–4314, 2021.
12. S. Bakheet and A. Al-Hamadi, “A framework for instantaneous driver drowsiness detection based on improved hog features and na¨ıve bayesian classification,” Brain Sciences, vol. 11, p. 240, 02 2021.
13. A. A. Jordan, A. Pegatoquet, A. Castagnetti, J. Raybaut, and P. Le Coz, “Deep learning for eye blink detection implemented at the edge,” IEEE Embedded Systems Letters, vol. 13, no. 3, pp. 130–133, 2021.
14. T. Vesselenyi, S. Moca, A. Rus, T. Mitran, and B. Tataru, “Driver˘ drowsiness detection using ANN image processing,” IOP Conference Series: Materials Science and Engineering, vol. 252, p. 012097, oct 2017.
15. M. Ngxande, J.-R. Tapamo, and M. Burke, “Bias remediation in driver drowsiness detection systems using generative adversarial networks,” IEEE Access, vol. 8, pp. 55592–55601, 2020.
16. Z. Li, C. Liukui, J. Peng, and Y. Wu, “Automatic detection of driver fatigue using driving operation information for transportation safety,” Sensors, vol. 17, p. 1212, 05 2017.
17. S. Said, S. Alkork, T. Beyrouthy, M. Hassan, O. E. Abdellatif, and M. F. Abdraboo, “Real Time Eye Tracking and Detection- A Driving Assistance System,” Advances in Science, Technology and Engineering Systems Journal, vol. 3, no. 6, pp. 446–454, 2018.
18. F. You, X. Li, Y. Gong, H. Wang, and H. Li, “A real-time driving drowsiness detection algorithm with individual differences consideration,” IEEE Access, vol. 7, pp. 179396–179408, 2019.
19. R. Tamanani, R. Muresan, and A. Al-Dweik, “Estimation of driver vigilance status using real-time facial expression and deep learning,” IEEE Sensors Letters, vol. 5, no. 5, pp. 1–4, 2021.
20. Z. X. Xu Q Zhu Z, Ge H Zhang Z, “Effective face detector based on yolov5 and superresolution reconstruction.” Comput Math Methods Med. 2021, Published 2021 Nov 16.
21. D. Qi, W. Tan, Q. Yao, and J. Liu, “Yolo5face: Why reinventing a face detector,” 2022.
22. A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai,
23. T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, J. Uszkoreit, and N. Houlsby, “An image is worth 16x16 words: Transformers for image recognition at scale,” CoRR, vol. abs/2010.11929, 2020.
24. H. Dong, L. Zhang, and B. Zou, “Exploring vision transformers for polarimetric sar image classification,” IEEE Transactions on Geoscience and Remote Sensing, pp. 1–1, 2021.
25. P. Deng, K. Xu, and H. Huang, “When cnns meet vision transformer: A joint framework for remote sensing scene classification,” IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1–5, 2022.
26. Y. Bazi, L. Bashmal, M. M. A. Rahhal, R. A. Dayil, and N. A. Ajlan, “Vision transformers for remote sensing image classification,” Remote Sensing, vol. 13, no. 3, 2021.
27. R. Ghoddoosian, M. Galib, and V. Athitsos, “A realistic dataset and baseline temporal model for early drowsiness detection,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2019, pp. 0–0.
28. S. Mittal, S. Gupta, Sagar, A. Shamma, I. Sahni, and N. Thakur, “Driver drowsiness detection using machine learning and image processing,” in 2021 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO), 2021, pp. 1–8.
29. A.-C. Phan, N.-H.-Q. Nguyen, T.-N. Trieu, and T.-C. Phan, “An efficient approach for detecting driver drowsiness based on deep learning,” Applied Sciences, vol. 11, no. 18, 2021.
30. S.-H. L. Ching-Hua Weng, Ying-Hsiu Lai, “Driver drowsiness detection via a hierarchical temporal deep belief network,” In Asian Conference on Computer Vision Workshop on Driver Drowsiness Detection from Video, Taipei, Taiwan, Nov. 2016.