A smart vision system for early driver drowsiness detection using CNN–transformer hybrid model with attention-based learningShow others and affiliations
2026 (English)In: Discover Artificial Intelligence, E-ISSN 2731-0809, Vol. 6, no 1, article id 809Article in journal (Refereed) Published
Abstract [en]
Driver drowsiness is one of the major factors that lead to serious traffic accidents, developing a reliable and real-time detection system is very important. In this paper, we propose a three-step vision-based pipeline for detecting driver drowsiness by combining computer vision and deep learning methods. First, an adaptive keyframe extraction approach based on histogram analysis and chi-square distance is applied to automatically select the most informative frames from a video sequence. Then, MediaPipe Face Mesh is used to extract facial landmarks, and key geometric features such as Eye Aspect Ratio (EAR), Mouth Aspect Ratio (MAR), and blink-related attributes are computed to represent drowsiness-related facial behavior. Finally, a hybrid CNN–Transformer model is designed to capture both short-term and long-term temporal patterns from the extracted feature sequences. The proposed model effectively distinguishes between Alert and Drowsy states, achieving 97.5% accuracy, a high F1-score, and a low false alarm rate, outperforming several traditional machine learning and deep learning baselines. The main contribution of this work is the integration of adaptive keyframe selection with an attention-based hybrid deep learning architecture, which makes the system efficient and suitable for real-time implementation in intelligent vehicle safety systems.
Place, publisher, year, edition, pages
Springer Nature, 2026. Vol. 6, no 1, article id 809
Keywords [en]
Attention-based learning, Deep neural networks, Driver drowsiness detection, Hybrid CNN–transformer, Temporal feature modeling, Vision-based safety systems, Aspect ratio, Behavioral research, Computer vision, Highway accidents, Intelligent vehicle highway systems, Real time control, Security systems, Driver drowsiness, Drowsiness detection, Feature models, Neural-networks, Temporal features, Vision based, Vision-based safety system
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:bth-30446DOI: 10.1007/s44163-026-01575-8Scopus ID: 2-s2.0-105047660047OAI: oai:DiVA.org:bth-30446DiVA, id: diva2:2096296
2026-08-282026-08-282026-08-28Bibliographically approved