5678910118 of 46
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A smart vision system for early driver drowsiness detection using CNN–transformer hybrid model with attention-based learning
Azarbaijan Shahid Madani University, Iran.
Azarbaijan Shahid Madani University, Iran.
İstinye University, Turkey.
Blekinge Institute of Technology, Faculty of Computing, Department of Computer Science.ORCID iD: 0000-0001-7536-3349
Show others and affiliations
2026 (English)In: Discover Artificial Intelligence, E-ISSN 2731-0809, Vol. 6, no 1, article id 809Article in journal (Refereed) Published
Abstract [en]

Driver drowsiness is one of the major factors that lead to serious traffic accidents, developing a reliable and real-time detection system is very important. In this paper, we propose a three-step vision-based pipeline for detecting driver drowsiness by combining computer vision and deep learning methods. First, an adaptive keyframe extraction approach based on histogram analysis and chi-square distance is applied to automatically select the most informative frames from a video sequence. Then, MediaPipe Face Mesh is used to extract facial landmarks, and key geometric features such as Eye Aspect Ratio (EAR), Mouth Aspect Ratio (MAR), and blink-related attributes are computed to represent drowsiness-related facial behavior. Finally, a hybrid CNN–Transformer model is designed to capture both short-term and long-term temporal patterns from the extracted feature sequences. The proposed model effectively distinguishes between Alert and Drowsy states, achieving 97.5% accuracy, a high F1-score, and a low false alarm rate, outperforming several traditional machine learning and deep learning baselines. The main contribution of this work is the integration of adaptive keyframe selection with an attention-based hybrid deep learning architecture, which makes the system efficient and suitable for real-time implementation in intelligent vehicle safety systems. 

Place, publisher, year, edition, pages
Springer Nature, 2026. Vol. 6, no 1, article id 809
Keywords [en]
Attention-based learning, Deep neural networks, Driver drowsiness detection, Hybrid CNN–transformer, Temporal feature modeling, Vision-based safety systems, Aspect ratio, Behavioral research, Computer vision, Highway accidents, Intelligent vehicle highway systems, Real time control, Security systems, Driver drowsiness, Drowsiness detection, Feature models, Neural-networks, Temporal features, Vision based, Vision-based safety system
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:bth-30446DOI: 10.1007/s44163-026-01575-8Scopus ID: 2-s2.0-105047660047OAI: oai:DiVA.org:bth-30446DiVA, id: diva2:2096296
Available from: 2026-08-28 Created: 2026-08-28 Last updated: 2026-08-28Bibliographically approved

Open Access in DiVA

fulltext(2947 kB)18 downloads
File information
File name FULLTEXT01.pdfFile size 2947 kBChecksum SHA-512
db06518cfbb99e3ed06fe1e13bd8909d336c731d7eca28b8acf664aa1608f69fce80a949bcf9000b7b98be46f82e22b51bf6564b9f77d2a141a6d74a7a34e14f
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Kusetogullari, Hüseyin

Search in DiVA

By author/editor
Kusetogullari, Hüseyin
By organisation
Department of Computer Science
In the same journal
Discover Artificial Intelligence
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 234 hits
5678910118 of 46
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf