YOLO Deep-Learning Based Driver Behaviors Detection and Effective Gaze Estimation by Head Poses for Driver Monitor System

Yi Chiao Fang*, Xi Liang Zhao, Hsuan Yu Lin, Yu Cheng Yang, Jiun In Guo*, Chih Peng Fan

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

This work develops a non-contact driver behavior monitoring system based on intelligent visual sensing to improve the driving safety. By the deep learning technology with YOLO, a car-specification near-infrared (NIR) camera is installed to detect the driver's behaviors and gaze directions. The YOLO-based head pose inference method is developed, and the driver's gaze directions are predicted with the simplified calibration. In experiments, the input size of YOLOv4-tiny based model is set to 416x416 pixels. After functional tests, the proposed method performs average precision (AP) to be 86.58% for detecting eleven classes including driver's objects and behaviors. Besides, the proposed gaze estimation technology by driver's head poses performs average detection accuracy up to 83% to estimate twelve driver's gaze directions.

Original languageEnglish
Title of host publicationGCCE 2023 - 2023 IEEE 12th Global Conference on Consumer Electronics
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages82-83
Number of pages2
ISBN (Electronic)9798350340181
DOIs
StatePublished - 2023
Event12th IEEE Global Conference on Consumer Electronics, GCCE 2023 - Nara, Japan
Duration: 10 Oct 202313 Oct 2023

Publication series

NameGCCE 2023 - 2023 IEEE 12th Global Conference on Consumer Electronics

Conference

Conference12th IEEE Global Conference on Consumer Electronics, GCCE 2023
Country/TerritoryJapan
CityNara
Period10/10/2313/10/23

Keywords

  • driver behaviors detection
  • Driver monitor system (DMS)
  • gaze estimation
  • head poses
  • YOLOv4-tiny

Fingerprint

Dive into the research topics of 'YOLO Deep-Learning Based Driver Behaviors Detection and Effective Gaze Estimation by Head Poses for Driver Monitor System'. Together they form a unique fingerprint.

Cite this