• CN:11-2187/TH
  • ISSN:0577-6686

机械工程学报 ›› 2019, Vol. 55 ›› Issue (2): 18-26.doi: 10.3901/JME.2019.02.018

• 仪器科学与技术 • 上一篇    下一篇

基于面部几何特征及手部运动特征的驾驶员疲劳检测

刘明周, 蒋倩男, 扈静   

  1. 合肥工业大学机械工程学院 合肥 230009
  • 收稿日期:2017-09-13 修回日期:2018-06-19 出版日期:2019-01-20 发布日期:2019-01-20
  • 通讯作者: 蒋倩男(通信作者),女,1992年出生,博士研究生。主要研究方向为人-机-环境工程学和机器视觉。E-mail:1191758741@qq.com
  • 作者简介:刘明周,男,1968年出生,博士,教授,博士研究生导师。主要研究方向为人-机-环境工程学、制造过程监测、控制与管理以及工业工程系统理论、分析及决策方法。E-mail:liumingzhou0551@163.com;扈静,女,1976年出生,博士,教授,硕士研究生导师。主要研究方向为人-机-环境工程学和制造过程监测与控制。E-mail:52868648@qq.com
  • 基金资助:
    国家自然科学基金资助项目(51375134)

Based on Facial Geometric Features and Hand Motion Characteristics Driver Fatigue Detection

LIU Mingzhou, JIANG Qiannan, HU Jing   

  1. School of Mechanical and Automotive Engineering, Hefei University of Technology, Hefei 230009
  • Received:2017-09-13 Revised:2018-06-19 Online:2019-01-20 Published:2019-01-20

摘要: 驾驶员疲劳驾驶是造成交通事故的主要原因之一,为解决该问题,提出一种新的基于机器视觉的驾驶员疲劳状态检测方法。根据驾驶员视频图像特点,采用基于肤色检测的Adaboost算法提取面部以及手部的感兴趣区域(Regions of interest,ROIs)。基于尺度不变特征变换(Scale invariant feature transform,SIFT)特征点匹配获取眼、嘴以及手部的SIFT特征点,据此得出面部以及手部特征参数。将Perclos、MClosed、Phdown以及SA 4个特征参数作为模型输入,疲劳度等级作为模型输出,建立三层BP神经网络模型,并应用贝叶斯正则化并结合动量梯度下降法较好地解决了传统BP人工神经网络训练高精度和预测低精度的过拟合现象。试验数据表明,该方法能够克服光照、背景、角度以及个体差异的影响,且疲劳检测的正确识别率达到99.64%。

关键词: BP人工神经网络, SIFT特征点匹配, 肤色检测, 机器视觉, 驾驶疲劳

Abstract: Fatigue driving is one of the major causes of traffic accidents. In order to solve the problem, a new method based on machine vision for driver fatigue detection is proposed. According to the characteristics of the driver's video image, the regions of interest (ROIs) of face and hand are extracted by the Adaboost algorithm based on skin color detection. Based on SIFT (scale invariant feature transform) feature points matching, the SIFT feature points of the eye, mouth and hand are extracted, and the facial and hand feature parameters are obtained. The 4 characteristic parameters of Perclos, MClosed, Phdown and SA are used as model inputs, and the fatigue grade is used as model output. Three layer BP neural network model is established. The Bayesian regularization and the momentum gradient descent method are used to solve the overfitting phenomena of the traditional BP neural network training with high accuracy and low prediction accuracy. The experimental data show that the method can overcome the influence of illumination, background, angle and individual difference, and the correct recognition rate of fatigue detection is 99.64%.

Key words: BP artificial neural network, driving fatigue, machine vision, SIFT feature point matching, skin color detection

中图分类号: