Machine Learning and End-to-End Deep Learning for Monitoring Driver Distractions From Physiological and Visual Signals

Project Code :TCMAPY283

Objective

The main objective of this project is for detecting driver distraction using multimodal data. In this the main contributions are statistical analysis for the identification of the best features and modalities for detecting each of four types of distraction, namely, cognitive, emotional, sensorimotor and mixed distraction.Comparison of classical ML and end-to-end deep learning (DL) models for driver distraction detection, including an analysis with respect to the size of the input window and the type of the input modality.

Abstract

It is only a matter of time until autonomous vehicles become ubiquitous; however, human driving supervision will remain a necessity for decades. To assess the driver’s ability to take control over the vehicle in critical scenarios, driver distractions can be monitored using wearable sensors or sensors that are embedded in the vehicle, such as video cameras. The types of driving distractions that can be sensed with various sensors is an open research question that this study attempts to answer. This study compared data from physiological sensors (palm electrodermal activity (pEDA), heart rate and breathing rate) and visual sensors (eye tracking, pupil diameter, nasal EDA (nEDA), emotional activation and facial action units (AUs)) for the detection of four types of distractions.

Keywords: Machine Learning, Deep Learning, Driver Distraction, Sensors, Facial Expressions.

 

NOTE: Without the concern of our team, please don't submit to the college. This Abstract varies based on student requirements.

Block Diagram

Specifications

HARDWARE SPECIFICATIONS:

  • Processor- I3/Intel Processor
  •  RAM- 4GB (min)
  • Hard Disk- 128 GB
  • Key Board-Standard Window
  •  Keyboard. Mouse-Two or Three Button Mouse.
  • Monitor-Any.

SOFTWARE SPECIFICATIONS:

  • Operating System: Windows 7+
  • Technology: Python 3.6+
  •  IDE: PyCharm IDE
  •  Libraries Used: Pandas, NumPy, OpenCV, TensorFlow, Matplotlib.

Learning Outcomes

  • Uses of Unsupervised Learning.
  • Importance of classification.
  • CNN Implementation.
  • Difference between CNN and RNN.
  • About Tensorflow framework,
  • About LSTM, DNN and OpenCV.
  • Importance of PyCharm IDE.
  • Process of debugging a code.
  • The problem with imbalanced dataset.
  • Input and Output modules.
  • How test the project based on user inputs and observe the output.
  • Project Development Skills:
    • Problem analyzing skills.
    • Problem solving skills.
    • Creativity and imaginary skills.
    • Programming skills.
    • Deployment.
    • Testing skills.
    • Debugging skills.
    • Project presentation skills.
    • Thesis writing skills.

Demo Video

mail-banner
call-banner
contact-banner
Request Video