Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Driver-Net: Multi-Camera Fusion for Assessing Driver Take-Over Readiness in Automated Vehicles

Created by
  • Haebom

Author

Mahdi Rezaei, Mohsen Azarmi

Outline

This paper proposes Driver-Net, a novel deep learning framework that accurately and timely assesses driver readiness to ensure safe control transfer in autonomous vehicles. Unlike conventional vision-based driver monitoring systems that focus on head posture or gaze, Driver-Net uses three cameras to synchronize and capture visual cues such as the driver's head, hands, and posture. It integrates spatiotemporal data through a dual-path architecture comprised of context blocks and feature blocks, and employs a multi-modal fusion strategy to enhance prediction accuracy. Evaluation results using a diverse dataset collected from the University of Leeds Driving Simulator demonstrate a maximum accuracy of 95.8% in driver readiness classification. This represents a significant improvement over existing methods and highlights the importance of multi-modal and multi-view fusion. As a real-time, non-invasive solution, Driver-Net significantly contributes to the development of safer and more reliable autonomous vehicles, meeting emerging regulations and future safety standards.

Takeaways, Limitations

Takeaways:
Improved driver handover readiness prediction accuracy (up to 95.8%) through multi-modal fusion using multiple cameras.
Presenting the possibility of implementing a real-time, non-intrusive driver monitoring system.
Contributing to improving the safety and reliability of autonomous vehicles
Contributing to meeting new regulations and safety standards
Limitations:
Since it was evaluated using simulator data, performance verification in actual road environments is required.
Need for generalized performance evaluation across a variety of driver characteristics and environmental conditions
Further research is needed on the size and diversity of the dataset.
Consideration should be given to computational costs and energy consumption that may arise when applying the system to actual vehicles.
👍