Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Fractured Glass, Failing Cameras: Simulating Physics-Based Adversarial Samples for Autonomous Driving Systems

Created by
  • Haebom

Author

Manav Prabhakar, Jwalandhar Girnar, Arpan Kusari

Outline

This paper focuses on physically based adversarial examples generated by physical defects within the camera of autonomous vehicles. Two real-world experiments demonstrate that glass breakage induces errors in neural network-based object detection models. A simulation-based study exploiting the physical processes of glass breakage generates realistic physically based adversarial examples. A finite element model (FEM)-based approach is used to generate surface cracks in camera images by applying a stress field defined by particles within a triangular mesh. Physically Based Rendering (PBR) techniques are used to realistically visualize these physically plausible defects. The simulated broken glass effect is applied as an image filter to open-source datasets such as KITTI and BDD100K, and the safety implications for object detection neural networks such as YOLOv8, Faster R-CNN, and Pyramid Vision Transformers are analyzed. Furthermore, the Kullback-Leibler (KL) divergence is calculated between various datasets (our own footage, KITTI, and the Kaggle cat and dog datasets) to investigate the distributional impact of visual distortion. KL divergence analysis results show that the broken glass filter does not cause significant changes in the data distribution.

Takeaways, Limitations

Takeaways: We highlight the importance of adversarial examples caused by physical camera failures in autonomous vehicles and present a novel methodology for realistically simulating and analyzing them. This paper provides a new perspective on physics-based adversarial example generation and safety assessment. We confirm that the broken glass filter has little effect on the data distribution.
Limitations: Currently, the focus is solely on glass breakage, and further research is needed on other types of camera physical failures. Test results in real-world road conditions are not presented. The diversity of the dataset used may be limited. Further research is needed that considers a wider range of breakage types and environmental conditions.
👍