Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Open-Set LiDAR Panoptic Segmentation Guided by Uncertainty-Aware Learning

Created by
  • Haebom

Author

Rohit Mohan, Julia Hindel, Florian Drews, Claudius Glaser, Daniele Cattaneo, Abhinav Valada

Outline

In this paper, we propose ULOPS, an uncertainty-based open-set panorama segmentation framework for detecting unknown object instances. This framework leverages Dirichlet-based evidence learning to model prediction uncertainty and integrates semantic segmentation with uncertainty estimation, embeddings for prototype association, and a separate decoder for instance-centric prediction. Unknown instances are identified and segmented using uncertainty estimates during the inference process. To enhance the model's ability to distinguish between known and unknown objects, we introduce three uncertainty-based loss functions: Uniform Evidence Loss, Adaptive Uncertainty Separation Loss, and Contrastive Uncertainty Loss. We evaluate the open-set performance by extending the KITTI-360 benchmark and introducing a new open-set evaluation on nuScenes, experimentally demonstrating that our framework outperforms existing methods.

Takeaways, Limitations

Takeaways:
We present a novel method for effectively tackling the open-set panorama segmentation problem by modeling uncertainty using Dirichlet-based evidence learning.
Effectively amplify the uncertainty difference between known and unknown objects through three uncertainty-based loss functions.
We verified its practicality by demonstrating superior performance compared to existing methods on the KITTI-360 and nuScenes datasets.
Applying a new open-set evaluation method to the nuScenes dataset to provide objective evaluation criteria for open-set problems.
Limitations:
The performance improvement of the proposed method may be limited to specific datasets.
Further research is needed on generalization performance in various environments and conditions.
Consideration needs to be given to computational costs and real-time processing performance for application to actual autonomous driving systems.
Further review is needed on the generalizability and validity of new open set evaluation methods.
👍