Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Open-Set LiDAR Panoptic Segmentation Guided by Uncertainty-Aware Learning

Created by
  • Haebom

Author

Rohit Mohan, Julia Hindel, Florian Drews, Claudius Glaser, Daniele Cattaneo, Abhinav Valada

Outline

This paper proposes the Uncertainty-Guided Open-Set Panoptic Segmentation (ULOPS) framework, which addresses the limitations of existing closed-set LiDAR panoptic segmentation models, which fail to detect unknown object instances. This framework leverages Dirichlet-based evidence learning to model prediction uncertainty and integrates semantic segmentation with uncertainty estimates, embeddings with prototypical associations, and a separate decoder for instance-centric prediction. During inference, uncertainty estimates are utilized to identify and segment unknown instances. To enhance the model's ability to distinguish between known and unknown objects, three uncertainty-based loss functions are introduced: uniform evidence loss, adaptive uncertainty separation loss, and contrastive uncertainty loss. We evaluate the open-set performance by extending the KITTI-360 benchmark and introducing a new open-set evaluation on nuScenes, experimentally demonstrating that the proposed approach outperforms existing open-set LiDAR panoptic segmentation methods.

Takeaways, Limitations

Takeaways:
We effectively solve the open-set LiDAR panorama segmentation problem by modeling uncertainty using Dirichlet-based evidence learning.
The ability to distinguish between known and unknown objects was improved by introducing an uncertainty-based loss function.
We achieved superior performance over existing methods on the KITTI-360 and nuScenes datasets.
A new benchmark for open set evaluation is presented.
Limitations:
Additional performance verification of the proposed method in an actual autonomous driving environment is required.
There is a lack of robustness assessments for various environmental and meteorological conditions.
Further analysis of generalization performance for new, unknown object types is needed.
The computational cost may be high.
👍