Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Leveraging Out-of-Distribution Unlabeled Images: Semi-Supervised Semantic Segmentation with an Open-Vocabulary Model

Created by
  • Haebom

Author

Wooseok Shin, Jisu Kang, Hyeonki Jeong, Jin Sob Kim, Sung Won Han

Outline

This paper proposes SemiOVS, a semi-supervised learning-based semantic segmentation framework that leverages limited labeled data and abundant out-of-distribution (OOD) unlabeled data. While previous studies have shown promising results using limited segmentation of standard datasets, the potential of leveraging large-scale unlabeled images has not been explored. SemiOVS utilizes the Open-Vocabulary Segmentation (OVS) model to generate highly accurate pseudo-labels for OOD images. Experimental results on the Pascal VOC and Context datasets demonstrate that leveraging additional unlabeled images in a label-constrained environment improves performance, particularly when leveraging OOD images via the OVS model. SemiOVS achieves state-of-the-art performance, outperforming existing methods PrevMatch and SemiVL by +3.5 mIoU and +3.0 mIoU, respectively.

Takeaways, Limitations

Takeaways:
Experimentally demonstrating the effectiveness of leveraging rich unlabeled images in a limited label data environment.
A novel semi-supervised learning framework based on the OVS model for effectively utilizing OOD images is presented.
Achieving state-of-the-art performance by improving semantic segmentation performance compared to existing methods.
Suggesting the potential of utilizing large-scale unlabeled data in real-world applications.
Limitations:
Further research is needed on the generalization performance of the method presented in this paper.
Robustness evaluation for various OOD data distributions is needed.
There is a need to verify the generalizability of experimental results limited to a specific dataset.
👍