Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Unified Domain Adaptive Semantic Segmentation

Created by
  • Haebom

Author

Zhe Zhang, Gaochang Wu, Jing Zhang, Xiatian Zhu, Dacheng Tao, Tianyou Chai

Outline

Unsupervised Domain Adaptive Semantic Segmentation (UDA-SS) aims to transfer supervision from a labeled source domain to an unlabeled target domain. This study integrates UDA-SS research across image and video scenarios, enabling a more comprehensive understanding, synergistic advancements, and efficient knowledge sharing. To this end, we explore integrated UDA-SS from a general data augmentation perspective, presenting a unified conceptual framework that enables improved generalization and cross-fertilization of ideas. Specifically, we propose a Quad-directional Mixup (QuadMix) method that addresses distinct point attributes and feature mismatches through a four-way path for intra- and inter-domain mixing in the feature space. To handle temporal variations in video, we integrate optical flow-based feature aggregation across spatial and temporal dimensions to achieve fine-grained domain alignment.

Takeaways, Limitations

We present an integrated approach to UDA-SS in both image and video scenarios, addressing the fragmentation of research fields and facilitating knowledge sharing.
We present a novel approach for intra- and inter-domain mixing in feature space via the Quad-directional Mixup (QuadMix) method.
Effectively handling temporal variations in videos using optical flow-based feature aggregation.
Outperforms state-of-the-art performance on four challenging UDA-SS benchmarks.
Promote reproducibility and advancement of research by making code and models open.
Limitations is not explicitly mentioned in the paper.
👍