Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

OT Score: An OT based Confidence Score for Source Free Unsupervised Domain Adaptation

Created by
  • Haebom

Author

Yiming Zhang, Sitong Liu, Alex Cloninger

Outline

This paper addresses the computational and theoretical limitations of current distribution alignment methods for source-free unsupervised domain adaptation (SFUDA). Specifically, we focus on estimating classification performance and confidence in situations where target labels are absent. To overcome the limitations of existing theoretical frameworks, which generate computationally intractable quantities and fail to adequately reflect the characteristics of the alignment algorithms used, we propose the Optimal Transport (OT) score, a novel theoretically derived confidence metric that leverages the flexibility of the decision boundary induced by the Semi-Discrete Optimal Transport alignment. The proposed OT score is intuitively interpretable, theoretically rigorous, and provides a principled uncertainty estimation for a given set of target pseudolabels. Experimental results demonstrate that the OT score outperforms existing confidence scores, improves SFUDA performance through training-time weighting adjustments, and provides a reliable label-free proxy for model performance.

Takeaways, Limitations

Takeaways:
SFUDA proposes OT score, a new reliability index for estimating classification performance and reliability.
The OT score outperforms the existing reliability score.
OT score improves SFUDA performance by adjusting training time weights.
OT score provides a reliable label-free proxy for model performance.
Deriving the OT score through a new theoretical analysis using the Semi-Discrete Optimal Transport alignment.
Limitations:
There is no specific mention of Limitations in the paper. (However, it is difficult to identify the specific Limitations based solely on the content stated in the paper summary.)
👍