Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Post Hoc Regression Refinement via Pairwise Rankings

Created by
  • Haebom

Author

Kevin Tirta Wijaya, Michael Sun, Minghao Guo, Hans-Peter Seidel, Wojciech Matusik, Vahid Babaei

Outline

RankRefine is a model developed to improve the accuracy of continuous attribute prediction. It is a postprocessing technique that leverages ranking information to improve the performance of existing regression models even in data-poor environments. Using a small reference set of query items and known attributes, it combines the output of the base regression model with rank-based estimates using an inversely distributed weighting scheme. In a molecular attribute prediction task, RankRefine has been shown to reduce the mean absolute error by up to 10% with just 20 pairwise comparisons obtained from a general-purpose large-scale language model (LLM), without any fine-tuning.

Takeaways, Limitations

Takeaways:
Presenting a practical methodology to improve the accuracy of regression models in data-poor environments.
Performance can be improved with just the rankings provided by experts or general LLMs.
Applicable to various domains and does not require model retraining.
Limitations:
Ranking information is required to improve performance, and performance may vary depending on the quality of the ranking.
The experimental results are limited to molecular property prediction, and further research is needed to determine their generalizability to other fields.
👍