Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Mirror-Consistency: Harnessing Inconsistency in Majority Voting

Created by
  • Haebom

Author

Siyuan Huang, Zhiyuan Ma, Jintao Du, Changhua Meng, Weiqiang Wang, Zhouhan Lin

Outline

This paper proposes a novel method, "Mirror Consistency," to overcome the limitations of self-consistency, a widely used method for improving the inference performance of large-scale language models (LLMs). Existing self-consistency relies on majority voting, ignoring minority opinions, which represent crucial information revealing uncertainty in the model generation process. Mirror Consistency introduces a "reflective mirror" into the self-ensemble decoding process, allowing the model to critically examine inconsistencies between multiple generated results. Furthermore, mirror consistency is used to improve sample-based confidence correction methods, similar to how humans understand themselves through a mirror, mitigating the overconfidence problem. Experimental results show that mirror consistency outperforms self-consistency in both inference accuracy and confidence correction.

Takeaways, Limitations

Takeaways:
We present Mirror-Consistency, a novel approach to improving the inference ability of LLM.
It addresses the problem of ignoring minority opinions, which is Limitations of self-consistency, and better reflects the uncertainty of the model.
We improve the performance of sample-based confidence correction methods to mitigate the overconfidence problem.
We experimentally demonstrate that it outperforms self-consistency in terms of inference accuracy and reliability correction.
Limitations:
The computational cost of the proposed method may be higher than self-consistency.
Further research is needed on generalization performance across different LLMs and tasks.
A detailed description of the specific mechanism of the "reflective mirror" may be lacking (further research is needed).
👍