Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Fairness Definitions in Language Models Explained

Created by
  • Haebom

Author

Avash Palikhe, Zichong Wang, Zhipeng Yin, Wenbin Zhang

Outline

This paper presents a systematic investigation of fairness in large-scale language models (LMs). We highlight that, despite their superior performance on a variety of natural language processing (NLP) tasks, LMs can inherit and amplify social biases associated with sensitive attributes such as gender and race. Therefore, this paper comprehensively reviews various existing fairness concepts and proposes a new classification scheme based on transformer architectures, including encoder-only, decoder-only, and encoder-decoder LMs. Experimental examples and results are presented for each fairness definition, and future research and open issues are discussed to advance the field.

Takeaways, Limitations

Takeaways:
Provides a systematic and comprehensive understanding of the concept of fairness in LMs.
We present a classification system of fairness concepts according to transformer architecture, providing a new perspective for studying the fairness of LMs.
By demonstrating the practical meaning and consequences of each fairness definition through experiments, we provide insight into practical applications beyond theoretical understanding.
It can contribute to improving the fairness of LMs by suggesting future research directions.
Limitations:
The proposed classification scheme may not fully cover the architecture of all LMs.
The experimental results may be limited to specific datasets or models, and further research is needed to determine generalizability.
There may be a lack of in-depth analysis of the interactions and relationships between definitions of fairness.
It may not provide clear guidance on which of the various fairness concepts should be applied in a particular situation.
👍