Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

LLM-D12: A Dual-Dimensional Scale of Instrumental and Relational Dependencies on Large Language Models

Created by
  • Haebom

Author

Ala Yankouskaya, Areej B. Babiker, Syeda WF Rizvi, Sameha Alshakhsi, Magnus Liebherr, Raian Ali

Outline

This study developed and validated a new questionnaire, the LLM-D12, to measure human dependence and addiction potential for large-scale language models (LLMs). To overcome the conceptual limitations of existing scales that apply behavioral addiction symptoms to LLM use situations, the authors developed a 12-item questionnaire based on their previous theoretical research. Data collected from 526 UK participants were used for exploratory and confirmatory factor analyses, which identified a two-factor structure: instrumental dependence (6 items) and relational dependence (6 items). Instrumental dependence measures the degree to which individuals rely on LLMs for decision-making and cognitive tasks, while relational dependence indicates the tendency to perceive LLMs as socially meaningful, perceptive, and companion-like. The LLM-D12 scale demonstrated excellent internal consistency and clear discriminant validity, and external validation confirmed the distinction between the two subscales. We interpreted the psychometric properties and structure of the LLM-D12 scale considering that although LLM dependence does not necessarily indicate dysfunction, it may reflect a level of dependence that may be problematic in certain situations.

Takeaways, Limitations

Takeaways:
We contributed to the research on dependence related to LLM use by developing and validating a new scale, the LLM-D12, to measure dependence on LLM.
We divided LLM dependence into two factors: instrumental dependence and relational dependence, to better reflect the complexity of interactions with LLM.
It suggests that LLM dependency may not imply dysfunction, and provides a more nuanced understanding of the problem at the level of dependency.
Limitations:
Because most of the study participants were British, generalizability to people from other cultural backgrounds is limited.
The sample size is relatively small, so further research on generalizability may be needed.
Further research is needed to determine the long-term stability and predictive validity of the LLM-D12 scale.
👍