[공지사항]을 빙자한 안부와 근황 
Show more

Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

A quantum semantic framework for natural language processing

Created by
  • Haebom

Author

Christopher J. Agostino, Quan Le Thien, Molly Apsel, Denizhan Pak, Elina Lesyk, Ashabari Majumdar

Outline

This paper argues that semantic degeneracy in natural language imposes fundamental limitations on modern natural language processing systems, including large-scale language models (LLMs). As the complexity of semantic representations increases, the possibility of interpretation increases exponentially, as demonstrated using Kolmogorov complexity. It argues that the classical view that linguistic forms themselves have intrinsic meaning is insufficient due to the computational difficulty of recovering the single intended meaning of complex or ambiguous texts. Instead, it argues that meaning is realized dynamically through observer-dependent interpretation behavior, the nondeterministic nature of which is best described by nonclassical quantum-like logic. Through semantic Bell inequality tests using various LLM agents, we obtain several executions that produce values (e.g., 2.3-2.4) that significantly violate the classical bound ($|S|\leq2$), demonstrating that linguistic interpretation under ambiguity can exhibit nonclassical contextuality. We therefore argue that classical frequentist-based analysis approaches to natural language are necessarily lossy, and instead suggest that a Bayesian-style repeated sampling approach may provide more practical and appropriate properties.

Takeaways, Limitations

Takeaways:
We show that the semantic degeneration of natural language presents a fundamental limitation of LLM.
Suggests that linguistic meaning is observer-dependent and dynamically realized.
Experimental demonstration of non-classical contextuality of linguistic interpretation.
Suggesting the need for a Bayesian approach to natural language analysis.
Limitations:
Further research is needed on the generalizability of the Bell inequality test.
Further research is needed on the specific methodology and effectiveness of the proposed Bayesian approach.
Need to verify generalizability to various types of LLM and natural languages.
There is a need to strengthen the theoretical foundation for the application of quantum logic.
👍