[공지사항]을 빙자한 안부와 근황 
Show more

Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Bottom-up Domain-specific Superintelligence: A Reliable Knowledge Graph is What We Need

Created by
  • Haebom

Author

Bhishma Dedhia, Yuval Kansal, Niraj K. Jha

Outline

Existing language models for cross-domain generalization have shown reasoning ability for specific tasks, but bottom-up learning using general corpora has limitations in acquiring the abstraction ability required for deep domain expertise. In this paper, we present a top-down approach that constructs domain basic concepts into more complex concepts. A knowledge graph (KG) represents domain basic concepts as head-relation-tail edges, and paths provide a compositional structure that encodes high-level concepts. This study presents a pipeline that generates tasks directly from KG basic concepts so that the model can acquire them and construct them for inference. Focusing on the medical field, we curate 24,000 reasoning tasks and thought processes derived from various medical basic concepts using medical KG, and fine-tune the QwQ-32B model with this curriculum to obtain the QwQ-Med-3 model, which shows progress toward medical superintelligence. We also introduce the ICD-Bench, an assessment set that quantifies reasoning ability in 15 medical domains. Experimental results show that QwQ-Med-3 outperforms state-of-the-art inference models on the ICD-Bench category, and in particular, widens the performance gap by leveraging the ground truth learned from difficult tasks. In the medical question-answering benchmark evaluation, QwQ-Med-3 also demonstrates the transferability of the learned expertise to improve the performance of the underlying model. While industry approaches to artificial general intelligence (AGI) emphasize broad expertise, this work suggests a future where AGI emerges from the configurable interactions of efficient domain-specific superintelligent agents.

Takeaways, Limitations

Takeaways:
We present a novel method for developing domain-specific superintelligence models via top-down learning based on knowledge graphs.
In the medical field, the QwQ-Med-3 model outperforms the previous best-performing models.
Verify the ability to transfer acquired domain knowledge to other tasks.
We present an AGI approach with configurable interactions of domain-specific superintelligent agents.
Introducing a new medical reasoning ability assessment benchmark called ICD-Bench.
Limitations:
Currently, the research is limited to the medical field, and further research is needed on the possibility of generalization to other domains.
The quality and completeness of the knowledge graph used can affect model performance.
Need to scale to larger datasets that include more diverse and complex medical cases.
There is a need to improve the interpretability of the model's inference process.
👍