Sign In

Towards Knowledgeable Deep Research: Framework and Benchmark

Created by
  • Haebom
Category
Empty

์ €์ž

Wenxuan Liu, Zixuan Li, Long Bai, Chunmao Zhang, Fenghui Zhang, Zhuo Chen, Wei Li, Yuxin Zuo, Fei Wang, Bingbing Xu, Xuhui Jiang, Jin Zhang, Xiaolong Jin, Jiafeng Guo, Tat-Seng Chua, Xueqi Cheng

๐Ÿ’ก ๊ฐœ์š”

๋ณธ ๋…ผ๋ฌธ์€ ๊ธฐ์กด์˜ ๋น„๊ตฌ์กฐ์  ์ •๋ณด๋ฟ๋งŒ ์•„๋‹ˆ๋ผ ๊ตฌ์กฐํ™”๋œ ์ง€์‹๊นŒ์ง€ ํ™œ์šฉํ•˜์—ฌ ์‹ฌ์ธต์ ์ธ ๋ณด๊ณ ์„œ๋ฅผ ์ƒ์„ฑํ•˜๋Š” ์ƒˆ๋กœ์šด ๊ณผ์ œ์ธ '์ง€์‹ ๊ธฐ๋ฐ˜ ์‹ฌ์ธต ์—ฐ๊ตฌ(KDR)'๋ฅผ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. ์ด๋ฅผ ์œ„ํ•ด ํ…์ŠคํŠธ, ์ด๋ฏธ์ง€, ํ‘œ๋ฅผ ์•„์šฐ๋ฅด๋Š” ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ ๋ณด๊ณ ์„œ ์ƒ์„ฑ์„ ์ง€์›ํ•˜๋Š” 'ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ์ง€์‹ ๋ถ„์„(HKA)' ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ๊ฐœ๋ฐœํ–ˆ์Šต๋‹ˆ๋‹ค. HKA๋Š” ํŠนํžˆ ์ฝ”๋”ฉ ๋ฐ ๋น„์ „-์–ธ์–ด ๋ชจ๋ธ์„ ํ™œ์šฉํ•˜์—ฌ ๊ตฌ์กฐํ™”๋œ ์ง€์‹์—์„œ ์ธ์‚ฌ์ดํŠธ๋ฅผ ์ถ”์ถœํ•˜๋Š” '๊ตฌ์กฐํ™”๋œ ์ง€์‹ ๋ถ„์„๊ธฐ'๋ฅผ ํ•ต์‹ฌ์œผ๋กœ ํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
๊ตฌ์กฐํ™”๋œ ์ง€์‹์˜ ํ™œ์šฉ์„ ํ†ตํ•ด LLM ๊ธฐ๋ฐ˜ ์‹ฌ์ธต ์—ฐ๊ตฌ์˜ ์ •ํ™•์„ฑ๊ณผ ๊นŠ์ด๋ฅผ ํฌ๊ฒŒ ํ–ฅ์ƒ์‹œํ‚ฌ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
โ€ข
๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ ์ •๋ณด๋ฅผ ํ†ตํ•ฉํ•˜์—ฌ ๋”์šฑ ํฌ๊ด„์ ์ด๊ณ  ์ดํ•ดํ•˜๊ธฐ ์‰ฌ์šด ๋ณด๊ณ ์„œ ์ƒ์„ฑ์ด ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค.
โ€ข
KDR-Bench๋ผ๋Š” ์ƒˆ๋กœ์šด ๋ฒค์น˜๋งˆํฌ๋Š” ์ง€์‹ ๊ธฐ๋ฐ˜ ์‹ฌ์ธต ์—ฐ๊ตฌ ๋ถ„์•ผ์˜ ๊ฐ๊ด€์ ์ธ ํ‰๊ฐ€๋ฅผ ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•ฉ๋‹ˆ๋‹ค.
โ€ข
ํ–ฅํ›„ ์—ฐ๊ตฌ์—์„œ๋Š” ๋” ๋‹ค์–‘ํ•œ ๋„๋ฉ”์ธ๊ณผ ๋ณต์žกํ•œ ๊ตฌ์กฐํ™”๋œ ๋ฐ์ดํ„ฐ๋ฅผ ํฌ๊ด„ํ•˜๊ณ , ์‹ค์‹œ๊ฐ„ ์ •๋ณด ํƒ์ƒ‰ ๋Šฅ๋ ฅ์„ ๊ฐ•ํ™”ํ•˜๋Š” ๋ฐฉํ–ฅ์œผ๋กœ ๋ฐœ์ „ํ•  ํ•„์š”๊ฐ€ ์žˆ์Šต๋‹ˆ๋‹ค.
๐Ÿ‘
Made with Slashpage