Sign In

EpiGraph: A Knowledge Graph and Benchmark for Evidence-Intensive Reasoning in Epilepsy

์ž‘์„ฑ์ž
  • Haebom
์นดํ…Œ๊ณ ๋ฆฌ
Empty

์ €์ž

Yuyang Dai, Zheng Chen, Jathurshan Pradeepkumar, Yasuko Matsubara, Jimeng Sun, Yasushi Sakurai, Yushun Dong

๐Ÿ’ก ๊ฐœ์š”

๋ณธ ์—ฐ๊ตฌ๋Š” ๋‡Œ์ „์ฆ ์ง„๋‹จ ๋ฐ ์น˜๋ฃŒ์— ํ•„์š”ํ•œ ๋ณต์žกํ•˜๊ณ  ์ด์งˆ์ ์ธ ์ž„์ƒ ์ง€์‹(์ƒ์ฒด ์‹ ํ˜ธ, ์œ ์ „ํ•™, ์•ฝ๋ฌผ์œ ์ „์ฒดํ•™ ๋“ฑ)์„ ํ†ตํ•ฉํ•˜๋Š” ๋Œ€๊ทœ๋ชจ ๋‡Œ์ „์ฆ ์ง€์‹ ๊ทธ๋ž˜ํ”„์ธ EpiGraph๋ฅผ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. ์ด๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ์ž„์ƒ ์˜์‚ฌ ๊ฒฐ์ •, EEG ๋ณด๊ณ ์„œ ์ƒ์„ฑ ๋“ฑ 5๊ฐ€์ง€ ์ž„์ƒ์ ์œผ๋กœ ๋™๊ธฐํ™”๋œ ์ž‘์—…์„ ํฌํ•จํ•˜๋Š” ๋‡Œ์ „์ฆ ์ง€์‹ ๊ฐ•ํ™” ์ถ”๋ก  ๋ฒค์น˜๋งˆํฌ์ธ EpiBench๋ฅผ ๊ตฌ์ถ•ํ–ˆ์Šต๋‹ˆ๋‹ค. EpiGraph๋ฅผ ํ™œ์šฉํ•œ Graph-RAG ์„ค์ •์€ ๊ธฐ์กด LLM์˜ ์„ฑ๋Šฅ์„ ์ „๋ฐ˜์ ์œผ๋กœ ํ–ฅ์ƒ์‹œ์ผฐ์œผ๋ฉฐ, ํŠนํžˆ ์•ฝ๋ฌผ์œ ์ „์ฒดํ•™ ์ถ”๋ก ์—์„œ ๋†’์€ ๊ฐœ์„  ํšจ๊ณผ๋ฅผ ๋ณด์˜€์Šต๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
๋‡Œ์ „์ฆ ๋ถ„์•ผ์˜ ๋ณต์žกํ•œ ์ž„์ƒ ์ง€์‹์„ ๊ตฌ์กฐํ™”ํ•œ ์ง€์‹ ๊ทธ๋ž˜ํ”„๋Š” LLM ๊ธฐ๋ฐ˜์˜ ์ฆ๊ฑฐ ๊ธฐ๋ฐ˜ ์ž„์ƒ ์ถ”๋ก  ์„ฑ๋Šฅ์„ ํฌ๊ฒŒ ํ–ฅ์ƒ์‹œํ‚ฌ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
โ€ข
EpiGraph์™€ EpiBench๋Š” ๋‡Œ์ „์ฆ ๋ถ„์•ผ์—์„œ ์ง€์‹ ๊ฐ•ํ™” LLM์˜ ์„ฑ๋Šฅ์„ ํ‰๊ฐ€ํ•˜๊ณ  ๋ฐœ์ „์‹œํ‚ค๊ธฐ ์œ„ํ•œ ์‹ค์šฉ์ ์ธ ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.
โ€ข
ํ˜„์žฌ ๋ฒค์น˜๋งˆํฌ๋Š” 5๊ฐ€์ง€ ํŠน์ • ์ž„์ƒ ์ž‘์—…์— ์ดˆ์ ์„ ๋งž์ถ”๊ณ  ์žˆ์œผ๋ฉฐ, ๋‡Œ์ „์ฆ ์ง„๋ฃŒ์˜ ๋ชจ๋“  ์ธก๋ฉด์„ ํฌ๊ด„ํ•˜์ง€ ๋ชปํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ํ–ฅํ›„ ๋” ๊ด‘๋ฒ”์œ„ํ•œ ์ž„์ƒ ์‹œ๋‚˜๋ฆฌ์˜ค์™€ ์ง€์‹ ์œ ํ˜•์„ ํ†ตํ•ฉํ•˜๋Š” ์—ฐ๊ตฌ๊ฐ€ ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค.
๐Ÿ‘