Sign In

Democratizing GraphRAG: Linear, CPU-Only Graph Retrieval for Multi-Hop QA

Created by
  • Haebom
Category
Empty

์ €์ž

Qizhi Wang

๐Ÿ’ก ๊ฐœ์š”

๊ธฐ์กด GraphRAG ์‹œ์Šคํ…œ์€ ๋ณต์žกํ•œ ๊ทธ๋ž˜ํ”„ ๊ตฌ์ถ• ๋ฐ GPU ๊ธฐ๋ฐ˜ ์ถ”๋ก ์œผ๋กœ ์ธํ•ด ๋น„์šฉ์ด ๋†’๋‹ค๋Š” ๋‹จ์ ์ด ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค. ๋ณธ ๋…ผ๋ฌธ์€ LLM ๊ธฐ๋ฐ˜ ๊ทธ๋ž˜ํ”„ ๊ตฌ์ถ•์„ ๋Œ€์ฒดํ•˜๊ณ  CPU๋งŒ์„ ์‚ฌ์šฉํ•˜์—ฌ ์„ ํ˜• ์‹œ๊ฐ„ ๋ณต์žก๋„๋กœ ๋™์ž‘ํ•˜๋Š” SPRIG (Seeded Propagation for Retrieval In Graphs)๋ผ๋Š” ์ƒˆ๋กœ์šด GraphRAG ํŒŒ์ดํ”„๋ผ์ธ์„ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. SPRIG์€ ๊ฒฝ๋Ÿ‰ NER ๊ธฐ๋ฐ˜ ๊ณต์ถœํ˜„ ๊ทธ๋ž˜ํ”„๋ฅผ ์‚ฌ์šฉํ•˜๊ณ  ๊ฐœ์ธํ™” ํŽ˜์ด์ง€ ๋žญํฌ(PPR)๋ฅผ ํ™œ์šฉํ•˜์—ฌ GPU ๋ฐ ํ† ํฐ ๋น„์šฉ ์—†์ด ๋‹ค๋‹จ๊ณ„ QA ์„ฑ๋Šฅ์„ ํ–ฅ์ƒ์‹œํ‚ต๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
CPU ์นœํ™”์ ์ธ ๊ทธ๋ž˜ํ”„ ๊ฒ€์ƒ‰์ด ๋‹ค๋‹จ๊ณ„ QA ์„ฑ๋Šฅ์„ ํ–ฅ์ƒ์‹œํ‚ฌ ์ˆ˜ ์žˆ๋Š” ์กฐ๊ฑด์„ ์ œ์‹œํ•ฉ๋‹ˆ๋‹ค.
โ€ข
๊ฐ•๋ ฅํ•œ ์–ดํœ˜ ๊ธฐ๋ฐ˜ ๊ฒ€์ƒ‰(RRF)์ด ์ถฉ๋ถ„ํ•œ ๊ฒฝ์šฐ๋ฅผ ๋ช…ํ™•ํžˆ ํ•˜์—ฌ, GPU ๋ฐ ํ† ํฐ ๋น„์šฉ ์—†์ด GraphRAG ์ ‘๊ทผ ๋ฐฉ์‹์„ ๋ณดํŽธํ™”ํ•  ์ˆ˜ ์žˆ๋Š” ํ˜„์‹ค์ ์ธ ๊ฒฝ๋กœ๋ฅผ ์ œ์‹œํ•ฉ๋‹ˆ๋‹ค.
โ€ข
์ œ์•ˆ๋œ ๋ฐฉ๋ฒ•์€ ๊ธฐ์กด LLM ๊ธฐ๋ฐ˜ ๊ทธ๋ž˜ํ”„ ๊ตฌ์ถ• ๋ฐ GPU ๊ธฐ๋ฐ˜ ์ถ”๋ก ์— ๋น„ํ•ด ์ƒ๋‹นํ•œ ๋น„์šฉ ์ ˆ๊ฐ ํšจ๊ณผ๋ฅผ ๊ฐ€์ ธ์˜ต๋‹ˆ๋‹ค.
๐Ÿ‘