Sign In

HyMem: Hybrid Memory Architecture with Dynamic Retrieval Scheduling

Created by
  • Haebom
Category
Empty

์ €์ž

Xiaochen Zhao, Kaikai Wang, Xiaowen Zhang, Chen Yao, Aili Wang

๐Ÿ’ก ๊ฐœ์š”

๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM) ์—์ด์ „ํŠธ๋Š” ๊ธด ๋Œ€ํ™”์—์„œ ๋น„ํšจ์œจ์ ์ธ ๋ฉ”๋ชจ๋ฆฌ ๊ด€๋ฆฌ๋กœ ์ธํ•ด ์„ฑ๋Šฅ์ด ์ €ํ•˜๋˜๋Š” ๋ฌธ์ œ๊ฐ€ ์žˆ์Šต๋‹ˆ๋‹ค. ๋ณธ ๋…ผ๋ฌธ์€ ์ธ์ง€ ๊ฒฝ์ œ ์›์น™์— ์˜๊ฐ์„ ๋ฐ›์•„, ์š”์•ฝ ์ˆ˜์ค€์˜ ์ปจํ…์ŠคํŠธ์™€ ๋ณต์žกํ•œ ์ฟผ๋ฆฌ์—๋งŒ ์„ ํƒ์ ์œผ๋กœ ์ž‘๋™ํ•˜๋Š” ๋”ฅ ๋ชจ๋“ˆ์„ ์‚ฌ์šฉํ•˜๋Š” ๊ณ„์ธต์  ๋ฉ”๋ชจ๋ฆฌ ๊ตฌ์กฐ์ธ HyMem์„ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. HyMem์€ ๋ฉ”๋ชจ๋ฆฌ ์••์ถ•๊ณผ ์›์‹œ ํ…์ŠคํŠธ ์œ ์ง€ ์‚ฌ์ด์˜ ์„ฑ๋Šฅ๊ณผ ํšจ์œจ์„ฑ ์ ˆ์ถฉ์ ์„ ๊ทน๋ณตํ•˜๋ฉฐ, LOCOMO ๋ฐ LongMemEval ๋ฒค์น˜๋งˆํฌ์—์„œ ์šฐ์ˆ˜ํ•œ ์„ฑ๋Šฅ์„ ๋ณด์—ฌ์ฃผ์—ˆ์Šต๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
LLM ์—์ด์ „ํŠธ์˜ ์žฅ๊ธฐ ๋Œ€ํ™” ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ์œ„ํ•œ ํšจ๊ณผ์ ์ธ ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ๋ฉ”๋ชจ๋ฆฌ ์•„ํ‚คํ…์ฒ˜ ์ œ์‹œ.
โ€ข
์ธ๊ฐ„์˜ ์ธ์ง€์  ๋ฉ”๋ชจ๋ฆฌ ๊ด€๋ฆฌ ๋ฐฉ์‹ ๋ชจ๋ฐฉ์„ ํ†ตํ•ด ํšจ์œจ์„ฑ๊ณผ ์„ฑ๋Šฅ์˜ ๊ท ํ˜•์  ๋‹ฌ์„ฑ.
โ€ข
์‹ค์ œ ๋ณต์žกํ•œ ์‹œ๋‚˜๋ฆฌ์˜ค์—์„œ์˜ ๋™์  ์Šค์ผ€์ค„๋ง ๋ฉ”์ปค๋‹ˆ์ฆ˜์˜ ์ถ”๊ฐ€์ ์ธ ๊ฒ€์ฆ ๋ฐ ์ตœ์ ํ™” ํ•„์š”.
๐Ÿ‘