Sign In

Beyond Fluency: Toward Reliable Trajectories in Agentic IR

Created by
  • Haebom
Category
Empty

์ €์ž

Anushree Sinha, Srivaths Ranganathan, Debanshu Das, Abhishek Dharmaratnakar

๐Ÿ’ก ๊ฐœ์š”

๋ณธ ๋…ผ๋ฌธ์€ ๋‹ค๋‹จ๊ณ„ ์ถ”๋ก -ํ–‰๋™-๊ด€์ฐฐ ๋ฃจํ”„๋ฅผ ํ†ตํ•ด ์ •๋ณด๋ฅผ ๊ฒ€์ƒ‰ํ•˜๋Š” ์ž์œจ ์—์ด์ „ํŠธ ์‹œ์Šคํ…œ์—์„œ ๋ฐœ์ƒํ•˜๋Š” ์˜ค๋ฅ˜ ๋ฌธ์ œ๋ฅผ ์ œ๊ธฐํ•ฉ๋‹ˆ๋‹ค. ์ดˆ๊ธฐ ๋‹จ๊ณ„์˜ ์‚ฌ์†Œํ•œ ์˜ค๋ฅ˜๊ฐ€ ๋ˆ„์ ๋˜์–ด ์–ธ์–ด์  ์œ ์ฐฝ์„ฑ์—๋„ ๋ถˆ๊ตฌํ•˜๊ณ  ๋‚ด๋ถ€ ์ถ”๋ก ๊ณผ ์™ธ๋ถ€ ๋„๊ตฌ ์‹คํ–‰ ๊ฐ„์˜ ๊ธฐ๋Šฅ์  ๋ถˆ์ผ์น˜๋ฅผ ์ดˆ๋ž˜ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋Ÿฌํ•œ ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๊ธฐ ์œ„ํ•ด ๋ณธ ๋…ผ๋ฌธ์€ ๊ฐ ์ƒํ˜ธ์ž‘์šฉ ์ง€์ ์—์„œ ๊ฒ€์ฆ ๊ฒŒ์ดํŠธ๋ฅผ ์„ค์ •ํ•˜๊ณ , ๋ณด์ •๋œ ๋ถˆํ™•์‹ค์„ฑ ํ•˜์—์„œ์˜ ์ฒด๊ณ„์ ์ธ ๊ธฐ๊ถŒ(abstention)์„ ์ œ์•ˆํ•˜๋ฉฐ, ์—”๋“œํฌ์ธํŠธ ์ •ํ™•๋„๋ณด๋‹ค ๊ถค์  ๋ฌด๊ฒฐ์„ฑ๊ณผ ์ธ๊ณผ์  ๊ท€์ธ์„ ๊ฐ•์กฐํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
์—์ด์ „ํŠธ ์‹œ์Šคํ…œ์˜ ์•ˆ์ „ํ•œ ๋ฐฐํฌ๋ฅผ ์œ„ํ•ด์„œ๋Š” ๋‹จ์ˆœํžˆ ์ตœ์ข… ๊ฒฐ๊ณผ์˜ ์ •ํ™•์„ฑ๋ฟ๋งŒ ์•„๋‹ˆ๋ผ, ๊ณผ์ •์˜ ๋ฌด๊ฒฐ์„ฑ๊ณผ ์˜ค๋ฅ˜์˜ ์ธ๊ณผ์  ์ถ”์ ์ด ์ค‘์š”ํ•ฉ๋‹ˆ๋‹ค.
โ€ข
์˜คํ•ด์˜ ์†Œ์ง€๊ฐ€ ์žˆ๋Š” ์œ ์ฐฝํ•จ(deceptive fluency)์œผ๋กœ ์ธํ•ด ๊ฐ์ง€๋˜์ง€ ์•Š๋Š” ์˜ค๋ฅ˜๊ฐ€ ๋ˆ„์ ๋˜๋Š” ๊ฒƒ์„ ๋ฐฉ์ง€ํ•˜๊ธฐ ์œ„ํ•œ ๋ฉ”์ปค๋‹ˆ์ฆ˜์ด ํ•„์ˆ˜์ ์ž…๋‹ˆ๋‹ค.
โ€ข
๋ณธ ๋…ผ๋ฌธ์€ ์ œ์•ˆ๋œ ๊ฒ€์ฆ ๊ฒŒ์ดํŠธ ๋ฐ ์ฒด๊ณ„์  ๊ธฐ๊ถŒ ์ „๋žต์˜ ์‹ค์ œ ์‹œ์Šคํ…œ ์ ์šฉ ๊ฐ€๋Šฅ์„ฑ๊ณผ ํšจ์œจ์„ฑ์— ๋Œ€ํ•œ ์ถ”๊ฐ€์ ์ธ ์‹คํ—˜์  ๊ฒ€์ฆ์ด ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค.
๐Ÿ‘