Sign In

Decision-aware User Simulation Agent for Evaluating Conversational Recommender Systems

์ž‘์„ฑ์ž
  • Haebom
์นดํ…Œ๊ณ ๋ฆฌ
Empty

์ €์ž

Yuan-Chi Li, Li-Chi Chen, Sung-Yi Wu, Yu-Che Tsai, Shou-De Lin

๐Ÿ’ก ๊ฐœ์š”

๊ธฐ์กด ๋Œ€ํ™”ํ˜• ์ถ”์ฒœ ์‹œ์Šคํ…œ(CRS) ํ‰๊ฐ€์— ์‚ฌ์šฉ๋˜๋Š” ์‚ฌ์šฉ์ž ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋Š” ์ธ๊ฐ„์˜ ์˜์‚ฌ๊ฒฐ์ • ๊ณผ์ •์„ ์ œ๋Œ€๋กœ ๋ชจ๋ธ๋งํ•˜์ง€ ๋ชปํ•˜๋Š” ํ•œ๊ณ„๊ฐ€ ์žˆ์Šต๋‹ˆ๋‹ค. ํŠนํžˆ LLM ๊ธฐ๋ฐ˜ ์‹œ๋ฎฌ๋ ˆ์ดํ„ฐ๋Š” ๊ณผ๋„ํ•œ ์ •๋ณด ์ฒ˜๋ฆฌ ๋Šฅ๋ ฅ์œผ๋กœ ์ธํ•ด ํ˜„์‹ค ์†Œ๋น„์ž์˜ ๋ง์„ค์ž„์ด๋‚˜ ์˜์‚ฌ๊ฒฐ์ • ์ง€์—ฐ ํ–‰๋™์„ ๊ฐ„๊ณผํ•˜์—ฌ ์‹ค์ œ๋ณด๋‹ค ๋†’์€ ์ˆ˜๋ฝ ํ™•๋ฅ ์„ ๋ณด์ด๋Š” ๋ฌธ์ œ๊ฐ€ ์žˆ์Šต๋‹ˆ๋‹ค. ๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” ์„ ํƒ ๊ณผ๋ถ€ํ•˜ ์ƒํ™ฉ์—์„œ์˜ ์ธ๊ฐ„ ์˜์‚ฌ๊ฒฐ์ •์„ ๋ช…์‹œ์ ์œผ๋กœ ๋ชจ๋ธ๋งํ•˜๋Š” 'Hesitator'๋ผ๋Š” ์ด๋ก  ๊ธฐ๋ฐ˜ ์‚ฌ์šฉ์ž ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
'Hesitator' ํ”„๋ ˆ์ž„์›Œํฌ๋Š” ํšจ์šฉ ๊ธฐ๋ฐ˜ ํ•ญ๋ชฉ ์„ ํƒ๊ณผ ๊ณผ๋ถ€ํ•˜ ์ธ์ง€์  ๊ฒฐ์ • ๊ณผ์ •์„ ๋ถ„๋ฆฌํ•˜๋Š” ๋ชจ๋“ˆํ˜• ์˜์‚ฌ๊ฒฐ์ • ๋ชจ๋“ˆ์„ ๋„์ž…ํ•˜์—ฌ ํ˜„์‹ค์ ์ธ ์‚ฌ์šฉ์ž ํ–‰๋™ ๋ชจ๋ธ๋ง์„ ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•ฉ๋‹ˆ๋‹ค.
โ€ข
๋‹ค์–‘ํ•œ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ํ™˜๊ฒฝ, ๋„๋ฉ”์ธ, ํŒ๋งค ๋ชจ๋“œ ๋ฐ LLM ๋ฐฑ๋ณธ์— ๊ฑธ์ณ 'Hesitator' ๋ชจ๋“ˆ ํ†ตํ•ฉ ์‹œ ๊ณผ๋ถ€ํ•˜ ์กฐ๊ฑด ํ•˜์—์„œ์˜ ๋น„ํ˜„์‹ค์ ์ธ ํ–‰๋™์„ ์ผ๊ด€๋˜๊ฒŒ ์™„ํ™”ํ•˜๋Š” ํšจ๊ณผ๋ฅผ ์ž…์ฆํ–ˆ์Šต๋‹ˆ๋‹ค.
โ€ข
๋˜ํ•œ, 'Hesitator'๋Š” ์‹ฌ๋ฆฌ๊ฒฝ์ œํ•™์˜ ํ™•๋ฆฝ๋œ ํ–‰๋™ ํŒจํ„ด์„ ์žฌํ˜„ํ•จ์œผ๋กœ์จ ์ธ๊ฐ„์˜ ์˜์‚ฌ๊ฒฐ์ • ํ–‰๋™์„ ํšจ๊ณผ์ ์œผ๋กœ ๋ชจ๋ธ๋งํ•  ์ˆ˜ ์žˆ์Œ์„ ๋ณด์—ฌ์ค๋‹ˆ๋‹ค.
โ€ข
ํ–ฅํ›„ ์—ฐ๊ตฌ์—์„œ๋Š” ๋”์šฑ ๋ณต์žกํ•œ ์˜์‚ฌ๊ฒฐ์ • ์‹œ๋‚˜๋ฆฌ์˜ค ๋ฐ ๋‹ค์–‘ํ•œ ๊ฐœ์ธ๋ณ„ ์˜์‚ฌ๊ฒฐ์ • ์Šคํƒ€์ผ์„ ๋ชจ๋ธ๋งํ•˜๋Š” ๋ฐฉํ–ฅ์œผ๋กœ ๋ฐœ์ „ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
๐Ÿ‘
Made with Slashpage