Sign In

CAREBench: Evaluating LLMs' Emotion Understanding by Assessing Cognitive Appraisal Reasoning

์ž‘์„ฑ์ž
  • Haebom
์นดํ…Œ๊ณ ๋ฆฌ
Empty

์ €์ž

Zhaoyue Sun, Hainiu Xu, Andero Uusberg, James J. Gross, Petr Slovak, Yulan He

๐Ÿ’ก ๊ฐœ์š”

๋ณธ ๋…ผ๋ฌธ์€ ์ธ๊ฐ„๊ณผ์˜ ํšจ๊ณผ์ ์ธ ์ƒํ˜ธ์ž‘์šฉ์— ํ•„์ˆ˜์ ์ธ LLM์˜ ๊ฐ์ • ์ดํ•ด ๋Šฅ๋ ฅ์„ ํ‰๊ฐ€ํ•˜๊ธฐ ์œ„ํ•œ ์ƒˆ๋กœ์šด ๋ฒค์น˜๋งˆํฌ์ธ CAREBench๋ฅผ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. ๊ธฐ์กด ํ‰๊ฐ€ ๋ฐฉ์‹์˜ ํ•œ๊ณ„๋ฅผ ๊ทน๋ณตํ•˜๊ธฐ ์œ„ํ•ด ์ธ์ง€์  ํ‰๊ฐ€ ์ด๋ก ์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์ธ์ง€์  ํ‰๊ฐ€ ์ถ”๋ก , ํ‰๊ฐ€ ๋“ฑ๊ธ‰, ๋‹ค์ค‘ ๋ ˆ์ด๋ธ” ๊ฐ์ • ์ฃผ์„์„ ํฌํ•จํ•˜๋Š” ํฌ๊ด„์ ์ธ ์ถ”๋ก  ์ฒด์ธ ์ฃผ์„์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด LLM์˜ ๊ฐ์ • ์ดํ•ด๋ฅผ ๋ณด๋‹ค ์ง„๋‹จ์ ์œผ๋กœ ํ‰๊ฐ€ํ•˜๊ณ , ํ˜„์žฌ ๋ชจ๋ธ๋“ค์˜ ๊ฐ์ • ์ดํ•ด ๋Šฅ๋ ฅ์˜ ํ•œ๊ณ„๋ฅผ ๋ช…ํ™•ํžˆ ํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
CAREBench๋Š” LLM์˜ ๊ฐ์ • ์ดํ•ด ๋Šฅ๋ ฅ์„ ๊ธฐ์กด์˜ ๋‹จ์ผ ๋ ˆ์ด๋ธ” ์˜ˆ์ธก ๋ฐฉ์‹์„ ๋„˜์–ด์„  ์ธ์ง€์  ๊ณผ์ •๊นŒ์ง€ ํ‰๊ฐ€ํ•  ์ˆ˜ ์žˆ๋Š” ์ตœ์ดˆ์˜ ๋ฒค์น˜๋งˆํฌ์ž…๋‹ˆ๋‹ค.
โ€ข
์—ฐ๊ตฌ ๊ฒฐ๊ณผ, ์ผ๋ถ€ LLM์€ ํŠน์ • ์ž‘์—…์—์„œ ์ธ๊ฐ„ ์ˆ˜์ค€์— ๊ทผ์ ‘ํ•˜๊ฑฐ๋‚˜ ๋Šฅ๊ฐ€ํ•˜์ง€๋งŒ, ์ธ์ง€์  ํ‰๊ฐ€ ์ถ”๋ก  ๋ฐ ๊ธ์ • ๊ฐ์ • ์ธ์‹์—์„œ๋Š” ์—ฌ์ „ํžˆ ๋ถ€์กฑํ•จ์„ ๋ณด์ž…๋‹ˆ๋‹ค.
โ€ข
ํ˜„์žฌ LLM์€ ์ธ๊ฐ„์˜ ์ฃผ๊ด€์  ๋‹ค์–‘์„ฑ์„ ํฌ์ฐฉํ•˜๋Š” ๋ฐ ํ•„์š”ํ•œ ๋ฉ”์ปค๋‹ˆ์ฆ˜์„ ๋‚ด์žฌํ™”ํ•˜์ง€ ๋ชปํ–ˆ์œผ๋ฉฐ, ์ด๋Š” ๋‹ค์šด์ŠคํŠธ๋ฆผ ๊ฐ์ • ์˜ˆ์ธก ๋ฉ”ํŠธ๋ฆญ์ด LLM์˜ ์ง„์ •ํ•œ ๊ฐ์ • ์ดํ•ด๋„๋ฅผ ๊ณผ๋Œ€ํ‰๊ฐ€ํ•  ์ˆ˜ ์žˆ์Œ์„ ์‹œ์‚ฌํ•ฉ๋‹ˆ๋‹ค.
โ€ข
ํ–ฅํ›„ ์—ฐ๊ตฌ๋Š” LLM์ด ์ธ๊ฐ„์˜ ์ฃผ๊ด€์  ๊ฒฝํ—˜๊ณผ ๋ณต์žกํ•œ ๊ฐ์ •์  ์ธ์ง€ ๊ณผ์ •์„ ๋” ์ž˜ ์ดํ•ดํ•˜๊ณ  ๋ชจ๋ฐฉํ•˜๋„๋ก ๊ฐœ์„ ํ•˜๋Š” ๋ฐ ์ดˆ์ ์„ ๋งž์ถฐ์•ผ ํ•ฉ๋‹ˆ๋‹ค.
๐Ÿ‘
Made with Slashpage