Sign In

The Alpha Illusion: Reported Alpha from LLM Trading Agents Should Not Be Treated as Deployment Evidence

์ž‘์„ฑ์ž
  • Haebom
์นดํ…Œ๊ณ ๋ฆฌ
Empty

์ €์ž

Yuxuan Ye, Jun Han, Ao Hu, Juncheng Bu, Yiyi Chen, Liangjian Wen, Danilo Mandic, Danny Dongning Sun, Xu Yinghui, Zenglin Xu

๐Ÿ’ก ๊ฐœ์š”

๋ณธ ๋…ผ๋ฌธ์€ ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM) ๊ธฐ๋ฐ˜์˜ ๊ธˆ์œต ๊ฑฐ๋ž˜ ์—์ด์ „ํŠธ๋“ค์ด ๋ณด๊ณ ํ•˜๋Š” ๋†’์€ ์•ŒํŒŒ(์ดˆ๊ณผ ์ˆ˜์ต)๊ฐ€ ์‹ค์ œ ๋ฐฐํฌ ๊ฐ€๋Šฅํ•œ ๊ฑฐ๋ž˜ ๋Šฅ๋ ฅ์„ ์ž…์ฆํ•˜๋Š” ์ฆ๊ฑฐ๋กœ ๊ฐ„์ฃผ๋˜์–ด์„œ๋Š” ์•ˆ ๋œ๋‹ค๊ณ  ์ฃผ์žฅํ•ฉ๋‹ˆ๋‹ค. ์—ฐ๊ตฌ์—์„œ๋Š” ๊ธฐ์กด LLM ๊ฑฐ๋ž˜ ์—์ด์ „ํŠธ๋“ค์˜ ์„ฑ๋Šฅ ๋ณด๊ณ ์„œ๊ฐ€ ์‹œ๊ฐ„์  ๋ฌด๊ฒฐ์„ฑ, ์‹ค์ œ ๋งˆ์ฐฐ, ๋ฐ˜์‚ฌ์‹ค์  ๊ฐ•๊ฑด์„ฑ ๋“ฑ์˜ ๊ตฌ์กฐ์  ์œ ํšจ์„ฑ ๊ฒ€์ฆ์„ ํ†ต๊ณผํ•˜์ง€ ๋ชปํ•จ์„ ์ง€์ ํ•˜๋ฉฐ, ์ด๋Ÿฌํ•œ ๋ณด๊ณ ๊ฐ€ ๊ณผ๋Œ€ํ‰๊ฐ€๋  ์ˆ˜ ์žˆ์Œ์„ ๊ฒฝ๊ณ ํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
LLM ๊ธฐ๋ฐ˜ ๊ฑฐ๋ž˜ ์—์ด์ „ํŠธ์˜ ๋ณด๊ณ ๋œ ์ˆ˜์ต๋ฅ ์€ ์‹ค์ œ ์‹œ์žฅ์—์„œ์˜ ์ ์šฉ ๊ฐ€๋Šฅ์„ฑ์„ ์ž…์ฆํ•˜๊ธฐ ์ „์— ์—„๊ฒฉํ•œ ๊ฒ€์ฆ ์ ˆ์ฐจ๋ฅผ ๊ฑฐ์ณ์•ผ ํ•ฉ๋‹ˆ๋‹ค.
โ€ข
์–ธ์–ด์  ์œ ์ฐฝ์„ฑ๊ณผ ์˜ˆ์ธก ๋Šฅ๋ ฅ, ์„œ์‚ฌ์  ์ถ”๋ก ๊ณผ ์ˆ˜์น˜์  ์‹คํ–‰ ๋Šฅ๋ ฅ์€ ๊ตฌ๋ถ„๋˜์–ด์•ผ ํ•˜๋ฉฐ, ๋ชจ๋ธ์˜ ์‚ฌ์ „ ์ •๋ณด(priors)๋Š” ์ˆจ๊ฒจ์ง„ ์š”์ธ ๋…ธ์ถœ๋กœ ์ž‘์šฉํ•  ์ˆ˜ ์žˆ์Œ์„ ์ธ์ง€ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.
โ€ข
๋…ผ๋ฌธ์€ LLM์„ ๋…๋ฆฝ์ ์ธ ๋ชจ๋“ˆ๊ณผ ํ†ตํ•ฉํ•˜์—ฌ ํˆฌ๋ช…ํ•˜๊ณ  ๊ฒ€์ฆ ๊ฐ€๋Šฅํ•œ ๊ฑฐ๋ž˜ ์‹œ์Šคํ…œ์„ ๊ตฌ์ถ•ํ•˜๊ธฐ ์œ„ํ•œ ์ตœ์†Œ ๋ณด๊ณ  ํ”„๋กœํ† ์ฝœ๊ณผ ๋Œ€์•ˆ์  ๋ชจ๋“ˆ์‹ ์ ‘๊ทผ ๋ฐฉ์‹์„ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค.
โ€ข
์•„์ง ๊ณต๊ฐœ๋œ ์ฆ๊ฑฐ๋งŒ์œผ๋กœ๋Š” LLM ๊ฑฐ๋ž˜ ์—์ด์ „ํŠธ์˜ ์ง„์ •ํ•œ ์˜ˆ์ธก ๋Šฅ๋ ฅ์„ temporal contamination, unmodeled frictions, short-window Sharpe uncertainty, narrative fitting, and parametric priors ๋“ฑ์œผ๋กœ๋ถ€ํ„ฐ ๋ช…ํ™•ํžˆ ๊ตฌ๋ถ„ํ•˜๊ธฐ ์–ด๋ ต์Šต๋‹ˆ๋‹ค.
๐Ÿ‘