Sign In

Navigating Potholes with Geometry-Aware Sharpness Minimization

์ž‘์„ฑ์ž
  • Haebom
์นดํ…Œ๊ณ ๋ฆฌ
Empty

์ €์ž

Simon Dufort-Labbe, Mehrab Hamidi, Razvan Pascanu, Ioannis Mitliagkas, Damien Scieur, Aristide Baratin

๐Ÿ’ก ๊ฐœ์š”

๋ณธ ๋…ผ๋ฌธ์€ ๊ธฐ์กด์˜ Sharpness-aware Minimization (SAM)์ด ํŒŒ๋ผ๋ฏธํ„ฐ ๋ฐฉํ–ฅ์„ ๊ท ์ผํ•˜๊ฒŒ ์ทจ๊ธ‰ํ•˜์—ฌ ์†์‹ค ํ•จ์ˆ˜์˜ ๊ธฐํ•˜ํ•™์  ๊ตฌ์กฐ๋ฅผ ๊ฐ„๊ณผํ•˜๋Š” ๋ฌธ์ œ๋ฅผ ์ง€์ ํ•ฉ๋‹ˆ๋‹ค. ์ด๋ฅผ ํ•ด๊ฒฐํ•˜๊ธฐ ์œ„ํ•ด, ์†์‹ค ํ•จ์ˆ˜์˜ ๊ธฐํ•˜ํ•™์  ์ •๋ณด๋ฅผ ํฌ์ฐฉํ•˜๋Š” ํ•™์Šต๋œ ์ „์น˜์กฐ๊ฑด์ž(learned preconditioner)์™€ SAM์„ ๊ฒฐํ•ฉํ•œ LLQR+SAM์„ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. LLQR+SAM์€ ๋Š๋ฆฐ ์‹œ๊ฐ„ ๊ทœ๋ชจ์—์„œ ํ•™์Šต๋œ ๊ธฐํ•˜ํ•™์  ์ •๋ณด๋ฅผ ํ™œ์šฉํ•˜์—ฌ SAM์˜ ๊ตญ์†Œ์ ์ธ ๋‚ ์นด๋กœ์›€(potholes) ํƒ์ง€ ์‹ ํ˜ธ๋ฅผ ์ฆํญ์‹œ์ผœ ์„ฑ๋Šฅ์„ ํ–ฅ์ƒ์‹œํ‚ต๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
SAM์˜ ํŒŒ๋ผ๋ฏธํ„ฐ ๋ฐฉํ–ฅ ๊ท ์ผ์„ฑ ๋ฌธ์ œ ํ•ด๊ฒฐ์„ ์œ„ํ•œ ์ƒˆ๋กœ์šด ์ ‘๊ทผ ๋ฐฉ์‹ ์ œ์‹œ.
โ€ข
ํ•™์Šต๋œ ๊ธฐํ•˜ํ•™์  ์ •๋ณด์™€ ๋น ๋ฅธ ์‹œ๊ฐ„ ๊ทœ๋ชจ์˜ ๋‚ ์นด๋กœ์›€ ๋ณด์ •์ด ์ƒํ˜ธ ๋ณด์™„์ ์ž„์„ ์ด๋ก ์ , ๊ฒฝํ—˜์ ์œผ๋กœ ์ž…์ฆ.
โ€ข
๋Š๋ฆฌ๊ฒŒ ํ•™์Šต๋œ ์ „์น˜์กฐ๊ฑด์ž๊ฐ€ ์†์‹ค ํ•จ์ˆ˜์˜ '์›€ํ‘น ํŒŒ์ธ ๊ณณ(potholes)'์„ ํšจ๊ณผ์ ์œผ๋กœ ํƒ์ง€ํ•˜์—ฌ ์•ˆ์ •์ ์ธ ํ•™์Šต ์œ ๋„.
๐Ÿ‘
Made with Slashpage