Sign In

3DPhysVideo: Consistency-Guided Flow SDE for Video Generation via 3D Scene Reconstruction and Physical Simulation

์ž‘์„ฑ์ž
  • Haebom
์นดํ…Œ๊ณ ๋ฆฌ
Empty

์ €์ž

Hwidong Kim, Yunho Kim, Tae-Kyun Kim

๐Ÿ’ก ๊ฐœ์š”

๋ณธ ๋…ผ๋ฌธ์€ ๋‹จ์ผ ์ด๋ฏธ์ง€๋กœ๋ถ€ํ„ฐ ๋ฌผ๋ฆฌ์ ์œผ๋กœ ์‚ฌ์‹ค์ ์ธ ์˜์ƒ์„ ์ƒ์„ฑํ•˜๊ธฐ ์œ„ํ•œ ์ƒˆ๋กœ์šด ํ•™์Šต ์—†๋Š” ํŒŒ์ดํ”„๋ผ์ธ์ธ 3DPhysVideo๋ฅผ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. ์ œ์•ˆ๋œ ๋ฐฉ๋ฒ•์€ ๊ธฐ์กด ์˜์ƒ ์ƒ์„ฑ ๋ชจ๋ธ์„ ์žฌํ™œ์šฉํ•˜์—ฌ 3D ์žฅ๋ฉด ์žฌ๊ตฌ์„ฑ๊ณผ ๋ฌผ๋ฆฌ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ๋‘ ๋‹จ๊ณ„๋ฅผ ๊ฑฐ์นฉ๋‹ˆ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ๋‹ค์ค‘ ๊ฐ์ฒด ๋ฐ ์œ ์ฒด ์ƒํ˜ธ์ž‘์šฉ ์žฅ๋ฉด์—์„œ๋„ ๋ฌผ๋ฆฌ ๋ฒ•์น™์„ ๋”ฐ๋ฅด๋Š” ๊ณ ํ’ˆ์งˆ ์˜์ƒ์„ ํšจ์œจ์ ์œผ๋กœ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
๊ธฐ์กด ์˜์ƒ ์ƒ์„ฑ ๋ชจ๋ธ์„ 3D ์žฅ๋ฉด ์žฌ๊ตฌ์„ฑ๊ณผ ๋ฌผ๋ฆฌ ๊ธฐ๋ฐ˜ ์˜์ƒ ํ•ฉ์„ฑ์— ์„ฑ๊ณต์ ์œผ๋กœ ์žฌํ™œ์šฉํ•  ์ˆ˜ ์žˆ์Œ์„ ๋ณด์—ฌ์ค๋‹ˆ๋‹ค.
โ€ข
๋ฌผ๋ฆฌ์  ์ผ๊ด€์„ฑ์„ ๊ฐ•์ œํ•˜๋Š” Consistency-Guided Flow SDE๋ฅผ ํ†ตํ•ด ๋‹จ์ผ ์ด๋ฏธ์ง€์—์„œ ๋ฌผ๋ฆฌ์ ์œผ๋กœ ํƒ€๋‹นํ•œ ์˜์ƒ ์ƒ์„ฑ์˜ ์ƒˆ๋กœ์šด ๊ฐ€๋Šฅ์„ฑ์„ ์ œ์‹œํ•ฉ๋‹ˆ๋‹ค.
โ€ข
์—ฐ๊ตฌ ๊ฒฐ๊ณผ๋Š” ๋‹ค์ค‘ ๊ฐ์ฒด ๋ฐ ์œ ์ฒด ์ƒํ˜ธ์ž‘์šฉ์„ ํฌํ•จํ•œ ๋‹ค์–‘ํ•œ ์‹œ๋‚˜๋ฆฌ์˜ค์—์„œ ์ตœ์‹  ๊ธฐ๋ฒ• ๋Œ€๋น„ ์šฐ์ˆ˜ํ•œ ์„ฑ๋Šฅ์„ ๋ณด์˜€์Šต๋‹ˆ๋‹ค.
โ€ข
ํ˜„์žฌ ๋ฐฉ๋ฒ•๋ก ์˜ ํ•œ๊ณ„์  ๋˜๋Š” ํ–ฅํ›„ ์—ฐ๊ตฌ ๊ณผ์ œ๋กœ๋Š” ๋ณต์žกํ•˜๊ณ  ๋™์ ์ธ ๋ฌผ๋ฆฌ ํ˜„์ƒ์— ๋Œ€ํ•œ ๋”์šฑ ์ •๊ตํ•œ ๋ชจ๋ธ๋ง ๋ฐ ํ•™์Šต ํšจ์œจ์„ฑ ๊ฐœ์„  ๋“ฑ์ด ์žˆ์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
๐Ÿ‘
Made with Slashpage