Daily Arxiv

์ „ ์„ธ๊ณ„์—์„œ ๋ฐœ๊ฐ„๋˜๋Š” ์ธ๊ณต์ง€๋Šฅ ๊ด€๋ จ ๋…ผ๋ฌธ์„ ์ •๋ฆฌํ•˜๋Š” ํŽ˜์ด์ง€ ์ž…๋‹ˆ๋‹ค.
๋ณธ ํŽ˜์ด์ง€๋Š” Google Gemini๋ฅผ ํ™œ์šฉํ•ด ์š”์•ฝ ์ •๋ฆฌํ•˜๋ฉฐ, ๋น„์˜๋ฆฌ๋กœ ์šด์˜ ๋ฉ๋‹ˆ๋‹ค.
๋…ผ๋ฌธ์— ๋Œ€ํ•œ ์ €์ž‘๊ถŒ์€ ์ €์ž ๋ฐ ํ•ด๋‹น ๊ธฐ๊ด€์— ์žˆ์œผ๋ฉฐ, ๊ณต์œ  ์‹œ ์ถœ์ฒ˜๋งŒ ๋ช…๊ธฐํ•˜๋ฉด ๋ฉ๋‹ˆ๋‹ค.

InverseCrafter: Efficient Video ReCapture as a Latent Domain Inverse Problem

Created by
  • Haebom
Category
Empty

์ €์ž

Yeobin Hong, Suhyeon Lee, Hyungjin Chung, Jong Chul Ye

๐Ÿ’ก ๊ฐœ์š”

InverseCrafter๋Š” ์‚ฌ์ „ ํ›ˆ๋ จ๋œ ๋น„๋””์˜ค ํ™•์‚ฐ ๋ชจ๋ธ(VDM) ๋ฏธ์„ธ ์กฐ์ •์˜ ๊ณ„์‚ฐ ๋น„์šฉ ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๊ธฐ ์œ„ํ•ด 4D ๋น„๋””์˜ค ์ƒ์„ฑ ์ž‘์—…์„ ์ž ์žฌ ๊ณต๊ฐ„์—์„œ ํ’€๋ฆฌ๋Š” inpainting ๋ฌธ์ œ๋กœ ์žฌ๊ตฌ์„ฑํ•˜๋Š” ํšจ์œจ์ ์ธ ์—ญ ๋ฌธ์ œ ํ•ด๊ฒฐ ๊ธฐ๋ฒ•์ž…๋‹ˆ๋‹ค. ์ด ๋ฐฉ๋ฒ•์€ ํ”ฝ์…€ ๊ณต๊ฐ„์˜ ์—ดํ™” ์—ฐ์‚ฐ์ž๋ฅผ ์—ฐ์†์ ์ธ ๋‹ค์ค‘ ์ฑ„๋„ ์ž ์žฌ ๋งˆ์Šคํฌ๋กœ ์ธ์ฝ”๋”ฉํ•˜์—ฌ VAE ์—ฐ์‚ฐ์˜ ๋ฐ˜๋ณต์ ์ธ ๋ณ‘๋ชฉ ํ˜„์ƒ์„ ์šฐํšŒํ•ฉ๋‹ˆ๋‹ค. InverseCrafter๋Š” ์นด๋ฉ”๋ผ ์ œ์–ด ์ž‘์—…์—์„œ ์ƒˆ๋กœ์šด ๋ทฐ ์ƒ์„ฑ๊ณผ ์ธก์ • ์ผ๊ด€์„ฑ ์ธก๋ฉด์—์„œ ์šฐ์ˆ˜ํ•œ ์„ฑ๋Šฅ์„ ๋ณด์ด๋ฉฐ, ์ผ๋ฐ˜์ ์ธ ๋น„๋””์˜ค inpainting ๋ฐ ํŽธ์ง‘์—๋„ ๋›ฐ์–ด๋‚ฉ๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
์‚ฌ์ „ ํ›ˆ๋ จ๋œ VDM ๋ฏธ์„ธ ์กฐ์ •์˜ ๊ณ ๋น„์šฉ ๋ฌธ์ œ๋ฅผ ํšจ์œจ์ ์ธ ์ž ์žฌ ๊ณต๊ฐ„ ๊ธฐ๋ฐ˜ inpainting ์ ‘๊ทผ๋ฒ•์œผ๋กœ ํ•ด๊ฒฐํ•˜์—ฌ ๊ณ„์‚ฐ ํšจ์œจ์„ฑ์„ ํฌ๊ฒŒ ํ–ฅ์ƒ์‹œ์ผฐ์Šต๋‹ˆ๋‹ค.
โ€ข
์นด๋ฉ”๋ผ ์ œ์–ด, ์ƒˆ๋กœ์šด ๋ทฐ ์ƒ์„ฑ, ์ผ๋ฐ˜์ ์ธ ๋น„๋””์˜ค ํŽธ์ง‘ ์ž‘์—… ๋“ฑ ๋‹ค์–‘ํ•œ ์‹œ๋‚˜๋ฆฌ์˜ค์—์„œ ์šฐ์ˆ˜ํ•œ ์„ฑ๋Šฅ์„ ๋ณด์˜€์Šต๋‹ˆ๋‹ค.
โ€ข
InverseCrafter๊ฐ€ ์˜์กดํ•˜๋Š” VDM์˜ ์„ฑ๋Šฅ์— ๋”ฐ๋ผ ๊ฒฐ๊ณผ๊ฐ€ ์ œํ•œ๋  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ์ž ์žฌ ๊ณต๊ฐ„ ํ‘œํ˜„์˜ ์ •๊ตํ•จ์ด ๋” ๋ฐœ์ „๋˜์–ด์•ผ ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
๐Ÿ‘