Sign In

Robust Prior-Guided Segmentation for Editable 3D Gaussian Splatting

์ž‘์„ฑ์ž
  • Haebom
์นดํ…Œ๊ณ ๋ฆฌ
Empty

์ €์ž

Raushan Joshi, Jean-Yves Guillemaut

๐Ÿ’ก ๊ฐœ์š”

๋ณธ ๋…ผ๋ฌธ์€ ์‹ค์‹œ๊ฐ„ 3D ์žฅ๋ฉด ์žฌ๊ตฌ์„ฑ์— ๊ฐ•์ ์„ ๊ฐ€์ง€๋Š” 3D Gaussian Splatting(3D-GS)์˜ ๊ฐ์ฒด ํŽธ์ง‘์„ ์œ„ํ•œ ๊ฒฌ๊ณ ํ•œ ๋ถ„ํ• (segmentation) ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๊ณ ์ž ํ•ฉ๋‹ˆ๋‹ค. ์ด๋ฅผ ์œ„ํ•ด SAM-HQ๋ฅผ ํ™œ์šฉํ•˜์—ฌ ์ •ํ™•ํ•œ 2D ๋งˆ์Šคํฌ๋ฅผ ์ƒ์„ฑํ•˜๊ณ , ๋‹ค์ค‘ ์‹œ์  ์ผ๊ด€์„ฑ์„ ๊ฐ•์ œํ•˜๋Š” ์‚ฌ์ „ ์ •๋ณด ๊ธฐ๋ฐ˜ ๋ผ๋ฒจ ์žฌํ• ๋‹น ๊ธฐ๋ฒ•์„ ํ†ตํ•ด 3D ๊ฐ€์šฐ์‹œ์•ˆ์— ๋Œ€ํ•œ ๊ฒฌ๊ณ ํ•œ ๋ถ„ํ• ์„ ์ˆ˜ํ–‰ํ•ฉ๋‹ˆ๋‹ค. ๊ฒฐ๊ณผ์ ์œผ๋กœ, ๋ณธ ์—ฐ๊ตฌ๋Š” ๊ฐ์ฒด ์ œ๊ฑฐ, ์ถ”์ถœ, ์ƒ‰์ƒ ๋ณ€๊ฒฝ ๋“ฑ ์‚ฌ์‹ค์ ์ธ 3D ์žฅ๋ฉด ํŽธ์ง‘์„ ์‹ค์‹œ๊ฐ„์œผ๋กœ ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ”‘ ์‹œ์‚ฌ์  ๋ฐ ํ•œ๊ณ„

โ€ข
3D Gaussian Splatting ํ™˜๊ฒฝ์—์„œ ๊ฐ์ฒด ํŽธ์ง‘์„ ์œ„ํ•œ ์ •ํ™•ํ•˜๊ณ  ๊ฒฌ๊ณ ํ•œ 3D ๋ถ„ํ• ์˜ ๊ฐ€๋Šฅ์„ฑ์„ ์ œ์‹œํ•ฉ๋‹ˆ๋‹ค.
โ€ข
SAM-HQ์™€ ์‚ฌ์ „ ์ •๋ณด ๊ธฐ๋ฐ˜ ๋ผ๋ฒจ ์žฌํ• ๋‹น ๊ธฐ๋ฒ•์˜ ๊ฒฐํ•ฉ์ด ๊ธฐ์กด ๋ฐฉ๋ฒ•๋ก ์˜ ํ•œ๊ณ„๋ฅผ ๊ทน๋ณตํ•˜๊ณ  ๋†’์€ ์‹œ๊ฐ์  ํ’ˆ์งˆ์„ ์œ ์ง€ํ•จ์„ ์ž…์ฆํ•ฉ๋‹ˆ๋‹ค.
โ€ข
VR ๋ฐ ๋กœ๋ณดํ‹ฑ์Šค ๋ถ„์•ผ์—์„œ์˜ ์‹ค์งˆ์ ์ธ ์‘์šฉ ๊ฐ€๋Šฅ์„ฑ์„ ๋ณด์—ฌ์ฃผ๋ฉฐ 3D ์žฅ๋ฉด ํŽธ์ง‘์˜ ๋ฐœ์ „์— ๊ธฐ์—ฌํ•ฉ๋‹ˆ๋‹ค.
โ€ข
ํŠน์ • ๋Œ€์ƒ ๊ฐ์ฒด์— ๋Œ€ํ•œ ๋ช…ํ™•ํ•œ 2D ๋งˆ์Šคํฌ ์ƒ์„ฑ์„ ์ „์ œ๋กœ ํ•˜๋ฏ€๋กœ, ๋ถ„ํ• ์ด ์–ด๋ ค์šด ๋ณต์žกํ•˜๊ฑฐ๋‚˜ ๋ชจํ˜ธํ•œ ๊ฐ์ฒด์— ๋Œ€ํ•œ ์„ฑ๋Šฅ ๊ฐœ์„  ์—ฌ์ง€๊ฐ€ ์žˆ์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
๐Ÿ‘
Made with Slashpage