[공지사항]을 빙자한 안부와 근황 
Show more

Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Robust 3D-Masked Part-level Editing in 3D Gaussian Splatting with Regularized Score Distillation Sampling

Created by
  • Haebom

Author

Hayeon Kim, Ji Ha Jang, Se Young Chun

Outline

In this paper, we propose RoMaP, a novel framework for precise local editing of 3D models based on Gaussian Splatting. To address the inaccurate 2D segmentation of conventional Gaussian Splatting and the ambiguity of Score Distillation Sampling (SDS) loss, RoMaP generates precise and consistent segmentations via the 3D-Geometry Aware Label Prediction (3D-GALP) module, and performs precise editing of the target region via the regularized SDS loss function and the Scheduled Latent Mixing and Part (SLaMP) editing method. SLaMP produces high-quality, locally edited 2D images while maintaining contextual consistency, and additional regularization terms (e.g., removing the Gaussian prior) enhance the flexibility by allowing changes beyond the original context. Experimental results demonstrate that RoMaP achieves state-of-the-art local 3D editing performance on both reconstructed and generated Gaussian scenes and objects.

Takeaways, Limitations

Takeaways:
Enables precise and dramatic part editing of 3D models based on Gaussian Splatting.
Overcoming the Limitations of existing methods with accurate and consistent sub-segmentation and regularized SDS loss function via 3D-GALP.
Generating high-quality partial editing 2D images and maintaining contextual consistency via SLaMP.
Additional regularization terms allow for flexible editing beyond the original context.
Achieving state-of-the-art performance on both reconstructed and generated Gaussian scenes and objects.
Limitations:
Lack of analysis of the computational cost and memory usage of the proposed method.
Lack of generalization performance evaluation for various 3D model shapes.
Further validation of its usefulness in real-world applications is needed.
👍