Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

LSD-3D: Large-Scale 3D Driving Scene Generation with Geometry Grounding

Created by
  • Haebom

Author

Julian Ost, Andrea Ramazzina, Amogh Joshi, Maximilian B omer, Mario Bijelic, Felix Heide

Outline

This paper addresses the problem of generating large-scale scene data for robot learning. Existing neural network-based reconstruction methods are useful for reconstructing large-scale outdoor scenes based on real-world environments, but they are limited to static environments and lack scene and trajectory diversity. Conversely, recent image or video diffusion models offer controllability but lack geometric foundations and causality. To overcome these limitations, this study presents a method for directly generating large-scale 3D driving scenes with accurate geometric information. The proposed method combines proxy geometry and environment representation generation with score distillation from learned 2D image priors, providing high controllability and enabling the generation of realistic and geometrically consistent 3D complex driving scenes, conditioned on map layout.

Takeaways, Limitations

Takeaways:
A novel method for directly generating large-scale 3D driving scenes with accurate geometric information is presented.
Provides high control, enabling prompt-based geometry and high-fidelity texture and structure creation.
Realistic and geometrically consistent 3D creation possible based on map layout
Causal new view synthesis possible through object persistence and explicit 3D geometry estimation.
Limitations:
Lack of specific details on the performance evaluation of the proposed method.
Validation of generalization performance on large-scale datasets is needed.
Further research is needed on the applicability to actual robotic systems.
👍