GeoWorld: Providing Full-frame Geometry Features to Facilitate 3D Scene Generation

Previous works that leverage video models for image-to-3Dscene generation often suffer from geometric distortions and blurry con-tent. Using video generation models to implicitly maintain geometricconsistency according to a single-frame input is ineffective. In this paper,we present a two-stage method, named GeoWorld, that renovates theimage-to-3D scene generation pipeline by providing full-frame geometryfeatures. The first-stage video generation model, followed by a multi-viewgeometry model, produces full-frame geometry features, which are thenused as a mental draft of geometric conditions to aid the second-stagevideo-generation model. A geometric loss is proposed to impose real-worldgeometric constraints, and a geometry adaptation module is introducedto ensure the effective utilization of geometry features. Thanks to full-frame geometric modeling, the two smaller video models in our two-stagemethod can generate higher-fidelity 3D scenes than SOTA methods, whilebeing even faster, e.g. 7.5× faster than Hunyuan-Voyager. Project page:https://peaes.github.io/GeoWorld.