LivingWorld: Interactive 4D World Generation with Environmental Dynamics
Abstract
We introduce LivingWorld, an interactive framework forgenerating 4D worlds with environmental dynamics from a single image.While recent advances in 3D scene generation enable large-scale environ-ment creation, most approaches focus primarily on reconstructing staticgeometry, leaving scene-scale environmental dynamics such as clouds,water, or smoke largely unexplored. Modeling such dynamics is challeng-ing because motion must remain coherent across an expanding scenewhile supporting low-latency user feedback. LivingWorld addresses thischallenge by progressively constructing a globally coherent motion field asthe scene expands. To maintain global consistency during expansion, weintroduce a geometry-aware alignment module that resolves directionaland scale ambiguities across views. We further represent motion using acompact hash-based motion field, enabling efficient querying and stablepropagation of dynamics throughout the scene. This representation alsosupports bidirectional motion propagation during rendering, producinglong and temporally coherent 4D sequences without relying on expen-sive video-based refinement. On a single RTX 5090 GPU, generatingeach new scene expansion step requires 9 seconds, followed by 3 secondsfor motion alignment and motion field updates, enabling interactive 4Dworld generation with globally coherent environmental dynamics. Videodemonstrations are available at paper.pnu-cvsp.com/LivingWorld.