Hanlin Wang, Hao Ouyang, Qiuyu Wang, Wen Wang, Qingyan Bai, Ka Leong Cheng, Yue Yu, Yixuan Li et al.
WorldDirector builds a controllable world simulator with persistent dynamic memory by using an LLM to orchestrate 3D trajectories and camera movements, which then serve as control signals for video generation.
Existing world models entangle physical dynamics with pixel rendering and rely on continuous visual observation to sustain motion, limiting controllability and visual identity preservation for complex, long-horizon event synthesis.
The framework explicitly decouples semantic motion orchestration from visual generation. An LLM coordinates 3D trajectories with camera movements, and these orchestrated trajectories are used as control signals for video generation.
The method demonstrates support for synthesizing complex and extended events with unprecedented controllability and persistent dynamic object memory. It successfully preserves the exact visual identities of dynamic entities even when they re-enter the scene after prolonged periods out of view.