CRePE: Curved Ray Expectation Positional Encoding for Unified-Camera-Controlled Video Generation
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Video world models should predict future appearance in a way that remains consistent with 3D scene structure, camera motion, and lens geometry. Existing attention-level camera encodings, however, either describe each token only by its viewing ray---without locating scene content along that ray---or assume pinhole projection, limiting camera control under wide-angle and fisheye lenses. We introduce Curved Ray Expectation Positional Encoding (CRePE), which represents each image token as a depth-aware distribution along its Unified Camera Model (UCM) ray and integrates the expected rotary positional phasor along the curved path this distribution traces when projected into each query view. CRePE is realized through a lightweight Geometric Attention Adapter on a frozen video diffusion transformer, with pseudo radial-distance supervision from a monocular geometry foundation model serving as a stabilizing anchor rather than an inference-time input. CRePE improves camera-control, lens, and orientation fidelity across pinhole, wide-angle, and fisheye settings, and transfers zero-shot to unseen real fisheye and diverse pinhole videos. Through Radial MixForcing, the same positional pathway further accepts externally supplied radial maps, enabling scene-geometry-conditioned generation and source-video motion transfer that follow the supplied geometry more faithfully than dedicated depth-conditioned baselines. CRePE thus offers a compact interface that unifies camera control, implicit 3D scene state, and external geometry control for video world models.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 33 of its 37 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
33 of 37 references.
Closest ancestors · 3
Same direction, newest first
- 2025Unified Camera Positional Encoding for Controlled Video Generation8 Dec
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2022Scalable Diffusion Models with Transformers19 Dec
Other references · 30
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 222
18 more
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
- 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
- 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 129
- 2024EscherNet: A Generative Model for Scalable View Synthesiscited by 94
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
- 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Modelcited by 64
- 2024World-consistent Video Diffusion with Explicit 3D Modelingcited by 62
- 2025UniK3D: Universal Camera Monocular 3D Estimationcited by 60
- 2024GeoCalib: Learning Single-image Calibration with Geometric Optimizationcited by 50
- 2025Segment Any Motion in Videoscited by 34
- 2025YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splattingcited by 34
- 2025Matrix-3D: Omnidirectional Explorable 3D World Generationcited by 33
- 2025OmniVDiff: Omni Controllable Video Diffusion for Generation and Understandingcited by 22
- 2025RealCam-Vid: High-resolution Video Dataset with Dynamic Scenes and Metric-scale Camera Movementscited by 12
- 2026RayRoPE: Projective Ray Positional Encoding for Multi-view Attentioncited by 10
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026SCoPE: Sightline-Coordinate Positional Encoding for Video Diffusion Transformerscited by 3
- 2026MeRoPE: Metric Rotary Position Embedding for Camera-Controlled Video Generationcited by 1
- 2026G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneitycited by 1
- 2026G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneity14 Sep 2026
- 2026MeRoPE: Metric Rotary Position Embedding for Camera-Controlled Video Generation1 Sep 2026
- 2026SCoPE: Sightline-Coordinate Positional Encoding for Video Diffusion Transformers25 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Geometry-Aware Rotary Position Embedding for Consistent Video World Model
- 2026PE-Field 4D: Video Generation Models as Canvas
- 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Models
- 2026Rays as Pixels: Learning A Joint Distribution of Videos and Camera Trajectories
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories
- 2026Stereo World Model: Camera-Guided Stereo Video Generation
- 2026RAYNOVA: Scale-Temporal Autoregressive World Modeling in Ray Space
- 2025DualCamCtrl: Dual-Branch Diffusion Model for Geometry-Aware Camera-Controlled Video Generation