mlsanityData to 7 Oct 2026

CRePE: Curved Ray Expectation Positional Encoding for Unified-Camera-Controlled Video Generation

arXiv 2605.12938 ↗First posted 13 May 2026cs.CV cs.AI cs.LGcited by 3

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Video world models should predict future appearance in a way that remains consistent with 3D scene structure, camera motion, and lens geometry. Existing attention-level camera encodings, however, either describe each token only by its viewing ray---without locating scene content along that ray---or assume pinhole projection, limiting camera control under wide-angle and fisheye lenses. We introduce Curved Ray Expectation Positional Encoding (CRePE), which represents each image token as a depth-aware distribution along its Unified Camera Model (UCM) ray and integrates the expected rotary positional phasor along the curved path this distribution traces when projected into each query view. CRePE is realized through a lightweight Geometric Attention Adapter on a frozen video diffusion transformer, with pseudo radial-distance supervision from a monocular geometry foundation model serving as a stabilizing anchor rather than an inference-time input. CRePE improves camera-control, lens, and orientation fidelity across pinhole, wide-angle, and fisheye settings, and transfers zero-shot to unseen real fisheye and diverse pinhole videos. Through Radial MixForcing, the same positional pathway further accepts externally supplied radial maps, enabling scene-geometry-conditioned generation and source-video motion transfer that follow the supplied geometry more faithfully than dedicated depth-conditioned baselines. CRePE thus offers a compact interface that unifies camera control, implicit 3D scene state, and external geometry control for video world models.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 33 of its 37 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

33 of 37 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Unified Camera Positional Encoding for Controlled Video Generation8 Dec
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  3. 2022Scalable Diffusion Models with Transformers19 Dec

Other references · 30

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  2. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  3. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  4. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
  5. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  6. 2025VACE: All-in-One Video Creation and Editingcited by 467
  7. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  8. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  9. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  10. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
  11. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  12. 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 222
18 more
  1. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
  2. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  3. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
  4. 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
  5. 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 129
  6. 2024EscherNet: A Generative Model for Scalable View Synthesiscited by 94
  7. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
  8. 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
  9. 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Modelcited by 64
  10. 2024World-consistent Video Diffusion with Explicit 3D Modelingcited by 62
  11. 2025UniK3D: Universal Camera Monocular 3D Estimationcited by 60
  12. 2024GeoCalib: Learning Single-image Calibration with Geometric Optimizationcited by 50
  13. 2025Segment Any Motion in Videoscited by 34
  14. 2025YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splattingcited by 34
  15. 2025Matrix-3D: Omnidirectional Explorable 3D World Generationcited by 33
  16. 2025OmniVDiff: Omni Controllable Video Diffusion for Generation and Understandingcited by 22
  17. 2025RealCam-Vid: High-resolution Video Dataset with Dynamic Scenes and Metric-scale Camera Movementscited by 12
  18. 2026RayRoPE: Projective Ray Positional Encoding for Multi-view Attentioncited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Geometry-Aware Rotary Position Embedding for Consistent Video World Model
  2. 2026PE-Field 4D: Video Generation Models as Canvas
  3. 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Models
  4. 2026Rays as Pixels: Learning A Joint Distribution of Videos and Camera Trajectories
  5. 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories
  6. 2026Stereo World Model: Camera-Guided Stereo Video Generation
  7. 2026RAYNOVA: Scale-Temporal Autoregressive World Modeling in Ray Space
  8. 2025DualCamCtrl: Dual-Branch Diffusion Model for Geometry-Aware Camera-Controlled Video Generation