mlsanityData to 7 Oct 2026

SCoPE: Sightline-Coordinate Positional Encoding for Video Diffusion Transformers

arXiv 2606.27345 ↗First posted 25 Jun 2026cs.CVcited by 3

On the map: Diffusion models → Video generation

Abstract (arXiv)

Video diffusion transformers address their tokens by position on the pixel-time grid: an address in the tensor, not in the world. The address we would want, the world point a token depicts, lies on a surface not yet generated, while its camera ray is fixed once the user specifies a trajectory. SCoPE therefore treats the ray as a second positional coordinate, and camera control becomes a property of the coordinate system, not an added module. The ray is added to the pretrained attention's queries and keys, and the score gains a term that reads the two rays alone. Its canonical form, the reciprocal product of line geometry, measures how nearly two lines of sight meet. Normalize-Gate-Inject makes a single encoding trainable across metric and up-to-scale pose sources. The retrofit keeps RoPE bit-exact, starts from the unchanged pretrained DiT, and adds under 0.1/% new parameters. On Wan2.2 at 5B and 14B under matched data and budget, SCoPE improves every camera-controllability and fidelity metric, leads all closed-loop revisit metrics, and shows widening margins with model size. At 14B, rotation error falls 29/% and FVD 43/% below the strongest baseline.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 69 of its 84 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

69 of 84 references.

Closest ancestors · 19

Same direction, newest first

  1. 2026ReRoPE: Repurposing RoPE for Relative Camera Control8 Feb
  2. 2025SpaceTimePilot: Generative Rendering of Dynamic Scenes Across Space and Time31 Dec
  3. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  4. 2025Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Control18 Sep
  5. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Models13 Mar
  6. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise14 Jan
  7. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Control7 Jan
  8. 2024Latent-Reframe: Enabling Camera Control for Video Diffusion Model without Training8 Dec
  9. 2024Trajectory Attention for Fine-grained Video Motion Control28 Nov
  10. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers27 Nov
  11. 2024Cavia: Camera-controllable Multi-view Video Diffusion with View-Integrated Attention14 Oct
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
7 more
  1. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control17 Jul
  2. 2024Training-free Camera Control for Video Generation14 Jun
  3. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generation4 Jun
  4. 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Control27 May
  5. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion5 Feb
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  7. 2022Video Diffusion Models7 Apr

Other references · 50

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2022Flow Matching for Generative Modelingcited by 5,426
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  8. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  9. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  10. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  11. 2019Root Mean Square Layer Normalizationcited by 1,425
  12. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
38 more
  1. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  2. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  3. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  4. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  5. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  6. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  7. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  8. 2020Query-Key Normalization for Transformerscited by 266
  9. 2024Rotary Position Embedding for Vision Transformercited by 226
  10. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
  11. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 139
  12. 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 129
  13. 2020Epipolar Transformerscited by 117
  14. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
  15. 2021Light Field Neural Renderingcited by 108
  16. 2023Learning to Render Novel Views from Wide-Baseline Stereo Pairscited by 103
  17. 2024EscherNet: A Generative Model for Scalable View Synthesiscited by 94
  18. 2025Cameras as Relative Positional Encodingcited by 94
  19. 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpointscited by 92
  20. 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
  21. 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
  22. 2022R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesiscited by 69
  23. 2024Controlling Space and Time with Diffusion Modelscited by 65
  24. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 59
  25. 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 54
  26. 2025Unified Camera Positional Encoding for Controlled Video Generationcited by 34
  27. 2025Generative Video Motion Editing with 3D Point Trackscited by 21
  28. 2025Positional Encoding Fieldcited by 20
  29. 2026Geometry-Aware Rotary Position Embedding for Consistent Video World Modelcited by 12
  30. 2025ReDirector: Creating Any-Length Video Retakes with Rotary Camera Encodingcited by 10
  31. 2026RayRoPE: Projective Ray Positional Encoding for Multi-view Attentioncited by 10
  32. 2023RePAST: Relative Pose Attention Scene Representation Transformercited by 7
  33. 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Modelscited by 7
  34. 2026URoPE: Universal Relative Position Embedding across Geometric Spacescited by 5
  35. 2026RAYNOVA: Scale-Temporal Autoregressive World Modeling in Ray Spacecited by 4
  36. 2026Rays as Pixels: Learning A Joint Distribution of Videos and Camera Trajectoriescited by 4
  37. 2026Warp-as-History: Generalizable Camera-Controlled Video Generation from One Training Videocited by 4
  38. 2026CRePE: Curved Ray Expectation Positional Encoding for Unified-Camera-Controlled Video Generationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PE-Field 4D: Video Generation Models as Canvas
  2. 2026Not All Tokens Need 40 Steps: Heterogeneous Step Allocation in Diffusion Transformers for Efficient Video Generation
  3. 2026RoLA: Rotary-Positioned Low-Rank Linear Attention for Efficient Diffusion Transformers
  4. 2025Emergent Temporal Correspondences from Video Diffusion Transformers
  5. 2025Stitch: Training-Free Position Control in Multimodal Diffusion Transformers
  6. 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation
  7. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling
  8. 2026Registers Matter for Pixel-Space Diffusion Transformers