MeRoPE: Metric Rotary Position Embedding for Camera-Controlled Video Generation
Not on the map. Why?
Abstract (arXiv)
In camera-controlled video generation, geometry-aware positional encodings condition tokens on camera extrinsics and per-token viewing rays. Existing schemes, however, have a scale-dependent failure mode on real-world metric camera trajectories: homogeneous projective encodings cause attention logits and feature norms to grow unbounded with physical translation baselines. We propose MeRoPE (Metric Rotary Position Embedding), a norm-preserving relative camera encoding for attention. MeRoPE encodes relative orientations between calibrated viewing rays with orthogonal rotation blocks, maps raw metric displacements into multi-frequency rotary phases, and adds a disparity-anchored correspondence prior along the epipolar arc. This design strictly preserves feature norms, bounds pre-softmax attention logits regardless of the physical translation scale, and maintains exact invariance to global rigid coordinate changes. Across nuScenes and PanShot, which cover large-baseline trajectories and diverse camera optics, respectively, MeRoPE achieves stronger camera control than prior encodings, with the best consistency between generated camera motion and conditioning poses in both rotation and translation. Code will be made publicly available.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 33 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
26 of 33 references.
References · 26
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 166
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
- 2025Cameras as Relative Positional Encodingcited by 105
- 2024EscherNet: A Generative Model for Scalable View Synthesiscited by 95
14 more
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 79
- 2026Lyra 2.0: Explorable Generative 3D Worldscited by 44
- 2025Unified Camera Positional Encoding for Controlled Video Generationcited by 37
- 2025BulletTime: Decoupled Control of Time and Camera Pose for Video Generationcited by 14
- 2026RayRoPE: Projective Ray Positional Encoding for Multi-view Attentioncited by 14
- 2026ReRoPE: Repurposing RoPE for Relative Camera Controlcited by 13
- 2026Geometry-Aware Rotary Position Embedding for Consistent Video World Modelcited by 12
- 2026Grounding World Simulation Models in a Real-World Metropoliscited by 12
- 2026World Engine: Towards the Era of Post-Training for Autonomous Drivingcited by 8
- 2026URoPE: Universal Relative Position Embedding across Geometric Spacescited by 6
- 2026RAYNOVA: Scale-Temporal Autoregressive World Modeling in Ray Spacecited by 4
- 2026CRePE: Curved Ray Expectation Positional Encoding for Unified-Camera-Controlled Video Generationcited by 4
- 2026Composing Driving Worlds through Disentangled Control for Adversarial Scenario Generationcited by 2
- 2026CityRAG: Stepping Into a City via Spatially-Grounded Video Generationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026LOCI: Spatial Linear Memory for Streaming World Modelscited by 0
- 2026LOCI: Spatial Linear Memory for Streaming World Models30 Sep 2026