OpenLongTail: Generative Scaling of Long-Tail Driving Data
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Scaling robust driving policies is fundamentally bottlenecked by the scarcity of edge cases in curated datasets. While the real world continuously captures these critical events, such long-tail events remain underutilized when collected from heterogeneous sources. Specifically, diverse but valuable in-the-wild long-tail videos lack the full view coverage required for training policy models, often missing multi-view poses or originating solely from monocular dash cameras. This modality gap prevents these ubiquitous observations from being converted into scalable training data for long-tail generalization. We introduce OpenLongTail, an open-source generative data engine for scaling autonomous driving policies under long-tail events. To transform heterogeneous data sources into view-aligned and temporally coherent multi-view assets that are useful for policy learning, we develop a pose-informed extrapolative view synthesis pipeline that generates the missing views. We further enhance cross-view consistency and the temporal alignment for the newly generated views by injecting Pl"ucker ray geometry into the scalable generation engine. By synthesizing heterogeneous long-tail data, we observe a significant improvement in closed-loop driving robustness in handling long-tail events. By measuring the extrapolative view synthesis and pose metrics, we validate the effectiveness of OpenLongTail in visual fidelity, cross-view consistency, and ego-trajectory recovery.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 75 of its 82 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
75 of 82 references.
Closest ancestors · 14
Same direction, newest first
- 2025GenieDrive: Towards Physics-Aware Driving World Model with 4D Occupancy Guided Video Generation14 Dec
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
- 2025LongDWM: Cross-Granularity Distillation for Building a Long-Term Driving World Model2 Jun
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving26 Mar
- 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT27 Dec
- 2024InfiniCube: Unbounded and Controllable Dynamic 3D Driving Scene Generation with World-Guided Video Models5 Dec
- 2024InfinityDrive: Breaking Time Limits in Driving World Models2 Dec
- 2024MyGo: Consistent and Controllable Multi-View Driving Video Generation with Camera Control10 Sep
- 2024Tokenize the World into Object-level Knowledge to Address Long-tail Events in Autonomous Driving1 Jul
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
2 more
Other references · 61
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
38 more
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 301
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 186
- 2025World Simulation with Video Foundation Models for Physical AIcited by 183
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
- 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
- 2023Dolphins: Multimodal Language Model for Drivingcited by 124
- 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectivescited by 120
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
- 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoningcited by 108
- 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
- 2023BEVControl: Accurately Controlling Street-view Elements with Multi-perspective Consistency via BEV Sketch Layoutcited by 102
- 2022CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Drivingcited by 100
- 2023WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generationcited by 93
- 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 90
- 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervisioncited by 85
- 2025Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Modelscited by 80
- 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
- 2025WOD-E2E: Waymo Open Dataset for End-to-End Driving in Challenging Long-tail Scenarioscited by 60
- 2025DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene Generationcited by 39
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 39
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Dexterous Tactile World Modelcited by 0
- 2026Dexterous Tactile World Model28 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2024Unleashing Generalization of End-to-End Autonomous Driving with Controllable Long Video Generation
- 2026HelloWorld: Towards Practical Applications of Generative Driving World Models
- 2025OpenViGA: Video Generation for Automotive Driving Scenes by Streamlining and Fine-Tuning Open Source Models with Public Data
- 2025STAGE: A Stream-Centric Generative World Model for Long-Horizon Driving-Scene Simulation
- 2024DreamDrive: Generative 4D Scene Modeling from Street View Images
- 2024Drive-1-to-3: Enriching Diffusion Priors for Novel View Synthesis of Real Vehicles
- 2026InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generation
- 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving