SubjectDrive: Scaling Generative Data in Autonomous Driving via Subject Control
Not on the map. Why?
Abstract (arXiv)
Autonomous driving progress relies on large-scale annotated datasets. In this work, we explore the potential of generative models to produce vast quantities of freely-labeled data for autonomous driving applications and present SubjectDrive, the first model proven to scale generative data production in a way that could continuously improve autonomous driving applications. We investigate the impact of scaling up the quantity of generative data on the performance of downstream perception models and find that enhancing data diversity plays a crucial role in effectively scaling generative data production. Therefore, we have developed a novel model equipped with a subject control mechanism, which allows the generative model to leverage diverse external data sources for producing varied and useful data. Extensive evaluations confirm SubjectDrive's efficacy in generating scalable autonomous driving training data, marking a significant step toward revolutionizing data production methods in this field.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 44 of its 49 references that are in the map. First posted on arXiv 28 Mar 2024.
Builds on
44 of 49 references.
References · 44
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
32 more
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 351
- 2022MAGVIT: Masked Generative Video Transformercited by 341
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 326
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 258
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
- 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
- 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clonescited by 171
- 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
- 2015A Large-Scale Car Dataset for Fine-Grained Categorization and Verificationcited by 129
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
- 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentationcited by 112
- 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
- 2023BEVControl: Accurately Controlling Street-view Elements with Multi-perspective Consistency via BEV Sketch Layoutcited by 102
- 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
- 2023WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generationcited by 93
- 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 76
- 2023DrivingDiffusion: Layout-Guided multi-view driving scene video generation with latent diffusion modelcited by 75
- 2023Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Trackingcited by 54
- 2023Custom-Edit: Text-Guided Image Editing with Customized Diffusion Modelscited by 54
- 2022CC-3DT: Panoramic 3D Object Tracking via Cross-Camera Fusioncited by 31
- 2022TripletTrack: 3D Object Tracking using Triplet Embeddings and LSTMcited by 26
- 2023Generate Anything Anywhere in Any Scenecited by 14
Built on by
Citing papers per year: 2024: 8; 2025: 16; 2026: 8.
32 papers.
Sort:
By area:
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
- 20253D and 4D World Modeling: A Surveycited by 64
- 2025DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene Generationcited by 39
- 2024DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenescited by 34
- 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Drivingcited by 21
- 2025X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllabilitycited by 20
- 2024DriveEditor: A Unified 3D Information-Guided Framework for Controllable Object Editing in Driving Scenescited by 17
- 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Modelcited by 14
- 2025Rethinking Driving World Model as Synthetic Data Generator for Perception Taskscited by 14
- 2025CoGen: 3D Consistent Video Generation via Adaptive Conditioning for Autonomous Drivingcited by 12
- 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Drivingcited by 11
- 2024OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generationcited by 10
20 more
- 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
- 2025Realistic and Controllable 3D Gaussian-Guided Object Editing for Driving Video Generationcited by 6
- 2024Panacea+: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 5
- 2025MObI: Multimodal Object Inpainting Using Diffusion Modelscited by 4
- 2025PosePilot: Steering Camera Pose for Generative World Models with Self-supervised Depthcited by 4
- 2025Zero-Shot Subject-Centric Generation for Creative Application Using Entropy Fusioncited by 3
- 2025NoiseController: Towards Consistent Multi-view Video Generation via Noise Decomposition and Collaborationcited by 3
- 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challengescited by 3
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generationcited by 3
- 2025LinkQA: Synthesizing Diverse QA from Multiple Seeds Strongly Linked by Knowledge Pointscited by 2
- 2024ARCON: Advancing Auto-Regressive Continuation for Driving Videoscited by 1
- 2025RoCo-Sim: Enhancing Roadside Collaborative Perception through Foreground Simulationcited by 0
- 2025MultiEditor: Controllable Multimodal Object Editing for Driving Scenarios Using 3D Gaussian Splatting Priorscited by 0
- 2025Reference-Guided Diffusion Inpainting For Multimodal Counterfactual Generationcited by 0
- 2026DrivePTS: A Progressive Learning Framework with Textual and Structural Enhancement for Driving Scene Generationcited by 0
- 2026On the Strengths and Weaknesses of Data for Open-set Embodied Assistancecited by 0
- 2026VistaGEN: Consistent Driving Video Generation with Fine-Grained Control Using Multiview Visual-Language Reasoningcited by 0
- 2026AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyondcited by 0
- 2026DriveCache: Action-Aware Caching for Driving World Model Inferencecited by 0
- 2026Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Viewscited by 0
- 2026Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Views8 Sep 2026
- 2026DriveCache: Action-Aware Caching for Driving World Model Inference17 Aug 2026
- 2026AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyond25 May 2026
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generation4 Apr 2026
- 2026VistaGEN: Consistent Driving Video Generation with Fine-Grained Control Using Multiview Visual-Language Reasoning30 Mar 2026
- 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challenges10 Mar 2026
- 2026On the Strengths and Weaknesses of Data for Open-set Embodied Assistance5 Mar 2026
- 2026DrivePTS: A Progressive Learning Framework with Textual and Structural Enhancement for Driving Scene Generation26 Feb 2026
- 2025Rethinking Driving World Model as Synthetic Data Generator for Perception Tasks22 Oct 2025
- 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Driving27 Sep 2025
- 20253D and 4D World Modeling: A Survey4 Sep 2025
- 2025Realistic and Controllable 3D Gaussian-Guided Object Editing for Driving Video Generation28 Aug 2025
20 more
- 2025LinkQA: Synthesizing Diverse QA from Multiple Seeds Strongly Linked by Knowledge Points2 Aug 2025
- 2025Reference-Guided Diffusion Inpainting For Multimodal Counterfactual Generation30 Jul 2025
- 2025MultiEditor: Controllable Multimodal Object Editing for Driving Scenarios Using 3D Gaussian Splatting Priors29 Jul 2025
- 2025X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllability16 Jun 2025
- 2025Generative AI for Autonomous Driving: Frontiers and Opportunities13 May 2025
- 2025PosePilot: Steering Camera Pose for Generative World Models with Self-supervised Depth3 May 2025
- 2025NoiseController: Towards Consistent Multi-view Video Generation via Noise Decomposition and Collaboration25 Apr 2025
- 2025CoGen: 3D Consistent Video Generation via Adaptive Conditioning for Autonomous Driving28 Mar 2025
- 2025DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene Generation19 Mar 2025
- 2025RoCo-Sim: Enhancing Roadside Collaborative Perception through Foreground Simulation13 Mar 2025
- 2025Zero-Shot Subject-Centric Generation for Creative Application Using Entropy Fusion12 Mar 2025
- 2025MObI: Multimodal Object Inpainting Using Diffusion Models6 Jan 2025
- 2024DriveEditor: A Unified 3D Information-Guided Framework for Controllable Object Editing in Driving Scenes27 Dec 2024
- 2024OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generation15 Dec 2024
- 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Model11 Dec 2024
- 2024ARCON: Advancing Auto-Regressive Continuation for Driving Videos4 Dec 2024
- 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Driving2 Dec 2024
- 2024DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenes6 Sep 2024
- 2024Panacea+: Panoramic and Controllable Video Generation for Autonomous Driving14 Aug 2024
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond6 May 2024
- 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Drivingcited by 21
- 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Modelcited by 14
- 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
- 2024ARCON: Advancing Auto-Regressive Continuation for Driving Videoscited by 1
- 2026DrivePTS: A Progressive Learning Framework with Textual and Structural Enhancement for Driving Scene Generationcited by 0
- 2026VistaGEN: Consistent Driving Video Generation with Fine-Grained Control Using Multiview Visual-Language Reasoningcited by 0
- 2026AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyondcited by 0
- 2026AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyond25 May 2026
- 2026VistaGEN: Consistent Driving Video Generation with Fine-Grained Control Using Multiview Visual-Language Reasoning30 Mar 2026
- 2026DrivePTS: A Progressive Learning Framework with Textual and Structural Enhancement for Driving Scene Generation26 Feb 2026
- 2025Generative AI for Autonomous Driving: Frontiers and Opportunities13 May 2025
- 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Model11 Dec 2024
- 2024ARCON: Advancing Auto-Regressive Continuation for Driving Videos4 Dec 2024
- 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Driving2 Dec 2024
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
- 20253D and 4D World Modeling: A Surveycited by 64
- 2025Rethinking Driving World Model as Synthetic Data Generator for Perception Taskscited by 14
- 2025PosePilot: Steering Camera Pose for Generative World Models with Self-supervised Depthcited by 4
- 2025NoiseController: Towards Consistent Multi-view Video Generation via Noise Decomposition and Collaborationcited by 3
- 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challengescited by 3
- 2026DriveCache: Action-Aware Caching for Driving World Model Inferencecited by 0
- 2026DriveCache: Action-Aware Caching for Driving World Model Inference17 Aug 2026
- 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challenges10 Mar 2026
- 2025Rethinking Driving World Model as Synthetic Data Generator for Perception Tasks22 Oct 2025
- 20253D and 4D World Modeling: A Survey4 Sep 2025
- 2025PosePilot: Steering Camera Pose for Generative World Models with Self-supervised Depth3 May 2025
- 2025NoiseController: Towards Consistent Multi-view Video Generation via Noise Decomposition and Collaboration25 Apr 2025
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond6 May 2024
- 2024DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenescited by 34
- 2025X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllabilitycited by 20
- 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Drivingcited by 11
- 2024OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generationcited by 10
- 2025MObI: Multimodal Object Inpainting Using Diffusion Modelscited by 4
- 2025Reference-Guided Diffusion Inpainting For Multimodal Counterfactual Generationcited by 0
- 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Driving27 Sep 2025
- 2025Reference-Guided Diffusion Inpainting For Multimodal Counterfactual Generation30 Jul 2025
- 2025X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllability16 Jun 2025
- 2025MObI: Multimodal Object Inpainting Using Diffusion Models6 Jan 2025
- 2024OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generation15 Dec 2024
- 2024DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenes6 Sep 2024
- 2025DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene Generationcited by 39
- 2024DriveEditor: A Unified 3D Information-Guided Framework for Controllable Object Editing in Driving Scenescited by 17
- 2025CoGen: 3D Consistent Video Generation via Adaptive Conditioning for Autonomous Drivingcited by 12
- 2025Realistic and Controllable 3D Gaussian-Guided Object Editing for Driving Video Generationcited by 6
- 2024Panacea+: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 5
- 2025Zero-Shot Subject-Centric Generation for Creative Application Using Entropy Fusioncited by 3
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generationcited by 3
- 2025LinkQA: Synthesizing Diverse QA from Multiple Seeds Strongly Linked by Knowledge Pointscited by 2
- 2025RoCo-Sim: Enhancing Roadside Collaborative Perception through Foreground Simulationcited by 0
- 2025MultiEditor: Controllable Multimodal Object Editing for Driving Scenarios Using 3D Gaussian Splatting Priorscited by 0
- 2026On the Strengths and Weaknesses of Data for Open-set Embodied Assistancecited by 0
- 2026Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Viewscited by 0
- 2026Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Views8 Sep 2026
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generation4 Apr 2026
- 2026On the Strengths and Weaknesses of Data for Open-set Embodied Assistance5 Mar 2026
- 2025Realistic and Controllable 3D Gaussian-Guided Object Editing for Driving Video Generation28 Aug 2025
- 2025LinkQA: Synthesizing Diverse QA from Multiple Seeds Strongly Linked by Knowledge Points2 Aug 2025
- 2025MultiEditor: Controllable Multimodal Object Editing for Driving Scenarios Using 3D Gaussian Splatting Priors29 Jul 2025
- 2025CoGen: 3D Consistent Video Generation via Adaptive Conditioning for Autonomous Driving28 Mar 2025
- 2025DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene Generation19 Mar 2025
- 2025RoCo-Sim: Enhancing Roadside Collaborative Perception through Foreground Simulation13 Mar 2025
- 2025Zero-Shot Subject-Centric Generation for Creative Application Using Entropy Fusion12 Mar 2025
- 2024DriveEditor: A Unified 3D Information-Guided Framework for Controllable Object Editing in Driving Scenes27 Dec 2024
- 2024Panacea+: Panoramic and Controllable Video Generation for Autonomous Driving14 Aug 2024