mlsanityData to 7 Oct 2026

SubjectDrive: Scaling Generative Data in Autonomous Driving via Subject Control

arXiv 2403.19438 ↗First posted 28 Mar 2024cs.CV cs.ROcited by 32

Not on the map. Why?

Abstract (arXiv)

Autonomous driving progress relies on large-scale annotated datasets. In this work, we explore the potential of generative models to produce vast quantities of freely-labeled data for autonomous driving applications and present SubjectDrive, the first model proven to scale generative data production in a way that could continuously improve autonomous driving applications. We investigate the impact of scaling up the quantity of generative data on the performance of downstream perception models and find that enhancing data diversity plays a crucial role in effectively scaling generative data production. Therefore, we have developed a novel model equipped with a subject control mechanism, which allows the generative model to leverage diverse external data sources for producing varied and useful data. Extensive evaluations confirm SubjectDrive's efficacy in generating scalable autonomous driving training data, marking a significant step toward revolutionizing data production methods in this field.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 44 of its 49 references that are in the map. First posted on arXiv 28 Mar 2024.

Builds on

44 of 49 references.

References · 44

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2023GPT-4 Technical Reportcited by 18,132
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  12. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
32 more
  1. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  2. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  4. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  5. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  6. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
  7. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  8. 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 351
  9. 2022MAGVIT: Masked Generative Video Transformercited by 341
  10. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  11. 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 326
  12. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
  13. 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
  14. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 258
  15. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
  16. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
  17. 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clonescited by 171
  18. 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
  19. 2015A Large-Scale Car Dataset for Fine-Grained Categorization and Verificationcited by 129
  20. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
  21. 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentationcited by 112
  22. 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
  23. 2023BEVControl: Accurately Controlling Street-view Elements with Multi-perspective Consistency via BEV Sketch Layoutcited by 102
  24. 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
  25. 2023WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generationcited by 93
  26. 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 76
  27. 2023DrivingDiffusion: Layout-Guided multi-view driving scene video generation with latent diffusion modelcited by 75
  28. 2023Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Trackingcited by 54
  29. 2023Custom-Edit: Text-Guided Image Editing with Customized Diffusion Modelscited by 54
  30. 2022CC-3DT: Panoramic 3D Object Tracking via Cross-Camera Fusioncited by 31
  31. 2022TripletTrack: 3D Object Tracking using Triplet Embeddings and LSTMcited by 26
  32. 2023Generate Anything Anywhere in Any Scenecited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 16; 2026: 8.

32 papers.

Sort:

By area:

  1. 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
  2. 20253D and 4D World Modeling: A Surveycited by 64
  3. 2025DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene Generationcited by 39
  4. 2024DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenescited by 34
  5. 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Drivingcited by 21
  6. 2025X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllabilitycited by 20
  7. 2024DriveEditor: A Unified 3D Information-Guided Framework for Controllable Object Editing in Driving Scenescited by 17
  8. 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Modelcited by 14
  9. 2025Rethinking Driving World Model as Synthetic Data Generator for Perception Taskscited by 14
  10. 2025CoGen: 3D Consistent Video Generation via Adaptive Conditioning for Autonomous Drivingcited by 12
  11. 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Drivingcited by 11
  12. 2024OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generationcited by 10
20 more
  1. 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
  2. 2025Realistic and Controllable 3D Gaussian-Guided Object Editing for Driving Video Generationcited by 6
  3. 2024Panacea+: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 5
  4. 2025MObI: Multimodal Object Inpainting Using Diffusion Modelscited by 4
  5. 2025PosePilot: Steering Camera Pose for Generative World Models with Self-supervised Depthcited by 4
  6. 2025Zero-Shot Subject-Centric Generation for Creative Application Using Entropy Fusioncited by 3
  7. 2025NoiseController: Towards Consistent Multi-view Video Generation via Noise Decomposition and Collaborationcited by 3
  8. 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challengescited by 3
  9. 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generationcited by 3
  10. 2025LinkQA: Synthesizing Diverse QA from Multiple Seeds Strongly Linked by Knowledge Pointscited by 2
  11. 2024ARCON: Advancing Auto-Regressive Continuation for Driving Videoscited by 1
  12. 2025RoCo-Sim: Enhancing Roadside Collaborative Perception through Foreground Simulationcited by 0
  13. 2025MultiEditor: Controllable Multimodal Object Editing for Driving Scenarios Using 3D Gaussian Splatting Priorscited by 0
  14. 2025Reference-Guided Diffusion Inpainting For Multimodal Counterfactual Generationcited by 0
  15. 2026DrivePTS: A Progressive Learning Framework with Textual and Structural Enhancement for Driving Scene Generationcited by 0
  16. 2026On the Strengths and Weaknesses of Data for Open-set Embodied Assistancecited by 0
  17. 2026VistaGEN: Consistent Driving Video Generation with Fine-Grained Control Using Multiview Visual-Language Reasoningcited by 0
  18. 2026AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyondcited by 0
  19. 2026DriveCache: Action-Aware Caching for Driving World Model Inferencecited by 0
  20. 2026Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Viewscited by 0