mlsanityData to 7 Oct 2026

Turbo3D: Ultra-fast Text-to-3D Generation

arXiv 2412.04470 ↗First posted 5 Dec 2024cs.CVcited by 14

Not on the map. Why?

Abstract (arXiv)

We present Turbo3D, an ultra-fast text-to-3D system capable of generating high-quality Gaussian splatting assets in under one second. Turbo3D employs a rapid 4-step, 4-view diffusion generator and an efficient feed-forward Gaussian reconstructor, both operating in latent space. The 4-step, 4-view generator is a student model distilled through a novel Dual-Teacher approach, which encourages the student to learn view consistency from a multi-view teacher and photo-realism from a single-view teacher. By shifting the Gaussian reconstructor's inputs from pixel space to latent space, we eliminate the extra image decoding time and halve the transformer sequence length for maximum efficiency. Our method demonstrates superior 3D generation results compared to previous baselines, while operating in a fraction of their runtime.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 57 of its 64 references that are in the map. First posted on arXiv 5 Dec 2024.

Builds on

57 of 64 references.

References · 57

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2022Flow Matching for Generative Modelingcited by 5,426
  9. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  12. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
38 more
  1. 2023Consistency Modelscited by 1,778
  2. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  3. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  4. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  5. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  6. 2021Variational Diffusion Modelscited by 1,145
  7. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  8. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  9. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  10. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  11. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  12. 2022On Distillation of Guided Diffusion Modelscited by 721
  13. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  14. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  15. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  16. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  17. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  18. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  19. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  20. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  21. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  22. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
  23. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  24. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  25. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
  26. 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
  27. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
  28. 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
  29. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
  30. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 213
  31. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  32. 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
  33. 2023Scalable 3D Captioning with Pretrained Modelscited by 201
  34. 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANscited by 165
  35. 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
  36. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generationcited by 162
  37. 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
  38. 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Datacited by 113

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 7.

14 papers.

Sort:

By area: