mlsanityData to 7 Oct 2026

Consistency^2: Consistent and Fast 3D Painting with Latent Consistency Models

arXiv 2406.11202 ↗First posted 17 Jun 2024cs.CV cs.GRcited by 2

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Generative 3D Painting is among the top productivity boosters in high-resolution 3D asset management and recycling. Ever since text-to-image models became accessible for inference on consumer hardware, the performance of 3D Painting methods has consistently improved and is currently close to plateauing. At the core of most such models lies denoising diffusion in the latent space, an inherently time-consuming iterative process. Multiple techniques have been developed recently to accelerate generation and reduce sampling iterations by orders of magnitude. Designed for 2D generative imaging, these techniques do not come with recipes for lifting them into 3D. In this paper, we address this shortcoming by proposing a Latent Consistency Model (LCM) adaptation for the task at hand. We analyze the strengths and weaknesses of the proposed model and evaluate it quantitatively and qualitatively. Based on the Objaverse dataset samples study, our 3D painting method attains strong preference in all evaluations. Source code is available at https://github.com/kongdai123/consistency2.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 31 of its 34 references that are in the map. First posted on arXiv 17 Jun 2024.

Builds on

31 of 34 references.

Closest ancestors · 8

Same direction, newest first

  1. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference6 Oct
  2. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
  3. 2023Consistency Models2 Mar
  4. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  7. 2020Denoising Diffusion Implicit Models6 Oct
  8. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 23

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  3. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  4. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  5. 2018Demystifying MMD GANscited by 1,268
  6. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  7. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  8. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  9. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  10. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  11. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  12. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
11 more
  1. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
  2. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  3. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  4. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
  5. 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
  6. 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
  7. 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 100
  8. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
  9. 20233D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillationcited by 34
  10. 2023Breathing New Life into 3D Assets with Generative Repaintingcited by 17
  11. 2023Generative Powers of Tencited by 15

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Multi-scale Latent Point Consistency Models for 3D Shape Generation
  2. 20243D-Consistent Image Inpainting with Diffusion Models
  3. 2024TLCM: Training-efficient Latent Consistency Model for Image Generation with 2-8 Steps
  4. 2024Phased Consistency Models
  5. 2025Improved Training Technique for Latent Consistency Models
  6. 2024VividDreamer: Towards High-Fidelity and Efficient Text-to-3D Generation
  7. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Models
  8. 2024ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models