mlsanityData to 7 Oct 2026

SyncTweedies: A General Generative Framework Based on Synchronized Diffusions

arXiv 2403.14370 ↗First posted 21 Mar 2024cs.CVcited by 26

Not on the map. Why?

Abstract (arXiv)

We introduce a general framework for generating diverse visual content, including ambiguous images, panorama images, mesh textures, and Gaussian splat textures, by synchronizing multiple diffusion processes. We present exhaustive investigation into all possible scenarios for synchronizing multiple diffusion processes through a canonical space and analyze their characteristics across applications. In doing so, we reveal a previously unexplored case: averaging the outputs of Tweedie's formula while conducting denoising in multiple instance spaces. This case also provides the best quality with the widest applicability to downstream tasks. We name this case SyncTweedies. In our experiments generating visual content aforementioned, we demonstrate the superior quality of generation by SyncTweedies compared to other synchronization methods, optimization-based and iterative-update-based methods.

Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 56 of its 75 references that are in the map. First posted on arXiv 21 Mar 2024.

Builds on

56 of 75 references.

References · 56

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2022Classifier-Free Diffusion Guidancecited by 5,717
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  9. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  11. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  12. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
38 more
  1. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  2. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  3. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  4. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  5. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  6. 2018Demystifying MMD GANscited by 1,268
  7. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  8. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  9. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  10. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  11. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  12. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  13. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  14. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  15. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  16. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  17. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  18. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  19. 2023Universal Guidance for Diffusion Modelscited by 426
  20. 2023Human Motion Diffusion as a Generative Priorcited by 354
  21. 2023Denoising Diffusion Models for Plug-and-Play Image Restorationcited by 335
  22. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  23. 2020Single-View View Synthesis with Multiplane Imagescited by 263
  24. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  25. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
  26. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
  27. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
  28. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  29. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  30. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
  31. 2023Delta Denoising Scorecited by 120
  32. 2022VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Modelscited by 112
  33. 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
  34. 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 100
  35. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
  36. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
  37. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  38. 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 13; 2026: 10.

26 papers.

Sort:

By area:

  1. 2024GrounDiT: Grounding Diffusion Transformers via Noisy Patch Transplantationcited by 24
  2. 2025VideoHandles: Editing 3D Object Compositions in Videos Using Video Generative Priorscited by 14
  3. 2024GenesisTex2: Stable, Consistent and High-Quality Text-to-Texture Generationcited by 8
  4. 2025StochSync: Stochastic Diffusion Synchronization for Image Generation in Arbitrary Spacescited by 8
  5. 2025LookingGlass: Generative Anamorphoses via Laplacian Pyramid Warpingcited by 7
  6. 2024MatchDiffusion: Training-free Generation of Match-cutscited by 5
  7. 2025Latent Swap Joint Diffusion for 2D Long-Form Latent Generationcited by 5
  8. 2025Toward Ambulatory Vision: Learning Visually-Grounded Active View Selectioncited by 5
  9. 2025MOSAIC: Generating Consistent, Privacy-Preserving Scenes from Multiple Depth Views in Multi-Room Environmentscited by 4
  10. 2025Coupled Diffusion Sampling for Training-Free Multi-View Image Editingcited by 4
  11. 2025Generative View Stitchingcited by 4
  12. 2025SyncSDE: A Probabilistic Framework for Diffusion Synchronizationcited by 3
14 more
  1. 2025TriTex: Learning Texture from a Single Mesh via Triplane Semantic Featurescited by 2
  2. 2025Refracting Reality: Generating Images with Realistic Transparent Objectscited by 2
  3. 2026Compositional Visual Planning via Inference-Time Diffusion Scalingcited by 2
  4. 2025GOATex: Geometry & Occlusion-Aware Texturingcited by 1
  5. 2025MatLat: Material Latent Space for PBR Texture Generationcited by 1
  6. 2026COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimationcited by 1
  7. 2026DisPOSE: Projected Polystochastic Diffusion for Self-Supervised Multi-View 3D Human Pose Estimationcited by 0
  8. 2026Variational Test-time Optimization for Diffusion Synchronizationcited by 0
  9. 2026Structure-Semantic Co-optimized Latent Diffusion Model for Fast Visual Anagram Synthesiscited by 0
  10. 2026JanusMesh: Fast and Zero-Shot 3D Visual Illusion Generation via Cross-Space Denoisingcited by 0
  11. 2026Accelerated Likelihood Maximization for Diffusion-based Versatile Content Generationcited by 0
  12. 2026AdaptiveSplat:Texture Aware Controllable 3D Gaussian Allocation for Feed-Forward Reconstructioncited by 0
  13. 2026JoLT: Joint Latent Trajectories for Context-Guided High-Resolution Tiled Generationcited by 0
  14. 2026Moore, Escher, Penrose: A Conformal Golden Braidcited by 0