mlsanityData to 14 Oct 2026

Structural Energy-Guided Sampling for View-Consistent Text-to-3D

arXiv 2508.16917 ↗First posted 23 Aug 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Text-to-3D generation often suffers from the Janus problem, where objects look correct from the front but collapse into duplicated or distorted geometry from other angles. We attribute this failure to viewpoint bias in 2D diffusion priors, which propagates into 3D optimization. To address this, we propose Structural Energy-Guided Sampling (SEGS), a training-free, plug-and-play framework that enforces multi-view consistency entirely at sampling time. SEGS defines a structural energy in a PCA subspace of intermediate U-Net features and injects its gradients into the denoising trajectory, steering geometry toward the intended viewpoint while preserving appearance fidelity. Integrated seamlessly into SDS/VSD pipelines, SEGS significantly reduces Janus artifacts, achieving improved geometric alignment and viewpoint consistency without retraining or weight modification.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 34 of its 40 references that are in the map. First posted on arXiv 23 Aug 2025.

Builds on

34 of 40 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  8. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  9. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  10. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  11. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  12. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
22 more
  1. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  2. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  3. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  4. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  5. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  6. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  7. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  8. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
  9. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  10. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  11. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  12. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
  13. 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
  14. 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 91
  15. 2023Control3D: Towards Controllable Text-to-3D Generationcited by 46
  16. 2023DreamControl: Control-Based Text-to-3D Generation with 3D Self-Priorcited by 39
  17. 2023Debiasing Scores and Prompts of 2D Diffusion for View-consistent Text-to-3D Generationcited by 32
  18. 2024A Comprehensive Survey on 3D Content Generationcited by 28
  19. 2024Latent-based Diffusion Model for Long-tailed Recognitioncited by 14
  20. 2025Neural Radiance Fields for the Real World: A Surveycited by 12
  21. 2025GS-2DGS: Geometrically Supervised 2DGS for Reflective Object Reconstructioncited by 11
  22. 2024DGNS: Deformable Gaussian Splatting and Dynamic Neural Surface for Monocular Dynamic 3D Reconstructioncited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Structural Energy Guidance for View-Consistent Text-to-3D Generation
  2. 2024JointDreamer: Ensuring Geometry Consistency and Text Congruence in Text-to-3D Generation via Joint Score Distillation
  3. 2024VividDreamer: Towards High-Fidelity and Efficient Text-to-3D Generation
  4. 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Prior
  5. 2024Geometry-Aware Score Distillation via 3D Consistent Noising and Gradient Consistency Modeling
  6. 2024Improving Viewpoint Consistency in 3D Generation via Structure Feature and CLIP Guidance
  7. 2024Dual3D: Efficient and Consistent Text-to-3D Generation with Dual-mode Multi-view Latent Diffusion
  8. 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3D