Hyper-3DG: Text-to-3D Gaussian Generation via Hypergraph
Not on the map. Why?
Abstract (arXiv)
Text-to-3D generation represents an exciting field that has seen rapid advancements, facilitating the transformation of textual descriptions into detailed 3D models. However, current progress often neglects the intricate high-order correlation of geometry and texture within 3D objects, leading to challenges such as over-smoothness, over-saturation and the Janus problem. In this work, we propose a method named ``3D Gaussian Generation via Hypergraph (Hyper-3DG)'', designed to capture the sophisticated high-order correlations present within 3D objects. Our framework is anchored by a well-established mainflow and an essential module, named ``Geometry and Texture Hypergraph Refiner (HGRefiner)''. This module not only refines the representation of 3D Gaussians but also accelerates the update process of these 3D Gaussians by conducting the Patch-3DGS Hypergraph Learning on both explicit attributes and latent visual features. Our framework allows for the production of finely generated 3D objects within a cohesive optimization, effectively circumventing degradation. Extensive experimentation has shown that our proposed method significantly enhances the quality of 3D generation while incurring no additional computational overhead for the underlying framework. (Project code: https://github.com/yjhboy/Hyper3DG)
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 45 of its 80 references that are in the map. First posted on arXiv 14 Mar 2024.
Builds on
45 of 80 references.
References · 45
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2017Graph Attention Networkscited by 8,854
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
33 more
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2018Hypergraph Neural Networkscited by 482
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2019Hypergraph Convolution and Hypergraph Attentioncited by 226
- 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 157
- 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
- 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
- 2023DreamControl: Control-Based Text-to-3D Generation with 3D Self-Priorcited by 39
- 2023Debiasing Scores and Prompts of 2D Diffusion for View-consistent Text-to-3D Generationcited by 32
- 2017Inhomogeneous Hypergraph Clustering with Applicationscited by 31
- 2023GeoDream: Disentangling 2D and Geometric Priors for High-Fidelity and Consistent 3D Generationcited by 30
- 2020Hypergraph Spectral Analysis and Processing in 3D Point Cloudcited by 14
- 2020Hypergraph Learning for Identification of COVID-19 with CT Imagingcited by 6
- 2024BoostDream: Efficient Refining for High-Quality Text-to-3D Generation from Multi-View Diffusioncited by 6
- 2023Clustered-patch Element Connection for Few-shot Learningcited by 4
Built on by
Citing papers per year: 2024: 7; 2025: 9; 2026: 5.
21 papers.
Sort:
By area:
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2024GRPose: Learning Graph Relations for Human Image Generation with Pose Priorscited by 14
- 20253DGen-Bench: Comprehensive Benchmark Suite for 3D Generative Modelscited by 12
- 2024A General Framework to Boost 3D GS Initialization for Text-to-3D Generation by Lexical Richnesscited by 8
- 2024DH-FaceVid-1K: A Large-Scale High-Quality Dataset for Face Video Generationcited by 8
- 2024TV-3DG: Mastering Text-to-3D Customized Generation with Visual Promptcited by 8
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2025SoftHGNN: Soft Hypergraph Neural Networks for General Visual Recognitioncited by 4
- 2025EverybodyDance: Bipartite Graph-Based Identity Correspondence for Multi-Character Animationcited by 3
- 2024Advancing Prompt Learning through an External Layercited by 2
9 more
- 2025ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generationcited by 2
- 2025Towards Fine-Grained Text-to-3D Quality Assessment: A Benchmark and A Two-Stage Rank-Learning Metriccited by 2
- 2026HiFi-Mesh: High-Fidelity Efficient 3D Mesh Generation via Compact Autoregressive Dependencecited by 2
- 2025EHGCN: Hierarchical Euclidean-Hyperbolic Fusion via Motion-Aware GCN for Hybrid Event Stream Perceptioncited by 1
- 2025Debiasing Diffusion Priors via 3D Attention for Consistent Gaussian Splattingcited by 1
- 2026GTA: Advancing Image-to-3D World Generation via Geometry Then Appearance Video Diffusioncited by 1
- 2026PnP-U3D: Plug-and-Play 3D Framework Bridging Autoregression and Diffusion for Unified Understanding and Generationcited by 0
- 2026ForgeDreamer: Industrial Text-to-3D Generation with Multi-Expert LoRA and Cross-View Hypergraphcited by 0
- 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillationcited by 0
- 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillation20 May 2026
- 2026GTA: Advancing Image-to-3D World Generation via Geometry Then Appearance Video Diffusion13 May 2026
- 2026ForgeDreamer: Industrial Text-to-3D Generation with Multi-Expert LoRA and Cross-View Hypergraph10 Mar 2026
- 2026PnP-U3D: Plug-and-Play 3D Framework Bridging Autoregression and Diffusion for Unified Understanding and Generation3 Feb 2026
- 2026HiFi-Mesh: High-Fidelity Efficient 3D Mesh Generation via Compact Autoregressive Dependence29 Jan 2026
- 2025EverybodyDance: Bipartite Graph-Based Identity Correspondence for Multi-Character Animation18 Dec 2025
- 2025Debiasing Diffusion Priors via 3D Attention for Consistent Gaussian Splatting8 Dec 2025
- 2025Towards Fine-Grained Text-to-3D Quality Assessment: A Benchmark and A Two-Stage Rank-Learning Metric28 Sep 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025SoftHGNN: Soft Hypergraph Neural Networks for General Visual Recognition21 May 2025
- 2025EHGCN: Hierarchical Euclidean-Hyperbolic Fusion via Motion-Aware GCN for Hybrid Event Stream Perception23 Apr 2025
- 2025Digital Twin Generation from Visual Data: A Survey17 Apr 2025
9 more
- 2025ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generation3 Apr 2025
- 20253DGen-Bench: Comprehensive Benchmark Suite for 3D Generative Models27 Mar 2025
- 2024TV-3DG: Mastering Text-to-3D Customized Generation with Visual Prompt16 Oct 2024
- 2024DH-FaceVid-1K: A Large-Scale High-Quality Dataset for Face Video Generation23 Sep 2024
- 2024GRPose: Learning Graph Relations for Human Image Generation with Pose Priors29 Aug 2024
- 2024A General Framework to Boost 3D GS Initialization for Text-to-3D Generation by Lexical Richness2 Aug 2024
- 2024Advancing Prompt Learning through an External Layer29 Jul 2024
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunities24 Jul 2024
- 2024Recent Advances in 3D Gaussian Splatting17 Mar 2024
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 20253DGen-Bench: Comprehensive Benchmark Suite for 3D Generative Modelscited by 12
- 2024A General Framework to Boost 3D GS Initialization for Text-to-3D Generation by Lexical Richnesscited by 8
- 2024DH-FaceVid-1K: A Large-Scale High-Quality Dataset for Face Video Generationcited by 8
- 2024TV-3DG: Mastering Text-to-3D Customized Generation with Visual Promptcited by 8
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2025SoftHGNN: Soft Hypergraph Neural Networks for General Visual Recognitioncited by 4
- 2025EverybodyDance: Bipartite Graph-Based Identity Correspondence for Multi-Character Animationcited by 3
- 2025ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generationcited by 2
- 2025Towards Fine-Grained Text-to-3D Quality Assessment: A Benchmark and A Two-Stage Rank-Learning Metriccited by 2
12 most cited of 15 All 15 (JSON)
- 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillation20 May 2026
- 2026HiFi-Mesh: High-Fidelity Efficient 3D Mesh Generation via Compact Autoregressive Dependence29 Jan 2026
- 2025EverybodyDance: Bipartite Graph-Based Identity Correspondence for Multi-Character Animation18 Dec 2025
- 2025Towards Fine-Grained Text-to-3D Quality Assessment: A Benchmark and A Two-Stage Rank-Learning Metric28 Sep 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025SoftHGNN: Soft Hypergraph Neural Networks for General Visual Recognition21 May 2025
- 2025EHGCN: Hierarchical Euclidean-Hyperbolic Fusion via Motion-Aware GCN for Hybrid Event Stream Perception23 Apr 2025
- 2025Digital Twin Generation from Visual Data: A Survey17 Apr 2025
- 2025ConsDreamer: Advancing Multi-View Consistency for Zero-Shot Text-to-3D Generation3 Apr 2025
- 20253DGen-Bench: Comprehensive Benchmark Suite for 3D Generative Models27 Mar 2025
- 2024TV-3DG: Mastering Text-to-3D Customized Generation with Visual Prompt16 Oct 2024
- 2024DH-FaceVid-1K: A Large-Scale High-Quality Dataset for Face Video Generation23 Sep 2024
12 newest of 15 All 15 (JSON)