TextMesh4D: Zero-shot Text-to-4D Mesh Generation
Not on the map. Why?
Abstract (arXiv)
Large-scale, high-quality dynamic 3D (4D) assets are essential for learning physically grounded representations, but remain costly to capture and annotate at scale. This limits the viability of supervised 4D learning and motivates zero-shot text-to-4D generation leveraging pretrained diffusion priors. To model complex dynamics, prior methods typically adopt implicit 3D representations (e.g., NeRFs or 3DGS) for their deformation capacity. However, their implicit nature provides limited control over surface topology, which hinders high-fidelity geometry and makes temporally coherent surface reconstruction challenging. To address these limitations, we explore zero-shot text-to-4D mesh generation. However, a structural mismatch arises when combining diffusion-based guidance with topology-constrained meshes: the guidance is noisy and spatially inconsistent, while meshes impose severe topological constraints, making direct vertex-level deformation unstable. In this paper, we introduce TextMesh4D, the first zero-shot framework for text-to-4D that directly generates dynamic meshes by addressing the above challenge at two complementary levels. Geometrically, we shift deformation modeling from vertices to faces via a Jacobian Deformation Field (JDF), enabling topology-aware surface reconstruction through an integrability-enforcing integration formulation. Semantically, we propose a Local-Global Semantic Regularizer (LGSR) that preserves identity over time by jointly constraining local deformation plausibility and global shape consistency. Extensive experiments demonstrate state-of-the-art temporal consistency, structural fidelity, and visual quality, while remaining efficient on a single 24GB GPU.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 70 references that are in the map. First posted on arXiv 30 Jun 2025.
Builds on
52 of 70 references.
References · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
38 more
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2023Text-To-4D Dynamic Scene Generationcited by 205
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
- 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
- 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
- 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
- 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
- 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
- 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
- 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
- 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
- 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
- 2023A Unified Approach for Text- and Image-guided 4D Scene Generationcited by 82
- 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generationcited by 81
- 2024TC4D: Trajectory-Conditioned Text-to-4D Generationcited by 77
- 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2022Understanding Pure CLIP Guidance for Voxel Grid NeRF Modelscited by 56
- 2024Comp4D: LLM-Guided Compositional 4D Scene Generationcited by 50
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025AnimateAnyMesh: A Feed-Forward 4D Foundation Model for Text-Driven Universal Mesh Animation
- 2024Tex4D: Zero-shot 4D Scene Texturing with Video Diffusion Models
- 2024DreamMesh: Jointly Manipulating and Texturing Triangle Meshes for Text-to-3D Generation
- 20244Dynamic: Text-to-4D Generation with Hybrid Priors
- 2026Feed-forward Motion In-betweening for Any 4D
- 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusion
- 2026Resonance4D: Frequency-Domain Motion Supervision for Preset-Free Physical Parameter Learning in 4D Dynamic Physical Scene Simulation
- 2024Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior