mlsanityData to 14 Oct 2026

TextMesh4D: Zero-shot Text-to-4D Mesh Generation

arXiv 2506.24121 ↗First posted 30 Jun 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Large-scale, high-quality dynamic 3D (4D) assets are essential for learning physically grounded representations, but remain costly to capture and annotate at scale. This limits the viability of supervised 4D learning and motivates zero-shot text-to-4D generation leveraging pretrained diffusion priors. To model complex dynamics, prior methods typically adopt implicit 3D representations (e.g., NeRFs or 3DGS) for their deformation capacity. However, their implicit nature provides limited control over surface topology, which hinders high-fidelity geometry and makes temporally coherent surface reconstruction challenging. To address these limitations, we explore zero-shot text-to-4D mesh generation. However, a structural mismatch arises when combining diffusion-based guidance with topology-constrained meshes: the guidance is noisy and spatially inconsistent, while meshes impose severe topological constraints, making direct vertex-level deformation unstable. In this paper, we introduce TextMesh4D, the first zero-shot framework for text-to-4D that directly generates dynamic meshes by addressing the above challenge at two complementary levels. Geometrically, we shift deformation modeling from vertices to faces via a Jacobian Deformation Field (JDF), enabling topology-aware surface reconstruction through an integrability-enforcing integration formulation. Semantically, we propose a Local-Global Semantic Regularizer (LGSR) that preserves identity over time by jointly constraining local deformation plausibility and global shape consistency. Extensive experiments demonstrate state-of-the-art temporal consistency, structural fidelity, and visual quality, while remaining efficient on a single 24GB GPU.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 70 references that are in the map. First posted on arXiv 30 Jun 2025.

Builds on

52 of 70 references.

References · 52

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  8. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  9. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  10. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  11. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  12. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
38 more
  1. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  2. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  3. 2023ModelScope Text-to-Video Technical Reportcited by 658
  4. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  5. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  6. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  7. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  8. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  9. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  10. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  11. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  12. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  13. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  14. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
  15. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
  16. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  17. 2023Text-To-4D Dynamic Scene Generationcited by 205
  18. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
  19. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
  20. 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
  21. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  22. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
  23. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
  24. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
  25. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
  26. 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
  27. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
  28. 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
  29. 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
  30. 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
  31. 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
  32. 2023A Unified Approach for Text- and Image-guided 4D Scene Generationcited by 82
  33. 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generationcited by 81
  34. 2024TC4D: Trajectory-Conditioned Text-to-4D Generationcited by 77
  35. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
  36. 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
  37. 2022Understanding Pure CLIP Guidance for Voxel Grid NeRF Modelscited by 56
  38. 2024Comp4D: LLM-Guided Compositional 4D Scene Generationcited by 50

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025AnimateAnyMesh: A Feed-Forward 4D Foundation Model for Text-Driven Universal Mesh Animation
  2. 2024Tex4D: Zero-shot 4D Scene Texturing with Video Diffusion Models
  3. 2024DreamMesh: Jointly Manipulating and Texturing Triangle Meshes for Text-to-3D Generation
  4. 20244Dynamic: Text-to-4D Generation with Hybrid Priors
  5. 2026Feed-forward Motion In-betweening for Any 4D
  6. 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusion
  7. 2026Resonance4D: Frequency-Domain Motion Supervision for Preset-Free Physical Parameter Learning in 4D Dynamic Physical Scene Simulation
  8. 2024Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior