AnimateAnyMesh: A Feed-Forward 4D Foundation Model for Text-Driven Universal Mesh Animation
Not on the map. Why?
Abstract (arXiv)
Recent advances in 4D content generation have attracted increasing attention, yet creating high-quality animated 3D models remains challenging due to the complexity of modeling spatio-temporal distributions and the scarcity of 4D training data. In this paper, we present AnimateAnyMesh, the first feed-forward framework that enables efficient text-driven animation of arbitrary 3D meshes. Our approach leverages a novel DyMeshVAE architecture that effectively compresses and reconstructs dynamic mesh sequences by disentangling spatial and temporal features while preserving local topological structures. To enable high-quality text-conditional generation, we employ a Rectified Flow-based training strategy in the compressed latent space. Additionally, we contribute the DyMesh Dataset, containing over 4M diverse dynamic mesh sequences with text annotations. Experimental results demonstrate that our method generates semantically accurate and temporally coherent mesh animations in a few seconds, significantly outperforming existing approaches in both quality and efficiency. Our work marks a substantial step forward in making 4D content creation more accessible and practical. All the data, code, and models will be open-released.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 72 of its 101 references that are in the map. First posted on arXiv 11 Jun 2025.
Builds on
72 of 101 references.
References · 72
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
38 more
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2022Human Motion Diffusion Modelcited by 1,080
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
- 2023Text-To-4D Dynamic Scene Generationcited by 205
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
- 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
50 most cited of 72 All 72 (JSON)
Built on by
Citing papers per year: 2025: 5; 2026: 27.
32 papers.
Sort:
By area:
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generationcited by 20
- 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusioncited by 16
- 2025AnimaX: Animating the Inanimate in 3D with Joint Video-Pose Diffusion Modelscited by 15
- 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesiscited by 15
- 2025SS4D: Native 4D Generative Model via Structured Spacetime Latentscited by 8
- 2025AnimaMimic: Imitating 3D Animation from Video Priorscited by 7
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenescited by 6
- 2026Choreographing a World of Dynamic Objectscited by 5
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visiblecited by 5
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026BiMotion: B-spline Motion for Text-guided Dynamic 3D Character Generationcited by 4
- 2026AnimateAnyMesh++: A Flexible Feed-Forward Framework for High-Fidelity Text-Driven Mesh Animationcited by 4
20 more
- 2026AniGen: Unified S3 Fields for Animatable 3D Asset Generationcited by 3
- 2026NeuROK: Generative 4D Neural Object Kinematicscited by 3
- 2026SPRig: Self-Supervised Pose-Invariant Rigging from Mesh Sequencescited by 1
- 2026MessyKitchens: Contact-rich object-level 3D scene reconstructioncited by 1
- 2026Fast 4D Mesh Generation by Spatio-Temporal Attention Chainscited by 1
- 2026Sketch2Motion: Text-driven 2D Sketch to 3D Animation via Diffusion-guided Skeleton Optimizationcited by 1
- 2026Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectoriescited by 1
- 2026AniGS: Bridging Rendering and Diffusion Prior for 3D Scene Animationcited by 1
- 2026UniMate: One Unified Model to Animate Diverse Skeletonscited by 1
- 2026Rigel3D: Rig-aware Latents for Animation-Ready 3D Asset Generationcited by 0
- 2026R-DMesh: Video-Guided 3D Animation via Rectified Dynamic Mesh Flowcited by 0
- 2026RePCM: Region-Specific and Phenotype-Adaptive Bi-Ventricular Cardiac Motion Synthesiscited by 0
- 2026PhyGenHOI: Physically-Aware 4D Generation of Dynamic Human-Object Interactionscited by 0
- 2026SkelMo: Universal Skeletal Motion Generation for 3D Rigged Shapescited by 0
- 2026Controllable Dynamic 3D Shape Generation via 3D Trajectories and Textcited by 0
- 2026AnimaSpark: A Feed-Forward Method for Animating Arbitrary 3D Objectscited by 0
- 2026Learning to Beat: Phenotype-Guided Latent Flow with Regional Motion Priors for Biventricular Motion Synthesiscited by 0
- 2026ArtiMo: Agent-Driven Articulated Mesh Animationcited by 0
- 2026BLARM: Animating 3D Objects from Video via Blending Latent Rigid Motion Primitivescited by 0
- 2026Cepheid: Decoupling Scale from Structure for Cross-Family Motion Completioncited by 0
- 2026Cepheid: Decoupling Scale from Structure for Cross-Family Motion Completion13 Oct 2026
- 2026UniMate: One Unified Model to Animate Diverse Skeletons4 Sep 2026
- 2026BLARM: Animating 3D Objects from Video via Blending Latent Rigid Motion Primitives31 Aug 2026
- 2026ArtiMo: Agent-Driven Articulated Mesh Animation21 Aug 2026
- 2026Learning to Beat: Phenotype-Guided Latent Flow with Regional Motion Priors for Biventricular Motion Synthesis20 Aug 2026
- 2026AniGS: Bridging Rendering and Diffusion Prior for 3D Scene Animation20 Jul 2026
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenes30 Jun 2026
- 2026Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectories24 Jun 2026
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible11 Jun 2026
- 2026AnimaSpark: A Feed-Forward Method for Animating Arbitrary 3D Objects9 Jun 2026
- 2026Controllable Dynamic 3D Shape Generation via 3D Trajectories and Text3 Jun 2026
- 2026SkelMo: Universal Skeletal Motion Generation for 3D Rigged Shapes1 Jun 2026
20 more
- 2026NeuROK: Generative 4D Neural Object Kinematics28 May 2026
- 2026PhyGenHOI: Physically-Aware 4D Generation of Dynamic Human-Object Interactions28 May 2026
- 2026Sketch2Motion: Text-driven 2D Sketch to 3D Animation via Diffusion-guided Skeleton Optimization27 May 2026
- 2026RePCM: Region-Specific and Phenotype-Adaptive Bi-Ventricular Cardiac Motion Synthesis20 May 2026
- 2026Fast 4D Mesh Generation by Spatio-Temporal Attention Chains19 May 2026
- 2026R-DMesh: Video-Guided 3D Animation via Rectified Dynamic Mesh Flow13 May 2026
- 2026Rigel3D: Rig-aware Latents for Animation-Ready 3D Asset Generation13 May 2026
- 2026AnimateAnyMesh++: A Flexible Feed-Forward Framework for High-Fidelity Text-Driven Mesh Animation29 Apr 2026
- 2026AniGen: Unified S3 Fields for Animatable 3D Asset Generation9 Apr 2026
- 2026MessyKitchens: Contact-rich object-level 3D scene reconstruction17 Mar 2026
- 2026BiMotion: B-spline Motion for Text-guided Dynamic 3D Character Generation21 Feb 2026
- 2026SPRig: Self-Supervised Pose-Invariant Rigging from Mesh Sequences13 Feb 2026
- 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusion22 Jan 2026
- 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesis20 Jan 2026
- 2026Choreographing a World of Dynamic Objects7 Jan 2026
- 2025SS4D: Native 4D Generative Model via Structured Spacetime Latents16 Dec 2025
- 2025AnimaMimic: Imitating 3D Animation from Video Priors16 Dec 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generation29 Sep 2025
- 2025AnimaX: Animating the Inanimate in 3D with Joint Video-Pose Diffusion Models24 Jun 2025
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generationcited by 20
- 2025AnimaX: Animating the Inanimate in 3D with Joint Video-Pose Diffusion Modelscited by 15
- 2025AnimaMimic: Imitating 3D Animation from Video Priorscited by 7
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visiblecited by 5
- 2026AniGS: Bridging Rendering and Diffusion Prior for 3D Scene Animationcited by 1
- 2026R-DMesh: Video-Guided 3D Animation via Rectified Dynamic Mesh Flowcited by 0
- 2026AniGS: Bridging Rendering and Diffusion Prior for 3D Scene Animation20 Jul 2026
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible11 Jun 2026
- 2026R-DMesh: Video-Guided 3D Animation via Rectified Dynamic Mesh Flow13 May 2026
- 2025AnimaMimic: Imitating 3D Animation from Video Priors16 Dec 2025
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generation29 Sep 2025
- 2025AnimaX: Animating the Inanimate in 3D with Joint Video-Pose Diffusion Models24 Jun 2025
- 2026ArtiMo: Agent-Driven Articulated Mesh Animationcited by 0
- 2026ArtiMo: Agent-Driven Articulated Mesh Animation21 Aug 2026
- 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusioncited by 16
- 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesiscited by 15
- 2025SS4D: Native 4D Generative Model via Structured Spacetime Latentscited by 8
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenescited by 6
- 2026Choreographing a World of Dynamic Objectscited by 5
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026BiMotion: B-spline Motion for Text-guided Dynamic 3D Character Generationcited by 4
- 2026AnimateAnyMesh++: A Flexible Feed-Forward Framework for High-Fidelity Text-Driven Mesh Animationcited by 4
- 2026AniGen: Unified S3 Fields for Animatable 3D Asset Generationcited by 3
- 2026NeuROK: Generative 4D Neural Object Kinematicscited by 3
- 2026SPRig: Self-Supervised Pose-Invariant Rigging from Mesh Sequencescited by 1
- 2026MessyKitchens: Contact-rich object-level 3D scene reconstructioncited by 1
12 most cited of 25 All 25 (JSON)
- 2026Cepheid: Decoupling Scale from Structure for Cross-Family Motion Completion13 Oct 2026
- 2026UniMate: One Unified Model to Animate Diverse Skeletons4 Sep 2026
- 2026BLARM: Animating 3D Objects from Video via Blending Latent Rigid Motion Primitives31 Aug 2026
- 2026Learning to Beat: Phenotype-Guided Latent Flow with Regional Motion Priors for Biventricular Motion Synthesis20 Aug 2026
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenes30 Jun 2026
- 2026Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectories24 Jun 2026
- 2026AnimaSpark: A Feed-Forward Method for Animating Arbitrary 3D Objects9 Jun 2026
- 2026Controllable Dynamic 3D Shape Generation via 3D Trajectories and Text3 Jun 2026
- 2026SkelMo: Universal Skeletal Motion Generation for 3D Rigged Shapes1 Jun 2026
- 2026NeuROK: Generative 4D Neural Object Kinematics28 May 2026
- 2026PhyGenHOI: Physically-Aware 4D Generation of Dynamic Human-Object Interactions28 May 2026
- 2026Sketch2Motion: Text-driven 2D Sketch to 3D Animation via Diffusion-guided Skeleton Optimization27 May 2026
12 newest of 25 All 25 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024CT4D: Consistent Text-to-4D Generation with Animatable Meshes
- 2025TextMesh4D: Zero-shot Text-to-4D Mesh Generation
- 2026SkelGen4D: Weakly-Supervised Skeleton-Based 4D Generation for Text-Driven Mesh Animation
- 2026Feed-forward Motion In-betweening for Any 4D
- 2025Drive Any Mesh: 4D Latent Diffusion for Mesh Deformation from Video
- 2024Bringing Objects to Life: training-free 4D generation from 3D objects through view consistent noise
- 20254-Doodle: Text to 3D Sketches that Move!
- 2024Learning Coherent Matrixized Representation in Latent Space for Volumetric 4D Generation