Helix4D: Complex 4D Mesh Generation
Not on the map. Why?
Abstract (arXiv)
Current video-to-4D methods struggle with complex topology changes, transparent materials, thin structures, and inner surfaces. We present Helix4D, a dynamic mesh generation framework by inheriting the expressive representation of Trellis2, adapting it from image-to-3D to video-conditioned 4D generation. Our design arises from two key questions: (a) how to enable Trellis2's frame-local attention to share information across frames while preserving its pretrained quality on rare cases such as transparent objects and inner surfaces, and (b) how to inject temporal information into a purely 3D positional encoding without breaking pretrained capabilities. We address (a) with a sliding-window cross-frame attention and anchor on the first frame. The first frame is generated by the base Trellis2 model and injected into our model, letting it inherit Trellis2's quality in rare cases through cross-frame attention. We address (b) with a 4D temporal encoding that repurposes redundant low-frequency spatial RoPE bands for time, extending the encoding from 3D with no additional parameters. Extensive experiments show the effectiveness of Helix4D for high-quality dynamic mesh generation on ActionBench and our own challenging complex dynamics set.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 46 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
42 of 46 references.
References · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 237
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
- 2023Text-To-4D Dynamic Scene Generationcited by 205
30 more
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
- 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 161
- 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
- 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 125
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
- 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
- 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 110
- 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
- 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
- 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 87
- 2023A Unified Approach for Text- and Image-guided 4D Scene Generationcited by 82
- 2023GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learningcited by 63
- 2025SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generationcited by 48
- 2025TexVerse: A Universe of 3D Objects with High-Resolution Texturescited by 45
- 2024Vidu4D: Single Generated Video to High-Fidelity 4D Reconstruction with Dynamic Gaussian Surfelscited by 38
- 2025Free4D: Tuning-free 4D Scene Generation with Spatial-Temporal Consistencycited by 35
- 2025V2M4: 4D Mesh Animation Reconstruction from a Single Monocular Videocited by 33
- 2025Gaussian Variation Field Diffusion for High-fidelity Video-to-4D Synthesiscited by 33
- 2025ShapeGen4D: Towards High Quality 4D Shape Generation from Videoscited by 21
- 2025Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Modelscited by 17
- 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusioncited by 16
- 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesiscited by 15
- 2026ReRoPE: Repurposing RoPE for Relative Camera Controlcited by 13
- 2026Mesh4D: 4D Mesh Reconstruction and Tracking from Monocular Videocited by 12
- 2025SS4D: Native 4D Generative Model via Structured Spacetime Latentscited by 8
- 2026Sculpt4D: Generating 4D Shapes via Sparse-Attention Diffusion Transformerscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.