Fast 4D Mesh Generation by Spatio-Temporal Attention Chains
Not on the map. Why?
Abstract (arXiv)
4D mesh generation has recently emerged as a powerful paradigm for recovering dynamic 3D structure from videos, but existing methods remain slow, computationally expensive, and difficult to scale to longer sequences. We introduce a training-free approach that accelerates 4D mesh generation while improving temporal correspondence quality. Our key observation is that temporal correspondences emerge inside a 4D backbone long before its generated meshes become visually accurate. We exploit this with a general framework we call Spatio-Temporal Attention Chain which propagates information across space and time. Starting from vertices on an anchor mesh, the chain maps vertices to latent tokens. It then follows temporal correspondences in latent space, and recovers frame-specific vertices through latent-to-vertex attention. This design avoids expensive explicit matching while preserving anchor mesh details and thereby improving dynamic mesh geometry and temporal consistency. Compared to state-of-the-art, our method generates a 4D mesh in 9 seconds, achieving a 13× speedup while producing higher-quality results. Moreover, our approach scales to videos up to 16× longer without degrading mesh quality. Beyond generation, the improved correspondences enable competitive zero-shot performance on two downstream tasks: 2D object tracking and 4D tracking. We further show that our framework enables reliable camera estimation, a capability not supported by prior 4D mesh generation methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 93 of its 101 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
93 of 101 references.
References · 93
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2020Quantifying Attention Flow in Transformerscited by 759
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
38 more
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2023CoTracker: It is Better to Track Togethercited by 516
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
- 2021Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformerscited by 316
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 215
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
- 2023Tracking Everything Everywhere All at Oncecited by 190
- 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
- 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 143
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
- 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 124
- 2024Training-Free Consistent Text-to-Image Generationcited by 123
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
- 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 115
- 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
- 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
- 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 99
- 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 93
- 2024Stereo4D: Learning How Things Move in 3D from Internet Stereo Videoscited by 89
- 2025Easi3R: Estimating Disentangled Motion from DUSt3R Without Trainingcited by 88
- 2025St4RTrack: Simultaneous 4D Reconstruction and Tracking in the Worldcited by 88
- 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 85
- 2018Creatures great and SMAL: Recovering the shape and motion of animals from videocited by 84
- 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 84
50 most cited of 93 All 93 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.