mlsanityData to 7 Oct 2026

Fast 4D Mesh Generation by Spatio-Temporal Attention Chains

arXiv 2605.19786 ↗First posted 19 May 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

4D mesh generation has recently emerged as a powerful paradigm for recovering dynamic 3D structure from videos, but existing methods remain slow, computationally expensive, and difficult to scale to longer sequences. We introduce a training-free approach that accelerates 4D mesh generation while improving temporal correspondence quality. Our key observation is that temporal correspondences emerge inside a 4D backbone long before its generated meshes become visually accurate. We exploit this with a general framework we call Spatio-Temporal Attention Chain which propagates information across space and time. Starting from vertices on an anchor mesh, the chain maps vertices to latent tokens. It then follows temporal correspondences in latent space, and recovers frame-specific vertices through latent-to-vertex attention. This design avoids expensive explicit matching while preserving anchor mesh details and thereby improving dynamic mesh geometry and temporal consistency. Compared to state-of-the-art, our method generates a 4D mesh in 9 seconds, achieving a 13× speedup while producing higher-quality results. Moreover, our approach scales to videos up to 16× longer without degrading mesh quality. Beyond generation, the improved correspondences enable competitive zero-shot performance on two downstream tasks: 2D object tracking and 4D tracking. We further show that our framework enables reliable camera estimation, a capability not supported by prior 4D mesh generation methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 93 of its 101 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

93 of 101 references.

References · 93

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  5. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  6. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  7. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
  8. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  9. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  10. 2020Quantifying Attention Flow in Transformerscited by 759
  11. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  12. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
38 more
  1. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  2. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  3. 2025Continuous 3D Perception Model with Persistent Statecited by 527
  4. 2023CoTracker: It is Better to Track Togethercited by 516
  5. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  6. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  7. 2023Emergent Correspondence from Image Diffusioncited by 437
  8. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
  9. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
  10. 2021Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformerscited by 316
  11. 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
  12. 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
  13. 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
  14. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
  15. 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 215
  16. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
  17. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
  18. 2023Tracking Everything Everywhere All at Oncecited by 190
  19. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
  20. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
  21. 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
  22. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 143
  23. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
  24. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 124
  25. 2024Training-Free Consistent Text-to-Image Generationcited by 123
  26. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
  27. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  28. 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 115
  29. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  30. 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
  31. 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 99
  32. 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 93
  33. 2024Stereo4D: Learning How Things Move in 3D from Internet Stereo Videoscited by 89
  34. 2025Easi3R: Estimating Disentangled Motion from DUSt3R Without Trainingcited by 88
  35. 2025St4RTrack: Simultaneous 4D Reconstruction and Tracking in the Worldcited by 88
  36. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 85
  37. 2018Creatures great and SMAL: Recovering the shape and motion of animals from videocited by 84
  38. 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 84

50 most cited of 93 All 93 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.