mlsanityData to 14 Oct 2026

Feed-forward Motion In-betweening for Any 4D

arXiv 2606.22131 ↗First posted 20 Jun 2026cs.CVcited by 1

On the map: World models → Video-generation world models and simulators

also in 1 more
Abstract (arXiv)

4D dynamics (3D geometry evolving over time) is a fundamental representation of the physical world and plays a crucial role in world modeling (e.g., animation and games). Owing to the scarcity of large-scale, long-horizon 4D mesh data with arbitrary shapes, early text-to-4D methods rely on distillation or test-time optimization from video diffusion priors, making inference prohibitively slow. Recent feed-forward generators greatly reduce inference cost but offer limited spatiotemporal controllability, and short-horizon generation often leads to error accumulation in long-horizon sequences. We propose a novel feed-forward in-betweening framework for arbitrary 4D meshes with keyframe conditioning. Building on universal mesh-animation latents, we introduce a frame-wise mesh VAE that encodes each frame into topology-agnostic latent tokens anchored by a reference mesh for keyframe conditioning. We further introduce a keyframe-conditioned rectified flow model with an MMDiT backbone that synthesizes non-keyframe frames conditioned on sparse keyframes. Experiments show strong performance and improved controllability on both DyMesh16 and DyMesh32 benchmarks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 32 of its 62 references that are in the map. First posted on arXiv 20 Jun 2026.

Builds on

32 of 62 references.

References · 32

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  4. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  5. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  6. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  7. 2022Human Motion Diffusion Modelcited by 1,080
  8. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  9. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  10. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  11. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  12. 2022Flexible Diffusion Modeling of Long Videoscited by 294
20 more
  1. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 223
  2. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
  3. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  4. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  5. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 115
  6. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  7. 2020Convolutional Autoencoders for Human Motion Infillingcited by 73
  8. 2024Flexible Motion In-betweening with Diffusion Modelscited by 71
  9. 2024Controlling Space and Time with Diffusion Modelscited by 66
  10. 2024Efficient4D: Fast Dynamic 3D Object Generation from a Single-view Videocited by 44
  11. 2024Vidu4D: Single Generated Video to High-Fidelity 4D Reconstruction with Dynamic Gaussian Surfelscited by 38
  12. 2022Motion Inbetweening via Deep Delta-Interpolatorcited by 16
  13. 2025AR4D: Autoregressive 4D Generation from Monocular Videoscited by 16
  14. 2024Text-guided 3D Human Motion Generation with Keyframe-based Parallel Skip Transformercited by 9
  15. 2025SS4D: Native 4D Generative Model via Structured Spacetime Latentscited by 8
  16. 2025In-2-4D: Inbetweening from Two Single-View Images to 4D Generationcited by 7
  17. 2026Choreographing a World of Dynamic Objectscited by 5
  18. 2026ProjFlow: Projection Sampling with Flow Matching for Zero-Shot Exact Spatial Motion Controlcited by 5
  19. 2024Bayesian Hierarchical Modelling of Noisy Gamma Processes: Model Formulation, Identifiability, Model Fitting, and Extensions to Unit-to-Unit Variabilitycited by 1
  20. 2025Scalable Motion In-betweening via Diffusion and Physics-Based Character Adaptationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Drive Any Mesh: 4D Latent Diffusion for Mesh Deformation from Video
  2. 2024Learning Coherent Matrixized Representation in Latent Space for Volumetric 4D Generation
  3. 2026Mesh4D: 4D Mesh Reconstruction and Tracking from Monocular Video
  4. 20254DNeX: Feed-Forward 4D Generative Modeling Made Easy
  5. 2026Beyond Pixels: From Video Priors to 4D Worlds
  6. 2025AnimateAnyMesh: A Feed-Forward 4D Foundation Model for Text-Driven Universal Mesh Animation
  7. 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Models
  8. 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Mesh