TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesis
On the map: Diffusion models → Video generation
Abstract (arXiv)
The gradual nature of a diffusion process that synthesizes samples in small increments constitutes a key ingredient of Denoising Diffusion Probabilistic Models (DDPM), which have presented unprecedented quality in image synthesis and been recently explored in the motion domain. In this work, we propose to adapt the gradual diffusion concept (operating along a diffusion time-axis) into the temporal-axis of the motion sequence. Our key idea is to extend the DDPM framework to support temporally varying denoising, thereby entangling the two axes. Using our special formulation, we iteratively denoise a motion buffer that contains a set of increasingly-noised poses, which auto-regressively produces an arbitrarily long stream of frames. With a stationary diffusion time-axis, in each diffusion step we increment only the temporal-axis of the motion such that the framework produces a new, clean frame which is removed from the beginning of the buffer, followed by a newly drawn noise vector that is appended to it. This new mechanism paves the way towards a new framework for long-term motion synthesis with applications to character animation and other domains.
Key facts. Cited by 49 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 37 of its 60 references that are in the map. First posted on arXiv 27 Jul 2023.
Builds on
37 of 60 references.
Closest ancestors · 5
Same direction, newest first
- 2023Human Motion Diffusion as a Generative Prior2 Mar
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Model5 Dec
- 2022Human Motion Diffusion Model29 Sep
- 2022FLAME: Free-form Language-based Motion Synthesis & Editing1 Sep
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug
Other references · 32
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
20 more
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2014Show and Tell: A Neural Image Caption Generatorcited by 879
- 2015Unsupervised Learning of Video Representations using LSTMscited by 435
- 2022EDGE: Editable Dance Generation From Musiccited by 287
- 2021Robust Motion In-betweeningcited by 229
- 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
- 2015DRAW: A Recurrent Neural Network For Image Generationcited by 191
- 2021Character Controllers Using Motion VAEscited by 184
- 2020Skeleton-Aware Networks for Deep Motion Retargetingcited by 124
- 2018QuaterNet: A Quaternion-based Recurrent Model for Human Motioncited by 109
- 2020Unpaired Motion Style Transfer from Video to Animationcited by 94
- 2014Video (language) modeling: a baseline for generative models of natural videoscited by 92
- 2018Neural Kinematic Networks for Unsupervised Motion Retargettingcited by 88
- 2022Real-Time Style Modelling of Human Locomotion via Feature-Wise Transformations and Local Motion Phasescited by 72
- 2021Rhythm is a Dancer: Music-Driven Motion Synthesis with Global Structurecited by 53
- 2019MoGlow: Probabilistic and controllable motion synthesis using normalising flowscited by 47
- 2019Learning Character-Agnostic Motion for Motion Retargeting in 2Dcited by 45
- 2022Real-time Controllable Motion Transition for Characterscited by 29
- 2023Example-based Motion Synthesis via Generative Motion Matchingcited by 16
Built on by
Citing papers per year: 2023: 5; 2024: 14; 2025: 17; 2026: 13.
49 papers.
Sort:
By area:
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
- 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 138
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
- 2023State of the Art on Diffusion Models for Visual Computingcited by 127
- 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 114
- 2023Controllable Human-Object Interaction Synthesiscited by 109
- 2024Rolling Diffusion Modelscited by 104
- 2023HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Modelscited by 93
- 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
- 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 64
- 2024Streaming Diffusion Policy: Fast Policy Synthesis with Variable Noise Diffusion Modelscited by 56
37 more
- 2024One Diffusion to Generate Them Allcited by 41
- 2025Streaming Flow Policy: Simplifying diffusion/flow-matching policies by treating action trajectories as flow trajectoriescited by 39
- 2025Absolute Coordinates Make Motion Generation Easycited by 29
- 2025Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Controlcited by 28
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 27
- 2024ZeroHSI: Zero-Shot 4D Human-Scene Interaction by Video Generationcited by 25
- 2025SceneDiffuser++: City-Scale Traffic Simulation via a Generative World Modelcited by 20
- 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Controlcited by 13
- 2025Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Controlcited by 13
- 2025From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Modelscited by 11
- 2024FORCE: Physics-aware Human-object Interactioncited by 7
- 2025Zero-Shot Human-Object Interaction Synthesis with Multimodal Priorscited by 7
- 2026ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generationcited by 7
- 2025RA-DP: Rapid Adaptive Diffusion Policy for Training-Free High-frequency Robotics Replanningcited by 6
- 2025Compositional Flows for 3D Molecule and Synthesis Pathway Co-designcited by 6
- 2025HOI-PAGE: Zero-Shot Human-Object Interaction Generation with Part Affordance Guidancecited by 6
- 2026Unleashing Guidance Without Classifiers for Human-Object Interaction Animationcited by 6
- 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Sizecited by 5
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planningcited by 5
- 2025Diffusion Forcing for Multi-Agent Interaction Sequence Modelingcited by 4
- 2024COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Modelscited by 3
- 2025PUMPS: Skeleton-Agnostic Point-based Universal Motion Pre-Training for Synthesis in Human Motion Taskscited by 3
- 2025Rolling Ahead Diffusion for Traffic Scene Simulationcited by 2
- 2025Analytic Energy-Guided Policy Optimization for Offline Reinforcement Learningcited by 2
- 2025MoReact: Generating Reactive Motion from Textual Descriptionscited by 2
- 2026Inference-Time Scaling in Diffusion Models through Iterative Partial Refinementcited by 2
- 2026TacForcing: Streaming Action Generation with Execution-Time Tactile Feedbackcited by 2
- 2026InfiniteDance: Scalable 3D Dance Generation Towards in-the-wild Generalizationcited by 1
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcingcited by 1
- 2026GIRAF: Towards Generalizable Human Interactions with Articulated Objectscited by 1
- 2024RDM: Recurrent Diffusion Model for Human Motion Generationcited by 0
- 2025Step2Motion: Locomotion Reconstruction from Pressure Sensing Insolescited by 0
- 2025SeFA-Policy: Fast and Accurate Visuomotor Policy Learning with Selective Flow Alignmentcited by 0
- 2026FatigueFusion: Latent Space Fusion for Fatigue-Driven Motion Synthesiscited by 0
- 2026EgoForce: Robust Online Egocentric Motion Reconstruction via Diffusion Forcingcited by 0
- 2026PredActor: Predictive Action Diffusion for Steerable Onboard Humanoid Controlcited by 0
- 2026CleanMDM: Clean Motion Diffusion Model for Multimodal Motion Cleanupcited by 0
- 2026CleanMDM: Clean Motion Diffusion Model for Multimodal Motion Cleanup4 Oct 2026
- 2026PredActor: Predictive Action Diffusion for Steerable Onboard Humanoid Control21 Sep 2026
- 2026TacForcing: Streaming Action Generation with Execution-Time Tactile Feedback26 Aug 2026
- 2026ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation9 Jul 2026
- 2026GIRAF: Towards Generalizable Human Interactions with Articulated Objects8 Jul 2026
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcing27 May 2026
- 2026Inference-Time Scaling in Diffusion Models through Iterative Partial Refinement19 May 2026
- 2026EgoForce: Robust Online Egocentric Motion Reconstruction via Diffusion Forcing13 May 2026
- 2026FatigueFusion: Latent Space Fusion for Fatigue-Driven Motion Synthesis11 Apr 2026
- 2026Unleashing Guidance Without Classifiers for Human-Object Interaction Animation26 Mar 2026
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planning13 Mar 2026
- 2026InfiniteDance: Scalable 3D Dance Generation Towards in-the-wild Generalization10 Mar 2026
37 more
- 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Size9 Mar 2026
- 2025Diffusion Forcing for Multi-Agent Interaction Sequence Modeling19 Dec 2025
- 2025SeFA-Policy: Fast and Accurate Visuomotor Policy Learning with Selective Flow Alignment11 Nov 2025
- 2025Step2Motion: Locomotion Reconstruction from Pressure Sensing Insoles26 Oct 2025
- 2025MoReact: Generating Reactive Motion from Textual Descriptions28 Sep 2025
- 2025PUMPS: Skeleton-Agnostic Point-based Universal Motion Pre-Training for Synthesis in Human Motion Tasks27 Jul 2025
- 2025SceneDiffuser++: City-Scale Traffic Simulation via a Generative World Model27 Jun 2025
- 2025HOI-PAGE: Zero-Shot Human-Object Interaction Generation with Part Affordance Guidance8 Jun 2025
- 2025Streaming Flow Policy: Simplifying diffusion/flow-matching policies by treating action trajectories as flow trajectories28 May 2025
- 2025Absolute Coordinates Make Motion Generation Easy26 May 2025
- 2025Analytic Energy-Guided Policy Optimization for Offline Reinforcement Learning3 May 2025
- 2025Compositional Flows for 3D Molecule and Synthesis Pathway Co-design10 Apr 2025
- 2025From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Models7 Apr 2025
- 2025Zero-Shot Human-Object Interaction Synthesis with Multimodal Priors25 Mar 2025
- 2025Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Control14 Mar 2025
- 2025RA-DP: Rapid Adaptive Diffusion Policy for Training-Free High-frequency Robotics Replanning6 Mar 2025
- 2025Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Control18 Feb 2025
- 2025Rolling Ahead Diffusion for Traffic Scene Simulation13 Feb 2025
- 2024ZeroHSI: Zero-Shot 4D Human-Scene Interaction by Video Generation24 Dec 2024
- 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Control20 Dec 2024
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregression25 Nov 2024
- 2024One Diffusion to Generate Them All25 Nov 2024
- 2024COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Models30 Sep 2024
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Device20 Sep 2024
- 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wild14 Jun 2024
- 2024RDM: Recurrent Diffusion Model for Human Motion Generation11 Jun 2024
- 2024Streaming Diffusion Policy: Fast Policy Synthesis with Variable Noise Diffusion Models7 Jun 2024
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Training19 May 2024
- 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction28 Mar 2024
- 2024FORCE: Physics-aware Human-object Interaction17 Mar 2024
- 2024Rolling Diffusion Models12 Feb 2024
- 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generation16 Jan 2024
- 2023HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Models11 Dec 2023
- 2023Controllable Human-Object Interaction Synthesis6 Dec 2023
- 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generation27 Nov 2023
- 2023State of the Art on Diffusion Models for Visual Computing11 Oct 2023
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusion31 Aug 2023
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
- 2023State of the Art on Diffusion Models for Visual Computingcited by 127
- 2023Controllable Human-Object Interaction Synthesiscited by 109
- 2024Rolling Diffusion Modelscited by 104
- 2023HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Modelscited by 93
- 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 64
- 2024Streaming Diffusion Policy: Fast Policy Synthesis with Variable Noise Diffusion Modelscited by 56
- 2024One Diffusion to Generate Them Allcited by 41
- 2025Streaming Flow Policy: Simplifying diffusion/flow-matching policies by treating action trajectories as flow trajectoriescited by 39
- 2025Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Controlcited by 28
- 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Controlcited by 13
- 2025Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Controlcited by 13
12 most cited of 20 All 20 (JSON)
- 2026CleanMDM: Clean Motion Diffusion Model for Multimodal Motion Cleanup4 Oct 2026
- 2026PredActor: Predictive Action Diffusion for Steerable Onboard Humanoid Control21 Sep 2026
- 2025SeFA-Policy: Fast and Accurate Visuomotor Policy Learning with Selective Flow Alignment11 Nov 2025
- 2025Streaming Flow Policy: Simplifying diffusion/flow-matching policies by treating action trajectories as flow trajectories28 May 2025
- 2025Analytic Energy-Guided Policy Optimization for Offline Reinforcement Learning3 May 2025
- 2025Compositional Flows for 3D Molecule and Synthesis Pathway Co-design10 Apr 2025
- 2025Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Control14 Mar 2025
- 2025RA-DP: Rapid Adaptive Diffusion Policy for Training-Free High-frequency Robotics Replanning6 Mar 2025
- 2025Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Control18 Feb 2025
- 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Control20 Dec 2024
- 2024One Diffusion to Generate Them All25 Nov 2024
- 2024COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Models30 Sep 2024
12 newest of 20 All 20 (JSON)
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
- 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 138
- 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 114
- 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
- 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
- 2025Absolute Coordinates Make Motion Generation Easycited by 29
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 27
- 2024ZeroHSI: Zero-Shot 4D Human-Scene Interaction by Video Generationcited by 25
- 2025From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Modelscited by 11
- 2024FORCE: Physics-aware Human-object Interactioncited by 7
- 2025Zero-Shot Human-Object Interaction Synthesis with Multimodal Priorscited by 7
- 2026ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generationcited by 7
12 most cited of 27 All 27 (JSON)
- 2026TacForcing: Streaming Action Generation with Execution-Time Tactile Feedback26 Aug 2026
- 2026ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation9 Jul 2026
- 2026GIRAF: Towards Generalizable Human Interactions with Articulated Objects8 Jul 2026
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcing27 May 2026
- 2026EgoForce: Robust Online Egocentric Motion Reconstruction via Diffusion Forcing13 May 2026
- 2026FatigueFusion: Latent Space Fusion for Fatigue-Driven Motion Synthesis11 Apr 2026
- 2026Unleashing Guidance Without Classifiers for Human-Object Interaction Animation26 Mar 2026
- 2026ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planning13 Mar 2026
- 2026InfiniteDance: Scalable 3D Dance Generation Towards in-the-wild Generalization10 Mar 2026
- 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Size9 Mar 2026
- 2025Diffusion Forcing for Multi-Agent Interaction Sequence Modeling19 Dec 2025
- 2025Step2Motion: Locomotion Reconstruction from Pressure Sensing Insoles26 Oct 2025
12 newest of 27 All 27 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Controllable Longer Image Animation with Diffusion Models
- 2026Causal Motion Diffusion Models for Autoregressive Motion Generation
- 2024AnaMoDiff: 2D Analogical Motion Diffusion via Disentangled Denoising
- 2025Characterizing Motion Encoding in Video Diffusion Timesteps
- 2023Modiff: Action-Conditioned 3D Motion Generation with Denoising Diffusion Probabilistic Models
- 2025Time-to-Move: Training-Free Motion Controlled Video Generation via Dual-Clock Denoising
- 2023Single Motion Diffusion
- 2024Denoising Reuse: Exploiting Inter-frame Motion Consistency for Efficient Video Latent Generation