Focus, Align, and Diffuse: Time-Series-Aware Keyframe Diffusion for Cardiac Dynamic Synthesis from Sparse Observations
Not on the map. Why?
Abstract (arXiv)
Dense cardiac dynamics are essential for assessing cardiac function, yet in practice clinicians often observe only extremely sparse measurements. However, recovering full dynamics from such sparsity is a highly ill-posed problem due to the lack of temporal cues. While auxiliary time-series signals like ECG provide physiological guidance, effectively exploiting them is challenging due to the cross-modal representation gap and phase misalignment. In this work, we present CardioFAD, a Focus--Align--Diffuse paradigm that reformulates sparse cardiac dynamic synthesis as a recoverability--alignability anchor discovery problem. Our core insight is that resolving extreme temporal ambiguity requires a compact set of anchor states that are both sufficient to recover the visual trajectory and reliable for ECG--visual alignment. We therefore learn motion-salient keyframes under two complementary principles: trajectory sufficiency, which preserves trajectory-critical intra-modal motion content, and anchor alignment, which promotes consistent inter-modal correspondence at these anchors. We implement the Focus and Align modules optimized by the two aspects. Diffuse then performs two-stage generation by first synthesizing keyframes and subsequently interpolating the remaining frames. Extensive experiments on cardiac MRI and echocardiography videos demonstrate superior visual quality, temporal coherence, and improved functional consistency under the extreme one-shot regime.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 83 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
59 of 83 references.
References · 59
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
38 more
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
- 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 175
- 2025Adaptive Keyframe Sampling for Long Video Understandingcited by 167
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 117
- 2023VDT: General-purpose Video Diffusion Transformers via Mask Modelingcited by 103
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 98
- 2023TrailBlazer: Trajectory Control for Diffusion-Based Video Generationcited by 91
- 2025M-LLM Based Video Frame Selection for Efficient Video Understandingcited by 88
- 2025BOLT: Boost Large Vision-Language Model Without Training for Long-form Video Understandingcited by 75
- 2024Track4Gen: Teaching Video Diffusion Models to Track Points Improves Video Generationcited by 44
- 2025MDP3: A Training-free Approach for List-wise Frame Selection in Video-LLMscited by 43
- 2025FOCUS: Efficient Keyframe Selection for Long Video Understandingcited by 37
- 2025Logic-in-Frames: Dynamic Keyframe Search via Visual Semantic-Logical Verification for Long Video Understandingcited by 34
- 2025MotionPro: A Precise Motion Controller for Image-to-Video Generationcited by 30
- 2023LaMD: Latent Motion Diffusion for Image-Conditional Video Generationcited by 22
- 2024I2VControl: Disentangled and Unified Video Motion Synthesis Controlcited by 20
- 2024EchoNet-Synthetic: Privacy-preserving Video Generation for Safe Medical Data Sharingcited by 18
- 2024A personalized time-resolved 3D mesh generative model for unveiling normal heart dynamicscited by 18
- 2025LeanVAE: An Ultra-Efficient Reconstruction VAE for Video Diffusion Modelscited by 17
- 2024Data-Efficient Unsupervised Interpolation Without Any Intermediate Frame for 4D Medical Imagescited by 16
- 2025ReFoCUS: Reinforcement-guided Frame Optimization for Contextual Understandingcited by 16
- 2023Edit Temporal-Consistent Videos with Image Diffusion Modelcited by 12
- 2025KeyFace: Expressive Audio-Driven Facial Animation for Long Sequences via KeyFrame Interpolationcited by 11
- 2025VideoMiner: Iteratively Grounding Key Frames of Hour-Long Videos via Tree-based Group Relative Policy Optimizationcited by 11
- 2024Text-guided 3D Human Motion Generation with Keyframe-based Parallel Skip Transformercited by 9
- 2024ECHOPulse: ECG controlled echocardio-grams video generationcited by 9
- 2025CardiacFlow: 3D+t Four-Chamber Cardiac Shape Completion and Generation via Flow Matchingcited by 9
- 2025KeyVID: Keyframe-Aware Video Diffusion for Audio-Synchronized Visual Animationcited by 8
- 2025Versatile Cardiovascular Signal Generation with a Unified Diffusion Transformercited by 7
- 2025Global and Local Contrastive Learning for Joint Representations from Cardiac MRI and ECGcited by 6
- 2025FB-Diff: Fourier Basis-guided Diffusion for Temporal Interpolation of 4D Medical Imagingcited by 6
- 2025End-to-End 4D Heart Mesh Recovery Across Full-Stack and Sparse Cardiac MRIcited by 6
- 2025EchoFlow: A Foundation Model for Cardiac Ultrasound Image and Video Generationcited by 5
- 2025Language-Guided Temporal Token Pruning for Efficient VideoLLM Processingcited by 5
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.