mlsanityData to 14 Oct 2026

Focus, Align, and Diffuse: Time-Series-Aware Keyframe Diffusion for Cardiac Dynamic Synthesis from Sparse Observations

arXiv 2610.19050 ↗First posted 13 Oct 2026eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Dense cardiac dynamics are essential for assessing cardiac function, yet in practice clinicians often observe only extremely sparse measurements. However, recovering full dynamics from such sparsity is a highly ill-posed problem due to the lack of temporal cues. While auxiliary time-series signals like ECG provide physiological guidance, effectively exploiting them is challenging due to the cross-modal representation gap and phase misalignment. In this work, we present CardioFAD, a Focus--Align--Diffuse paradigm that reformulates sparse cardiac dynamic synthesis as a recoverability--alignability anchor discovery problem. Our core insight is that resolving extreme temporal ambiguity requires a compact set of anchor states that are both sufficient to recover the visual trajectory and reliable for ECG--visual alignment. We therefore learn motion-salient keyframes under two complementary principles: trajectory sufficiency, which preserves trajectory-critical intra-modal motion content, and anchor alignment, which promotes consistent inter-modal correspondence at these anchors. We implement the Focus and Align modules optimized by the two aspects. Diffuse then performs two-stage generation by first synthesizing keyframes and subsequently interpolating the remaining frames. Extensive experiments on cardiac MRI and echocardiography videos demonstrate superior visual quality, temporal coherence, and improved functional consistency under the extreme one-shot regime.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 83 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

59 of 83 references.

References · 59

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  7. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  8. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  9. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  10. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
  11. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  12. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
38 more
  1. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
  2. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 175
  3. 2025Adaptive Keyframe Sampling for Long Video Understandingcited by 167
  4. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
  5. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  6. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
  7. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
  8. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 117
  9. 2023VDT: General-purpose Video Diffusion Transformers via Mask Modelingcited by 103
  10. 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 98
  11. 2023TrailBlazer: Trajectory Control for Diffusion-Based Video Generationcited by 91
  12. 2025M-LLM Based Video Frame Selection for Efficient Video Understandingcited by 88
  13. 2025BOLT: Boost Large Vision-Language Model Without Training for Long-form Video Understandingcited by 75
  14. 2024Track4Gen: Teaching Video Diffusion Models to Track Points Improves Video Generationcited by 44
  15. 2025MDP3: A Training-free Approach for List-wise Frame Selection in Video-LLMscited by 43
  16. 2025FOCUS: Efficient Keyframe Selection for Long Video Understandingcited by 37
  17. 2025Logic-in-Frames: Dynamic Keyframe Search via Visual Semantic-Logical Verification for Long Video Understandingcited by 34
  18. 2025MotionPro: A Precise Motion Controller for Image-to-Video Generationcited by 30
  19. 2023LaMD: Latent Motion Diffusion for Image-Conditional Video Generationcited by 22
  20. 2024I2VControl: Disentangled and Unified Video Motion Synthesis Controlcited by 20
  21. 2024EchoNet-Synthetic: Privacy-preserving Video Generation for Safe Medical Data Sharingcited by 18
  22. 2024A personalized time-resolved 3D mesh generative model for unveiling normal heart dynamicscited by 18
  23. 2025LeanVAE: An Ultra-Efficient Reconstruction VAE for Video Diffusion Modelscited by 17
  24. 2024Data-Efficient Unsupervised Interpolation Without Any Intermediate Frame for 4D Medical Imagescited by 16
  25. 2025ReFoCUS: Reinforcement-guided Frame Optimization for Contextual Understandingcited by 16
  26. 2023Edit Temporal-Consistent Videos with Image Diffusion Modelcited by 12
  27. 2025KeyFace: Expressive Audio-Driven Facial Animation for Long Sequences via KeyFrame Interpolationcited by 11
  28. 2025VideoMiner: Iteratively Grounding Key Frames of Hour-Long Videos via Tree-based Group Relative Policy Optimizationcited by 11
  29. 2024Text-guided 3D Human Motion Generation with Keyframe-based Parallel Skip Transformercited by 9
  30. 2024ECHOPulse: ECG controlled echocardio-grams video generationcited by 9
  31. 2025CardiacFlow: 3D+t Four-Chamber Cardiac Shape Completion and Generation via Flow Matchingcited by 9
  32. 2025KeyVID: Keyframe-Aware Video Diffusion for Audio-Synchronized Visual Animationcited by 8
  33. 2025Versatile Cardiovascular Signal Generation with a Unified Diffusion Transformercited by 7
  34. 2025Global and Local Contrastive Learning for Joint Representations from Cardiac MRI and ECGcited by 6
  35. 2025FB-Diff: Fourier Basis-guided Diffusion for Temporal Interpolation of 4D Medical Imagingcited by 6
  36. 2025End-to-End 4D Heart Mesh Recovery Across Full-Stack and Sparse Cardiac MRIcited by 6
  37. 2025EchoFlow: A Foundation Model for Cardiac Ultrasound Image and Video Generationcited by 5
  38. 2025Language-Guided Temporal Token Pruning for Efficient VideoLLM Processingcited by 5

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.