Personalized 4D Whole-Heart Mesh Reconstruction from Cine MRI via Multi-Scale Temporal Modeling and Differentiable Contour Rendering
Not on the map. Why?
Abstract (arXiv)
Accurate 4D whole-heart mesh reconstruction from sparse cine MRI is critical for creating cardiac digital twins, but remains challenging due to limited 2D slice coverage and the complex coupling between cardiac shape and motion. Existing methods often rely on intermediate contour fitting and typically reconstruct static, single-phase, or partial cardiac geometries, limiting their ability to capture full-chamber dynamics. We propose a novel end-to-end framework for reconstructing temporally resolved whole-heart meshes from multi-view 2D cine MRI sequences by learning an image-to-mesh mapping. The framework incorporates a differentiable contour renderer inspired by the Beer-Lambert attenuation principle, enabling anatomy-aware supervision of 3D+t mesh deformation through contour-based projection losses. To improve temporal consistency across the cardiac cycle, we further introduce a multi-scale temporal modeling module that integrates global cycle-level dynamics with local inter-frame coherence to generate smooth and physiologically plausible mesh trajectories. The proposed method achieved a whole-heart mean absolute error of 1.68 ± 0.31 mm and a motion jitter of 0.77 ± 0.17 mm/frame3, outperforming existing methods with lower reconstruction error and substantially improved motion smoothness. It also improved 2D contour alignment across multiple cine MRI views and supported downstream proof-of-concept electrophysiological simulation. The code will be released publicly upon acceptance of the manuscript for publication.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 69 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
31 of 69 references.
References · 31
- 2017Attention Is All You Needcited by 59,932
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
- 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 267
- 2018PU-Net: Point Cloud Upsampling Networkcited by 208
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2018Boundary loss for highly unbalanced segmentationcited by 187
- 2023Exphormer: Sparse Transformers for Graphscited by 166
- 2022Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensorscited by 144
- 2017Anatomically Constrained Neural Networks (ACNN): Application to Cardiac Image Enhancement and Segmentationcited by 109
- 2018Deep learning cardiac motion analysis for human survival predictioncited by 31
19 more
- 2019DARNet: Deep Active Ray Network for Building Segmentationcited by 30
- 2022Learning Whole Heart Mesh Generation From Patient Images For Computational Simulationscited by 21
- 2023Towards Enabling Cardiac Digital Twins of Myocardial Infarction Using Deep Computational Models for Inverse Inferencecited by 18
- 2018Explainable cardiac pathology classification on cine MRI with motion characterization by semi-supervised learning of apparent flowcited by 16
- 2019End to End Trainable Active Contours via Differentiable Renderingcited by 15
- 20234D Myocardium Reconstruction with Decoupled Motion and Shape Modelcited by 15
- 2024Solving the Inverse Problem of Electrocardiography for Cardiac Digital Twins: A Surveycited by 14
- 2023Multi-view Hybrid Graph Convolutional Network for Volume-to-mesh Reconstruction in Cardiovascular MRIcited by 12
- 2022Mesh-based 3D Motion Tracking in Cardiac MRI using Deep Learningcited by 9
- 2021Cobiveco: Consistent biventricular coordinates for precise and intuitive description of position in the heart -- with MATLAB implementationcited by 8
- 2022A comprehensive and biophysically detailed computational model of the whole human heart electromechanicscited by 8
- 2024Improved 3D Whole Heart Geometry from Sparse CMR Slicescited by 8
- 2025CardiacFlow: 3D+t Four-Chamber Cardiac Shape Completion and Generation via Flow Matchingcited by 8
- 2023Modeling 3D cardiac contraction and relaxation with point cloud deformation networkscited by 7
- 2025An Automated Computational Pipeline for Generating Large-Scale Cohorts of Patient-Specific Ventricular Models in Electromechanical In Silico Trialscited by 3
- 2026CineMesh4D: Personalized 4D Whole Heart Reconstruction from Sparse Cine MRIcited by 3
- 2025UltraTwin: Towards Cardiac Anatomical Twin Generation from Multi-view 2D Ultrasoundcited by 2
- 2026Cardiac Mesh Flow: One-Step Generation of 3D+t Cardiac Four-Chamber Meshes via Flow Matchingcited by 2
- 2026Personalized 3D Myocardial Infarct Geometry Reconstruction from Cine MRI for Cardiac Digital Twinscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.