mlsanityData to 14 Oct 2026

A Generative Shape Compositional Framework to Synthesise Populations of Virtual Chimaeras

arXiv 2210.01607 ↗First posted 4 Oct 2022eess.IV cs.CV cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Generating virtual populations of anatomy that capture sufficient variability while remaining plausible is essential for conducting in-silico trials of medical devices. However, not all anatomical shapes of interest are always available for each individual in a population. Hence, missing/partially-overlapping anatomical information is often available across individuals in a population. We introduce a generative shape model for complex anatomical structures, learnable from datasets of unpaired datasets. The proposed generative model can synthesise complete whole complex shape assemblies coined virtual chimaeras, as opposed to natural human chimaeras. We applied this framework to build virtual chimaeras from databases of whole-heart shape assemblies that each contribute samples for heart substructures. Specifically, we propose a generative shape compositional framework which comprises two components - a part-aware generative shape model which captures the variability in shape observed for each structure of interest in the training population; and a spatial composition network which assembles/composes the structures synthesised by the former into multi-part shape assemblies (viz. virtual chimaeras). We also propose a novel self supervised learning scheme that enables the spatial composition network to be trained with partially overlapping data and weak labels. We trained and validated our approach using shapes of cardiac structures derived from cardiac magnetic resonance images available in the UK Biobank. Our approach significantly outperforms a PCA-based shape model (trained with complete data) in terms of generalisability and specificity. This demonstrates the superiority of the proposed approach as the synthesised cardiac virtual populations are more plausible and capture a greater degree of variability in shape than those generated by the PCA-based shape model.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 19 of its 69 references that are in the map. First posted on arXiv 4 Oct 2022.

Builds on

19 of 69 references.

References · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
  6. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  7. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  8. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
  9. 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 268
  10. 2019Evaluation of Algorithms for Multi-Modality Whole Heart Segmentation: An Open-Access Grand Challengecited by 100
  11. 2020DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasetscited by 94
  12. 2020Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying Kernelscited by 53
7 more
  1. 2017Deformable Shape Completion with Graph Convolutional Autoencoderscited by 50
  2. 2019Learning Part Generation and Assembly for Structure-aware Shape Synthesiscited by 36
  3. 2016Parametric Exponential Linear Unit for Deep Convolutional Neural Networkscited by 32
  4. 2019Composite Shape Modeling via Latent Space Factorizationcited by 31
  5. 2021EditVAE: Unsupervised Part-Aware Controllable 3D Point Cloud Shape Generationcited by 21
  6. 2018DiDA: Disentangled Synthesis for Domain Adaptationcited by 10
  7. 2020Handling confounding variables in statistical shape analysis -- application to cardiac remodellingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 2.

5 papers.