mlsanityData to 14 Oct 2026

Beyond Imaging: Vision Transformer Digital Twin Surrogates for 3D+T Biological Tissue Dynamics

arXiv 2508.15883 ↗First posted 21 Aug 2025eess.IV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Understanding the dynamic organization and homeostasis of living tissues requires high-resolution, time-resolved imaging coupled with methods capable of extracting interpretable, predictive insights from complex datasets. Here, we present the Vision Transformer Digital Twin Surrogate Network (VT-DTSN), a deep learning framework for predictive modeling of 3D+T imaging data from biological tissue. By leveraging Vision Transformers pretrained with DINO (Self-Distillation with NO Labels) and employing a multi-view fusion strategy, VT-DTSN learns to reconstruct high-fidelity, time-resolved dynamics of a Drosophila midgut while preserving morphological and feature-level integrity across imaging depths. The model is trained with a composite loss prioritizing pixel-level accuracy, perceptual structure, and feature-space alignment, ensuring biologically meaningful outputs suitable for in silico experimentation and hypothesis testing. Evaluation across layers and biological replicates demonstrates VT-DTSN's robustness and consistency, achieving low error rates and high structural similarity while maintaining efficient inference through model optimization. This work establishes VT-DTSN as a feasible, high-fidelity surrogate for cross-timepoint reconstruction and for studying tissue dynamics, enabling computational exploration of cellular behaviors and homeostasis to complement time-resolved imaging studies in biological research.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 31 references that are in the map. First posted on arXiv 21 Aug 2025.

Builds on

10 of 31 references.

References · 10

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  4. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 675
  5. 2020Understanding SSIMcited by 77
  6. 2021PQK: Model Compression via Pruning, Quantization, and Knowledge Distillationcited by 21
  7. 2022Scheduling Techniques for Liver Segmentation: ReduceLRonPlateau Vs OneCycleLRcited by 19
  8. 2021Layered gradient accumulation and modular pipeline parallelism: fast and efficient training of large language modelscited by 6
  9. 2022End-to-end Multiple Instance Learning with Gradient Accumulationcited by 4
  10. 2022Distributed Deep Learning Inference Acceleration using Seamless Collaboration in Edge Computingcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Twins: Learn to Predict Unified Representations with Focal Loss
  2. 2026DualDiT: A Conditional Dual-Output Diffusion Transformer for Joint OCT Image and Segmentation Mask Generation
  3. 2021Deep Quantized Representation for Enhanced Reconstruction
  4. 2025Rethinking Vision Transformer Depth via Structural Reparameterization
  5. 2026HistDiT: A Structure-Aware Latent Conditional Diffusion Model for High-Fidelity Virtual Staining in Histopathology
  6. 2026MUMINS: Metadata-conditioned Uncertainty-aware Medical Image Next-state Synthesis
  7. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models
  8. 2025Compressing Biology: Evaluating the Stable Diffusion VAE for Phenotypic Drug Discovery