PDE-Constrained Optimization for Neural Image Segmentation with Physics Priors
Not on the map. Why?
Abstract (arXiv)
Segmentation of microscopy images constitutes an ill-posed inverse problem due to measurement noise, weak object boundaries, and limited labeled data. Although deep neural networks provide flexible nonparametric estimators, unconstrained empirical risk minimization often leads to unstable solutions and poor generalization. In this work, image segmentation is formulated as a PDE-constrained optimization problem that integrates physically motivated priors into deep learning models through variational regularization. The proposed framework minimizes a composite objective function consisting of a data fidelity term and penalty terms derived from reaction-diffusion equations and phase-field interface energies, all implemented as differentiable residual losses. Experiments are conducted on the LIVECell dataset, a high-quality, manually annotated collection of phase-contrast microscopy images. Training is performed on two cell types, while evaluation is carried out on a distinct, unseen cell type to assess generalization. A UNet architecture is used as the unconstrained baseline model. Experimental results demonstrate consistent improvements in segmentation accuracy and boundary fidelity compared to unconstrained deep learning baselines. Moreover, the PDE-regularized models exhibit enhanced stability and improved generalization in low-sample regimes, highlighting the advantages of incorporating structured priors. The proposed approach illustrates how PDE-constrained optimization can strengthen data-driven learning frameworks, providing a principled bridge between variational methods, statistical learning, and scientific machine learning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 1 Feb 2026.
Builds on
17 of 36 references.
References · 17
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2020Image Segmentation Using Deep Learning: A Surveycited by 659
- 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 351
- 2018A Probabilistic U-Net for Segmentation of Ambiguous Imagescited by 281
- 2017A Review on Deep Learning Techniques Applied to Semantic Segmentationcited by 122
5 more
- 2018RTSeg: Real-time Semantic Segmentation Comparative Studycited by 11
- 2024PINNs for Medical Image Analysis: A Surveycited by 5
- 2016Variational reaction-diffusion systems for semantic segmentationcited by 1
- 2025Learning to Solve Optimization Problems Constrained with Partial Differential Equationscited by 1
- 2025A Physics-Informed Loss Function for Boundary-Consistent and Robust Artery Segmentation in DSA Sequencescited by 1
Built on by
Not cited yet.