Double-well Net for Image Segmentation
Not on the map. Why?
Abstract (arXiv)
In this study, our goal is to integrate classical mathematical models with deep neural networks by introducing two novel deep neural network models for image segmentation known as Double-well Nets. Drawing inspirations from the Potts model, our models leverage neural networks to represent a region force functional. We extend the well-know MBO (Merriman-Bence-Osher) scheme to solve the Potts model. The widely recognized Potts model is approximated using a double-well potential and then solved by an operator-splitting method, which turns out to be an extension of the well-known MBO scheme. Subsequently, we replace the region force functional in the Potts model with a UNet-type network, which is data-driven and is designed to capture multiscale features of images, and also introduce control variables to enhance effectiveness. The resulting algorithm is a neural network activated by a function that minimizes the double-well potential. What sets our proposed Double-well Nets apart from many existing deep learning methods for image segmentation is their strong mathematical foundation. They are derived from the network approximation theory and employ the MBO scheme to approximately solve the Potts model. By incorporating mathematical principles, Double-well Nets bridge the MBO scheme and neural networks, and offer an alternative perspective for designing networks with mathematical backgrounds. Through comprehensive experiments, we demonstrate the performance of Double-well Nets, showcasing their superior accuracy and robustness compared to state-of-the-art neural networks. Overall, our work represents a valuable contribution to the field of image segmentation by combining the strengths of classical variational models and deep neural networks. The Double-well Nets introduce an innovative approach that leverages mathematical foundations to enhance segmentation performance.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 38 of its 95 references that are in the map. First posted on arXiv 31 Dec 2023.
Builds on
38 of 95 references.
References · 38
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2016Error bounds for approximations with deep ReLU networkscited by 567
- 2017Stable Architectures for Deep Neural Networkscited by 340
- 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 331
- 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
- 2018Universality of Deep Convolutional Neural Networkscited by 176
- 2019Deep Network Approximation Characterized by Number of Neuronscited by 120
26 more
- 2019Nonparametric Regression on Low-Dimensional Manifolds using Deep ReLU Networks : Function Approximation and Statistical Recoverycited by 73
- 2018RGCNN: Regularized Graph CNN for Point Cloud Segmentationcited by 70
- 2021Neural ODE control for classification, approximation and transportcited by 56
- 2022Deep Nonparametric Estimation of Operators between Infinite Dimensional Spacescited by 45
- 2019MgNet: A Unified Framework of Multigrid and Convolutional Neural Networkcited by 41
- 2019Approximation and Non-parametric Estimation of ResNet-type Convolutional Neural Networkscited by 40
- 2019Deep learning as optimal control problems: models and numerical methodscited by 33
- 2021Besov Function Approximation and Binary Classification on Low-Dimensional Manifolds Using Convolutional Residual Networkscited by 32
- 2020Deep Convolutional Neural Networks with Spatial Regularization, Volume and Star-shape Priori for Image Segmentationcited by 31
- 2016Deep nets for local manifold learningcited by 26
- 2021A Neural Network Approach for High-Dimensional Optimal Control Applied to Multi-Agent Path Findingcited by 18
- 2023PottsMGNet: A Mathematical Explanation of Encoder-Decoder Based Neural Networkscited by 17
- 2013Multiclass Data Segmentation using Diffuse Interface Methods on Graphscited by 15
- 2020Curvature Regularized Surface Reconstruction from Point Cloudcited by 13
- 2021Topology-Preserving 3D Image Segmentation Based On Hyperelastic Regularizationcited by 13
- 2019A Regularized Convolutional Neural Network for Semantic Image Segmentationcited by 12
- 2020A Color Elastica Model for Vector-Valued Image Regularizationcited by 11
- 2022DOSnet as a Non-Black-Box PDE Solver: When Deep Learning Meets Operator Splittingcited by 11
- 2023EWT: Efficient Wavelet-Transformer for Single Image Denoisingcited by 11
- 2018Convexity Shape Prior for Level Set based Image Segmentation Methodcited by 10
- 2022Neural ODE Control for Trajectory Approximation of Continuity Equationcited by 8
- 2022Elastica Models for Color Image Regularizationcited by 6
- 2022Benefits of Overparameterized Convolutional Residual Networks: Function Approximation under Smoothness Constraintcited by 6
- 2017New region force for variational models in image segmentation and high dimensional data clusteringcited by 3
- 2023Connections between Operator-splitting Methods and Deep Neural Networks with Applications in Image Segmentationcited by 3
- 2019Volume Preserving Image Segmentation with Entropic Regularization Optimal Transport and Its Applications in Deep Learningcited by 2
Built on by
Citing papers per year: 2024: 3; 2025: 3; 2026: 1.
7 papers.
- 2024Deep Convolutional Neural Networks Meet Variational Shape Compactness Priors for Image Segmentationcited by 4
- 2024Euler's Elastica Based Cartoon-Smooth-Texture Image Decompositioncited by 4
- 2024A Mathematical Explanation of UNetcited by 4
- 2025A Mathematical Explanation of Transformerscited by 2
- 2025Image Segmentation via Variational Model Based Tailored UNet: A Deep Variational Frameworkcited by 1
- 2025Robust Variational Model Based Tailored UNet: Leveraging Edge Detector and Mean Curvature for Improved Image Segmentationcited by 0
- 2026Propagate, Then Sharpen: Post-Hoc Refinement of Frozen Node Classifierscited by 0
- 2026Propagate, Then Sharpen: Post-Hoc Refinement of Frozen Node Classifiers28 Sep 2026
- 2025Robust Variational Model Based Tailored UNet: Leveraging Edge Detector and Mean Curvature for Improved Image Segmentation8 Dec 2025
- 2025A Mathematical Explanation of Transformers5 Oct 2025
- 2025Image Segmentation via Variational Model Based Tailored UNet: A Deep Variational Framework9 May 2025
- 2024A Mathematical Explanation of UNet6 Oct 2024
- 2024Euler's Elastica Based Cartoon-Smooth-Texture Image Decomposition3 Jul 2024
- 2024Deep Convolutional Neural Networks Meet Variational Shape Compactness Priors for Image Segmentation23 May 2024