Deep Recurrence for Dynamical Segmentation Models
Not on the map. Why?
Abstract (arXiv)
While biological vision systems rely heavily on feedback connections to iteratively refine perception, most artificial neural networks remain purely feedforward, processing input in a single static pass. In this work, we propose a predictive coding inspired feedback mechanism that introduces a recurrent loop from output to input, allowing the model to refine its internal state over time. We implement this mechanism within a standard U-Net architecture and introduce two biologically motivated operations, softmax projection and exponential decay, to ensure stability of the feedback loop. Through controlled experiments on a synthetic segmentation task, we show that the feedback model significantly outperforms its feedforward counterpart in noisy conditions and generalizes more effectively with limited supervision. Notably, feedback achieves above random performance with just two training examples, while the feedforward model requires at least four. Our findings demonstrate that feedback enhances robustness and data efficiency, and offer a path toward more adaptive and biologically inspired neural architectures. Code is available at: github.com/DCalhas/feedback_segmentation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 24 references that are in the map. First posted on arXiv 14 Jul 2025.
Builds on
14 of 24 references.
References · 14
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2019Deep Equilibrium Modelscited by 615
- 2016Dense Associative Memory for Pattern Recognitioncited by 236
- 2017A Study and Comparison of Human and Deep Learning Recognition Performance Under Visual Distortionscited by 108
- 2023Energy Transformercited by 71
- 2018Reviving and Improving Recurrent Back-Propagationcited by 69
- 2019Recurrence is required to capture the representational dynamics of the human visual systemcited by 58
- 2020A simple way to make neural networks robust against diverse image corruptionscited by 30
- 2020Stable and expressive recurrent vision modelscited by 20
- 2021Feasibility-based Fixed Point Networkscited by 17
Built on by
Not cited yet.