HamVision: Hamiltonian Dynamics as Inductive Bias for Medical Image Analysis
Not on the map. Why?
Abstract (arXiv)
We present HamVision, a framework for medical image analysis that uses the damped harmonic oscillator, a fundamental building block of signal processing, as a structured inductive bias for both segmentation and classification tasks. The oscillator's phase-space decomposition yields three functionally distinct representations: position~q (feature content), momentum~p (spatial gradients that encode boundary and texture information), and energy H = tfrac12|z|2 (a parameter-free saliency map). These representations emerge from the dynamics, not from supervision, and can be exploited by different task-specific heads without any modification to the oscillator itself. For segmentation, energy gates the skip connections while momentum injects boundary information at every decoder level (HamSeg). For classification, the three representations are globally pooled and concatenated into a phase-space feature vector (HamCls). We evaluate HamVision across ten medical imaging benchmarks spanning five imaging modalities. On segmentation, HamSeg achieves state-of-the-art Dice scores on ISIC,2018 (89.38%), ISIC,2017 (88.40%), TN3K (87.05%), and ACDC (92.40%), outperforming most baselines with only 8.57M parameters. On classification, HamCls achieves state-of-the-art accuracy on BloodMNIST (98.85%) and PathMNIST (96.65%), and competitive results on the remaining MedMNIST datasets against MedMamba and MedViT. Diagnostic analysis confirms that the oscillator's momentum consistently encodes an interior,>,boundary,>,exterior gradient for segmentation and that the energy map correlates with discriminative regions for classification, properties that emerge entirely from the Hamiltonian dynamics. Code is available at https://github.com/Minds-R-Lab/hamvision.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 22 Mar 2026.
Builds on
23 of 37 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2022A ConvNet for the 2020scited by 3,545
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
11 more
- 2024VMamba: Visual State Space Modelcited by 955
- 2019Hamiltonian Neural Networkscited by 702
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 682
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
- 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 331
- 2015Unitary Evolution Recurrent Neural Networkscited by 291
- 2024VM-UNet: Vision Mamba UNet for Medical Image Segmentationcited by 286
- 2023MedViT: A Robust Vision Transformer for Generalized Medical Image Classificationcited by 89
- 2024MedMamba: Vision Mamba for Medical Image Classificationcited by 86
- 2026Mamba-3: Improved Sequence Modeling using State Space Principlescited by 76
- 2017Gabor Convolutional Networkscited by 55
Built on by
Not cited yet.