A Contrastive Pre-trained Foundation Model for Deciphering Imaging Noisomics across Modalities
Not on the map. Why?
Abstract (arXiv)
Characterizing imaging noise is notoriously data-intensive and device-dependent, as modern sensors entangle physical signals with complex algorithmic artifacts. Current paradigms struggle to disentangle these factors without massive supervised datasets, often reducing noise to mere interference rather than an information resource. Here, we introduce "Noisomics", a framework shifting the focus from suppression to systematic noise decoding via the Contrastive Pre-trained (CoP) Foundation Model. By leveraging the manifold hypothesis and synthetic noise genome, CoP employs contrastive learning to disentangle semantic signals from stochastic perturbations. Crucially, CoP breaks traditional deep learning scaling laws, achieving superior performance with only 100 training samples, outperforming supervised baselines trained on 100,000 samples, thereby reducing data and computational dependency by three orders of magnitude. Extensive benchmarking across 12 diverse out-of-domain datasets confirms its robust zero-shot generalization, demonstrating a 63.8% reduction in estimation error and an 85.1% improvement in the coefficient of determination compared to the conventional training strategy. We demonstrate CoP's utility across scales: from deciphering non-linear hardware-noise interplay in consumer photography to optimizing photon-efficient protocols for deep-tissue microscopy. By decoding noise as a multi-parametric footprint, our work redefines stochastic degradation as a vital information resource, empowering precise imaging diagnostics without prior device calibration.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 45 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
16 of 45 references.
References · 16
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2013Describing Textures in the Wildcited by 2,110
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 682
- 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 326
- 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 250
- 2021Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesiscited by 140
4 more
- 2021A Petri Dish for Histopathology Image Analysiscited by 63
- 2018RuleMatrix: Visualizing and Understanding Classifiers with Rulescited by 62
- 2022FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Contextcited by 47
- 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connectionscited by 47
Built on by
Not cited yet.