# Explainable, Physics Aware, Trustworthy AI Paradigm Shift for Synthetic Aperture Radar

arXiv: https://arxiv.org/abs/2301.03589 · HTML: https://mlsanity.com/paper/2301.03589/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 19 of its 77 references that are in the map.
- First posted on arXiv 9 Jan 2023.

## Builds on (most cited first, 19 of 19)

- [A Simple Framework for Contrastive Learning of Visual Representations](https://mlsanity.com/paper/2002.05709/) (2020)
- [Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning](https://mlsanity.com/paper/1506.02142/) (2015)
- [Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles](https://mlsanity.com/paper/1612.01474/) (2016)
- [Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination](https://mlsanity.com/paper/1805.01978/) (2018)
- [FCOS: Fully Convolutional One-Stage Object Detection](https://mlsanity.com/paper/1904.01355/) (2019)
- [Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI](https://mlsanity.com/paper/1910.10045/) (2019)
- [Bayesian Deep Learning and a Probabilistic Perspective of Generalization](https://mlsanity.com/paper/2002.08791/) (2020)
- [Theory-guided Data Science: A New Paradigm for Scientific Discovery from Data](https://mlsanity.com/paper/1612.08544/) (2016)
- [Deep Learning Meets SAR](https://mlsanity.com/paper/2006.10027/) (2020)
- [Machine Learning for the Geosciences: Challenges and Opportunities](https://mlsanity.com/paper/1711.04708/) (2017)
- [tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid Flow](https://mlsanity.com/paper/1801.09710/) (2018)
- [Physically Explainable CNN for SAR Image Classification](https://mlsanity.com/paper/2110.14144/) (2021)
- [What, Where and How to Transfer in SAR Target Recognition Based on Deep CNNs](https://mlsanity.com/paper/1906.01379/) (2019)
- [Classification of Large-Scale High-Resolution SAR Images with Deep Transfer Learning](https://mlsanity.com/paper/2001.01425/) (2020)
- [Bayesian U-Net for Segmenting Glaciers in SAR Imagery](https://mlsanity.com/paper/2101.03249/) (2021)
- [New SAR target recognition based on YOLO and very deep multi-canonical correlation analysis](https://mlsanity.com/paper/2110.15383/) (2021)
- [PeaceGAN: A GAN-based Multi-Task Learning Method for SAR Target Image Generation with a Pose Estimator and an Auxiliary Classifier](https://mlsanity.com/paper/2103.15469/) (2021)
- [Unsupervised Classification of PolSAR Data Using a Scattering Similarity Measure Derived from a Geodesic Distance](https://mlsanity.com/paper/1712.00427/) (2017)
- [SAR Image Colorization: Converting Single-Polarization to Fully Polarimetric Using Deep Neural Networks](https://mlsanity.com/paper/1707.07225/) (2017)

## Abstract (arXiv)

The recognition or understanding of the scenes observed with a SAR system requires a broader range of cues, beyond the spatial context. These encompass but are not limited to: imaging geometry, imaging mode, properties of the Fourier spectrum of the images or the behavior of the polarimetric signatures. In this paper, we propose a change of paradigm for explainability in data science for the case of Synthetic Aperture Radar (SAR) data to ground the explainable AI for SAR. It aims to use explainable data transformations based on well-established models to generate inputs for AI methods, to provide knowledgeable feedback for training process, and to learn or improve high-complexity unknown or un-formalized models from the data. At first, we introduce a representation of the SAR system with physical layers: i) instrument and platform, ii) imaging formation, iii) scattering signatures and objects, that can be integrated with an AI model for hybrid modeling. Successively, some illustrative examples are presented to demonstrate how to achieve hybrid modeling for SAR image understanding. The perspective of trustworthy model and supplementary explanations are discussed later. Finally, we draw the conclusion and we deem the proposed concept has applicability to the entire class of coherent imaging sensors and other computational imaging systems.
