# Fusion of Single and Integral Multispectral Aerial Images

arXiv: https://arxiv.org/abs/2311.17515 · HTML: https://mlsanity.com/paper/2311.17515/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 19 of its 52 references that are in the map.
- First posted on arXiv 29 Nov 2023.

## Builds on (most cited first, 19 of 19)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection](https://mlsanity.com/paper/2203.16220/) (2022)
- [RFN-Nest: An end-to-end residual fusion network for infrared and visible images](https://mlsanity.com/paper/2103.04286/) (2021)
- [CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusion](https://mlsanity.com/paper/2211.10960/) (2022)
- [MDLatLRR: A novel decomposition method for infrared and visible image fusion](https://mlsanity.com/paper/1811.02291/) (2018)
- [Infrared and Visible Image Fusion using a Deep Learning Framework](https://mlsanity.com/paper/1804.06992/) (2018)
- [An Autonomous Drone for Search and Rescue in Forests using Airborne Optical Sectioning](https://mlsanity.com/paper/2105.04328/) (2021)
- [Search and Rescue with Airborne Optical Sectioning](https://mlsanity.com/paper/2009.08835/) (2020)
- [Multi-focus Image Fusion using dictionary learning and Low-Rank Representation](https://mlsanity.com/paper/1804.08355/) (2018)
- [A Statistical View on Synthetic Aperture Imaging for Occlusion Removal](https://mlsanity.com/paper/1906.06600/) (2019)
- [Fast Automatic Visibility Optimization for Thermal Synthetic Aperture Visualization](https://mlsanity.com/paper/2005.04065/) (2020)
- [Pose Error Reduction for Focus Enhancement in Thermal Synthetic Aperture Visualization](https://mlsanity.com/paper/2012.08606/) (2020)
- [Combined Person Classification with Airborne Optical Sectioning](https://mlsanity.com/paper/2106.10077/) (2021)
- [Through-Foliage Tracking with Airborne Optical Sectioning](https://mlsanity.com/paper/2111.06959/) (2021)
- [Inverse Airborne Optical Sectioning](https://mlsanity.com/paper/2207.13344/) (2022)
- [Evaluation of Color Anomaly Detection in Multispectral Images For Synthetic Aperture Sensing](https://mlsanity.com/paper/2211.04293/) (2022)
- [On the Role of Field of View for Occlusion Removal with Airborne Optical Sectioning](https://mlsanity.com/paper/2204.13371/) (2022)

## Built on by (most cited first, 5 of 5)

- [An Autonomous Drone Swarm for Detecting and Tracking Anomalies among Dense Vegetation](https://mlsanity.com/paper/2407.10754/) (2024)
- [DeepForest: Sensing Into Self-Occluding Volumes of Vegetation With Aerial Imaging](https://mlsanity.com/paper/2502.02171/) (2025)
- [Through-Foliage Surface-Temperature Reconstruction for Early Wildfire Detection](https://mlsanity.com/paper/2511.12572/) (2025)
- [Reciprocal Visibility](https://mlsanity.com/paper/2402.06991/) (2024)
- [Vision-Reasoning-Guided Occlusion Removal from Light Fields](https://mlsanity.com/paper/2606.19985/) (2026)

## Abstract (arXiv)

An adequate fusion of the most significant salient information from multiple input channels is essential for many aerial imaging tasks. While multispectral recordings reveal features in various spectral ranges, synthetic aperture sensing makes occluded features visible. We present a first and hybrid (model- and learning-based) architecture for fusing the most significant features from conventional aerial images with the ones from integral aerial images that are the result of synthetic aperture sensing for removing occlusion. It combines the environment's spatial references with features of unoccluded targets that would normally be hidden by dense vegetation. Our method outperforms state-of-the-art two-channel and multi-channel fusion approaches visually and quantitatively in common metrics, such as mutual information, visual information fidelity, and peak signal-to-noise ratio. The proposed model does not require manually tuned parameters, can be extended to an arbitrary number and arbitrary combinations of spectral channels, and is reconfigurable for addressing different use cases. We demonstrate examples for search and rescue, wildfire detection, and wildlife observation.