# Late or Earlier Information Fusion from Depth and Spectral Data? Large-Scale Digital Surface Model Refinement by Hybrid-cGAN

arXiv: https://arxiv.org/abs/1904.09935 · HTML: https://mlsanity.com/paper/1904.09935/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 Apr 2019.

## Built on by (most cited first, 7 of 7)

- [Sat-NeRF: Learning Multi-View Satellite Photogrammetry With Transient Objects and Shadow Modeling Using RPC Cameras](https://mlsanity.com/paper/2203.08896/) (2022)
- [SparseSat-NeRF: Dense Depth Supervised Neural Radiance Fields for Sparse Satellite Images](https://mlsanity.com/paper/2309.00277/) (2023)
- [ResDepth: A Deep Residual Prior For 3D Reconstruction From High-resolution Satellite Images](https://mlsanity.com/paper/2106.08107/) (2021)
- [Machine-learned 3D Building Vectorization from Satellite Imagery](https://mlsanity.com/paper/2104.06485/) (2021)
- [HiRes-FusedMIM: A High-Resolution RGB-DSM Pre-trained Model for Building-Level Remote Sensing Applications](https://mlsanity.com/paper/2503.18540/) (2025)
- [Unified Face Matching and Physical-Digital Spoofing Attack Detection](https://mlsanity.com/paper/2501.09635/) (2025)
- [SeasonStereo: Robust Dense Stereo Matching for Multi-Date Satellite Imagery via Generative AI](https://mlsanity.com/paper/2607.27139/) (2026)

## Abstract (arXiv)

We present the workflow of a DSM refinement methodology using a Hybrid-cGAN where the generative part consists of two encoders and a common decoder which blends the spectral and height information within one network. The inputs to the Hybrid-cGAN are single-channel photogrammetric DSMs with continuous values and single-channel pan-chromatic (PAN) half-meter resolution satellite images. Experimental results demonstrate that the earlier information fusion from data with different physical meanings helps to propagate fine details and complete an inaccurate or missing 3D information about building forms. Moreover, it improves the building boundaries making them more rectilinear.
