mlsanityData to 14 Oct 2026

Beyond RGB: Very High Resolution Urban Remote Sensing With Multimodal Deep Networks

arXiv 1711.08681 ↗First posted 23 Nov 2017cs.NE cs.CVcited by 64

Not on the map. Why?

Abstract (arXiv)

In this work, we investigate various methods to deal with semantic labeling of very high resolution multi-modal remote sensing data. Especially, we study how deep fully convolutional networks can be adapted to deal with multi-modal and multi-scale remote sensing data for semantic labeling. Our contributions are threefold: a) we present an efficient multi-scale approach to leverage both a large spatial context and the high resolution data, b) we investigate early and late fusion of Lidar and multispectral data, c) we validate our methods on two public datasets with state-of-the-art results. Our results indicate that late fusion make it possible to recover errors steaming from ambiguous data, while early fusion allows for better joint-feature learning but at the cost of higher sensitivity to missing data.

Key facts. Cited by 64 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Nov 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 18; 2022: 13; 2023: 12; 2024: 4; 2025: 10; 2026: 7.

64 papers.

Sort:

By area:

  1. 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 167
  2. 2021TPH-YOLOv5: Improved YOLOv5 Based on Transformer Prediction Head for Object Detection on Drone-captured Scenarioscited by 83
  3. 2021A Novel Transformer Based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Imagescited by 56
  4. 2023Cross-City Matters: A Multimodal Remote Sensing Benchmark Dataset for Cross-City Semantic Segmentation using High-Resolution Domain Adaptation Networkscited by 55
  5. 2023SAM-Assisted Remote Sensing Imagery Semantic Segmentation with Object and Boundary Constraintscited by 35
  6. 2021Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Imagescited by 28
  7. 2022GLF-CR: SAR-Enhanced Cloud Removal with Global-Local Fusioncited by 24
  8. 2023PopulAtion Parameter Averaging (PAPA)cited by 23
  9. 2023FedDiff: Diffusion Model Driven Federated Learning for Multi-Modal and Multi-Clientscited by 23
  10. 2021ABCNet: Attentive Bilateral Contextual Network for Efficient Semantic Segmentation of Fine-Resolution Remote Sensing Imagescited by 22
  11. 2022Current Trends in Deep Learning for Earth Observation: An Open-source Benchmark Arena for Image Classificationcited by 18
  12. 2023Multi-modal learning for geospatial vegetation forecastingcited by 16
38 more
  1. 2025RingMoE: Mixture-of-Modality-Experts Multi-Modal Foundation Models for Universal Remote Sensing Image Interpretationcited by 16
  2. 2024A Unified Framework with Multimodal Fine-tuning for Remote Sensing Semantic Segmentationcited by 15
  3. 2021HED-UNet: Combined Segmentation and Edge Detection for Monitoring the Antarctic Coastlinecited by 13
  4. 2022Curriculum-style Local-to-global Adaptation for Cross-domain Remote Sensing Image Segmentationcited by 11
  5. 2021Large-scale Building Height Retrieval from Single SAR Imagery based on Bounding Box Regression Networkscited by 10
  6. 2021Weakly Supervised Change Detection Using Guided Anisotropic Difusioncited by 8
  7. 2022Augmentation Invariance and Adaptive Sampling in Semantic Segmentation of Agricultural Aerial Imagescited by 8
  8. 2023FedFusion: Manifold Driven Federated Learning for Multi-satellite and Multi-modality Fusioncited by 8
  9. 2024Adaptive Fusion of Multi-view Remote Sensing data for Optimal Sub-field Crop Yield Predictioncited by 8
  10. 2021MultiScene: A Large-scale Dataset and Benchmark for Multi-scene Recognition in Single Aerial Imagescited by 7
  11. 2021An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagerycited by 7
  12. 2023No Wrong Turns: The Simple Geometry Of Neural Networks Optimization Pathscited by 7
  13. 2021A Contrastive Distillation Approach for Incremental Semantic Segmentation in Aerial Imagescited by 6
  14. 2023MetaSegNet: Metadata-collaborative Vision-Language Representation Learning for Semantic Segmentation of Remote Sensing Imagescited by 6
  15. 2021Scale-aware Neural Network for Semantic Segmentation of Multi-resolution Remote Sensing Imagescited by 5
  16. 2021Single-stream CNN with Learnable Architecture for Multi-source Remote Sensing Datacited by 5
  17. 2022Hierarchical Instance Mixing across Domains in Aerial Segmentationcited by 5
  18. 2022Common Practices and Taxonomy in Deep Multi-view Fusion for Remote Sensing Applicationscited by 5
  19. 2021Aerial Scene Understanding in The Wild: Multi-Scene Recognition via Prototype-based Memory Networkscited by 4
  20. 2022A Review of Landcover Classification with Very-High Resolution Remotely Sensed Optical Images-Analysis Unit,Model Scalability and Transferabilitycited by 4
  21. 2023GAMUS: A Geometry-aware Multi-modal Semantic Segmentation Benchmark for Remote Sensing Datacited by 4
  22. 2024LMFNet: An Efficient Multimodal Fusion Approach for Semantic Segmentation in High-Resolution Remote Sensingcited by 4
  23. 2022Computer vision-based analysis of buildings and built environments: A systematic review of current approachescited by 3
  24. 2022Seafloor-Invariant Caustics Removal from Underwater Imagerycited by 3
  25. 2023Incomplete Multimodal Learning for Remote Sensing Data Fusioncited by 3
  26. 2022FasterX: Real-Time Object Detection Based on Edge GPUs for UAV Applicationscited by 2
  27. 2025Missing Data as Augmentation in the Earth Observation Domain: A Multi-View Learning Approachcited by 2
  28. 2025CARL: Camera-Agnostic Representation Learning for Spectral Image Analysiscited by 2
  29. 2021A hierarchical deep learning framework for the consistent classification of land use objects in geospatial databasescited by 1
  30. 2021Multi-modal land cover mapping of remote sensing images using pyramid attention and gated fusion networkscited by 1
  31. 2022Random Ferns for Semantic Segmentation of PolSAR Imagescited by 1
  32. 2022Classification of Quasars, Galaxies, and Stars in the Mapping of the Universe Multi-modal Deep Learningcited by 1
  33. 2022Semantic Labeling of High Resolution Images Using EfficientUNets and Transformerscited by 1
  34. 2024In the Search for Optimal Multi-view Learning Models for Crop Classification with Global Remote Sensing Datacited by 1
  35. 2025EGFormer: Towards Efficient and Generalizable Multimodal Semantic Segmentationcited by 1
  36. 2025A Spatially Masked Adaptive Gated Network for multimodal post-flood water extent mapping using SAR and incomplete multispectral datacited by 1
  37. 2026SGMA: Semantic-Guided Modality-Aware Segmentation for Remote Sensing with Incomplete Multimodal Datacited by 1
  38. 2026SIGMAE: A Spectral-Index-Guided Foundation Model for Multispectral Remote Sensingcited by 1

50 most cited of 64 All 64 (JSON)