Functional Map of the World
Not on the map. Why?
Cited by 33 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We present a new dataset, Functional Map of the World (fMoW), which aims to inspire the development of machine learning models capable of predicting the functional purpose of buildings and land use from temporal sequences of satellite images and a rich set of metadata features. The metadata provided with each image enables reasoning about location, time, sun angles, physical sizes, and other features when making predictions about objects in the image. Our dataset consists of over 1 million images from over 200 countries. For each image, we provide at least one bounding box annotation containing one of 63 categories, including a "false detection" category. We present an analysis of the dataset along with baseline approaches that reason about metadata and temporal views. Our data, code, and pretrained models have been made publicly available.
Key facts. Cited by 338 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 51; 2023: 59; 2024: 73; 2025: 85; 2026: 44.
338 papers.
Sort:
By area:
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2021Robust fine-tuning of zero-shot modelscited by 797
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
- 2021Domain Generalization: A Surveycited by 764
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
- 2023DataComp: In search of the next generation of multimodal datasetscited by 644
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 436
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 2022Exploring Visual Prompts for Adapting Large-Scale Modelscited by 274
- 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 249
38 more
- 2022Surgical Fine-Tuning Improves Adaptation to Distribution Shiftscited by 205
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
- 2022Improving Out-of-Distribution Robustness via Selective Augmentationcited by 202
- 2022Datamodels: Predicting Predictions from Training Datacited by 189
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 187
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 151
- 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 151
- 2022Finetune like you pretrain: Improved finetuning of zero-shot vision modelscited by 150
- 2022Leveraging Unlabeled Data to Predict Out-of-Distribution Performancecited by 145
- 2022On Feature Learning in the Presence of Spurious Correlationscited by 145
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Modelcited by 138
- 2021On Calibration and Out-of-domain Generalizationcited by 134
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 131
- 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 125
- 2022SuS-X: Training-Free Name-Only Transfer of Vision-Language Modelscited by 119
- 2024Scalable Pre-training of Large Autoregressive Image Modelscited by 115
- 2024Multimodal Autoregressive Pre-training of Large Vision Encoderscited by 109
- 2022An Empirical Study of Remote Sensing Pretrainingcited by 105
- 2024Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observationcited by 104
- 2021D2C: Diffusion-Denoising Models for Few-shot Conditional Generationcited by 96
- 2022Agreement-on-the-Line: Predicting the Performance of Neural Networks under Distribution Shiftcited by 94
- 2022Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Timecited by 90
- 2021Extending the WILDS Benchmark for Unsupervised Adaptationcited by 86
- 2022NICO++: Towards Better Benchmarking for Domain Generalizationcited by 86
- 2022Sparse Mixture-of-Experts are Domain Generalizable Learnerscited by 85
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 85
- 2024Rethinking Transformers Pre-training for Multi-Spectral Satellite Imagerycited by 83
- 2022DynamicEarthNet: Daily Multi-Spectral Satellite Dataset for Semantic Change Segmentationcited by 78
- 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 77
- 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 77
- 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 74
- 2024HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Modelcited by 73
- 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 70
- 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representationscited by 69
- 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 68
- 2022Probable Domain Generalization via Quantile Risk Minimizationcited by 66
- 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretrainingcited by 66
50 most cited of 338 All 338 (JSON)
- 2026Aperture: Training-Free Multiscale Concept Bottlenecks for Remote Sensing29 Sep 2026
- 2026The Devil is in the Spectrum Bias: Spectrum-Balanced Feature Matching for Robust Representation Distillation28 Sep 2026
- 2026Multi-source conformal prediction: leveraging heterogeneity via localization13 Sep 2026
- 2026From Coordinates to Candidate Regions: Temporal Change Localization via Region Selection in Remote Sensing Multimodal LLMs8 Sep 2026
- 2026SLED: Scalable Location Encoding via Distillation6 Aug 2026
- 2026Exploring Budgeted Image Classification with Content-Sensitive Resource Allocation27 Jul 2026
- 2026DA-MergeLoRA: Hypernetwork-Based LoRA Merging for Few-Shot Test-Time Domain Adaptation20 Jul 2026
- 2026What's in an Earth Embedding? An Explainability Analysis of Location Encoders23 Jun 2026
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks9 Jun 2026
- 2026Bridging Domain Expertise and Generalization for Performance Estimation4 Jun 2026
- 2026Who Needs Labels? Adapting Vision Foundation Models With the Metadata You Already Have3 Jun 2026
- 2026Density-Aware Translation of Spurious Correlations in Zero-Shot VLMs1 Jun 2026
38 more
- 2026MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modeling19 May 2026
- 2026No One Knows the State of the Art in Geospatial Foundation Models12 May 2026
- 2026TrajGANR: Trajectory-Centric Urban Multimodal Learning via Geospatially Aligned Neural Representations7 May 2026
- 2026Survey on Disaster Management Datasets for Remote Sensing Based Emergency Applications5 May 2026
- 2026Rethinking Electro-Optical Vision Foundation Models for Remote Sensing Retrieval: A Controlled Comparison with Generalist VFM4 May 2026
- 2026EO-Gym: A Multimodal, Interactive Environment for Earth Observation Agents2 May 2026
- 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directions27 Apr 2026
- 2026SyMTRS: Benchmark Multi-Task Synthetic Dataset for Depth, Domain Adaptation and Super-Resolution in Aerial Imagery23 Apr 2026
- 2026HyperFM: An Efficient Hyperspectral Foundation Model with Spectral Grouping22 Apr 2026
- 2026Pretrain Where? Investigating How Pretraining Data Diversity Impacts Geospatial Foundation Model Performance22 Apr 2026
- 2026RSRCC: A Remote Sensing Regional Change Comprehension Benchmark Constructed via Retrieval-Augmented Best-of-N Ranking22 Apr 2026
- 2026HarmoniDiff-RS: Training-Free Diffusion Harmonization for Satellite Image Composition21 Apr 2026
- 2026OT on the Map: Quantifying Domain Shifts in Geographic Space17 Apr 2026
- 2026On-Orbit Space AI: Federated, Multi-Agent, and Collaborative Algorithms for Satellite Constellations15 Apr 2026
- 2026Tracking Adaptation Time: Metrics for Temporal Distribution Shift8 Apr 2026
- 2026GeoSANE: Learning Geospatial Representations from Models, Not Data24 Mar 2026
- 2026Revisiting Autoregressive Models for Generative Image Classification19 Mar 2026
- 2026RS-WorldModel: a Unified Model for Remote Sensing Understanding and Future Sense Forecasting16 Mar 2026
- 2026RSEdit: Text-Guided Image Editing for Remote Sensing14 Mar 2026
- 2026Revisiting Model Stitching In the Foundation Model Era12 Mar 2026
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks10 Mar 2026
- 2026SIGMAE: A Spectral-Index-Guided Foundation Model for Multispectral Remote Sensing8 Mar 2026
- 2026NeighborMAE: Exploiting Spatial Dependencies between Neighboring Earth Observation Images in Masked Autoencoders Pretraining3 Mar 2026
- 2026TerraDiT: Point-Conditioned Diffusion Transformer for Satellite Image Synthesis2 Mar 2026
- 2026Meta-Learning Hyperparameters for Parameter Efficient Fine-Tuning2 Mar 2026
- 2026Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth Observation23 Feb 2026
- 2026CBEN -- A Multimodal Machine Learning Dataset for Cloud Robust Remote Sensing Image Understanding13 Feb 2026
- 2026MMEarth-Bench: Global Model Adaptation via Multimodal Test-Time Training6 Feb 2026
- 2026Gradual Fine-Tuning for Flow Matching Models30 Jan 2026
- 2026Cross-Scale Pretraining: Enhancing Self-Supervised Learning for Low-Resolution Satellite Imagery for Semantic Segmentation19 Jan 2026
- 2026Multi-Distribution Robust Conformal Prediction6 Jan 2026
- 2026Subimage Overlap Prediction: Task-Aligned Self-Supervised Pretraining For Semantic Segmentation In Remote Sensing Imagery5 Jan 2026
- 2025FUSE-RSVLM: Feature Fusion Vision-Language Model for Remote Sensing30 Dec 2025
- 2025MMLANDMARKS: a Cross-View Instance-Level Benchmark for Geo-Spatial Understanding19 Dec 2025
- 2025Any-Optical-Model: A Universal Foundation Model for Optical Remote Sensing19 Dec 2025
- 2025UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenes28 Nov 2025
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes27 Nov 2025
- 2025FarSLIP: Discovering Effective CLIP Adaptation for Fine-Grained Remote Sensing Understanding18 Nov 2025
50 newest of 338 All 338 (JSON)
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 151
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Modelcited by 138
- 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 125
- 2022SuS-X: Training-Free Name-Only Transfer of Vision-Language Modelscited by 119
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 85
- 2024Good at captioning, bad at counting: Benchmarking GPT-4V on Earth observation datacited by 39
- 2024ViTamin: Designing Scalable Vision Models in the Vision-Language Eracited by 39
- 2024Towards Vision-Language Geo-Foundation Model: A Surveycited by 36
- 2022SVL-Adapter: Self-Supervised Adapter for Vision-Language Pretrained Modelscited by 34
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2025DynamicVL: Benchmarking Multimodal Large Language Models for Dynamic City Understandingcited by 18
- 2024Probabilistic Language-Image Pre-Trainingcited by 16
12 most cited of 29 All 29 (JSON)
- 2026From Coordinates to Candidate Regions: Temporal Change Localization via Region Selection in Remote Sensing Multimodal LLMs8 Sep 2026
- 2026Density-Aware Translation of Spurious Correlations in Zero-Shot VLMs1 Jun 2026
- 2025FUSE-RSVLM: Feature Fusion Vision-Language Model for Remote Sensing30 Dec 2025
- 2025ChatENV: An Interactive Vision-Language Model for Sensor-Guided Environmental Monitoring and Scenario Simulation14 Aug 2025
- 2025Remote Sensing Large Vision-Language Model: Semantic-augmented Multi-level Alignment and Semantic-aware Expert Modeling27 Jun 2025
- 2025DynamicVL: Benchmarking Multimodal Large Language Models for Dynamic City Understanding27 May 2025
- 2025REOBench: Benchmarking Robustness of Earth Observation Foundation Models22 May 2025
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May 2025
- 2025DGTRSD & DGTRS-CLIP: A Dual-Granularity Remote Sensing Image-Text Dataset and Vision Language Foundation Model for Alignment25 Mar 2025
- 2025LongProLIP: A Probabilistic Vision-Language Model with Long Context Text11 Mar 2025
- 2025DOFA-CLIP: Multimodal Vision-Language Foundation Models for Earth Observation8 Mar 2025
- 2025Quality-Driven Curation of Remote Sensing Vision-Language Data via Learned Scoring Models2 Mar 2025
12 newest of 29 All 29 (JSON)
- 2023DataComp: In search of the next generation of multimodal datasetscited by 644
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 131
- 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Modelcited by 55
- 2022DDPM-CD: Denoising Diffusion Probabilistic Models as Feature Extractors for Change Detectioncited by 19
- 2024MMM-RS: A Multi-modal, Multi-GSD, Multi-scene Remote Sensing Dataset and Benchmark for Text-to-Image Generationcited by 8
- 2024SatDiffMoE: A Mixture of Estimation Method for Satellite Image Super-resolution with Latent Diffusion Modelscited by 4
- 2025RSFAKE-1M: A Large-Scale Dataset for Detecting Diffusion-Generated Remote Sensing Forgeriescited by 2
- 2025Metadata, Wavelet, and Time Aware Diffusion Models for Satellite Image Super Resolutioncited by 0
- 2025Environment-Aware Satellite Image Generation with Diffusion Modelscited by 0
- 2026Gradual Fine-Tuning for Flow Matching Modelscited by 0
- 2026TerraDiT: Point-Conditioned Diffusion Transformer for Satellite Image Synthesiscited by 0
- 2026Revisiting Autoregressive Models for Generative Image Classificationcited by 0
- 2026Revisiting Autoregressive Models for Generative Image Classification19 Mar 2026
- 2026TerraDiT: Point-Conditioned Diffusion Transformer for Satellite Image Synthesis2 Mar 2026
- 2026Gradual Fine-Tuning for Flow Matching Models30 Jan 2026
- 2025Environment-Aware Satellite Image Generation with Diffusion Models29 Sep 2025
- 2025Metadata, Wavelet, and Time Aware Diffusion Models for Satellite Image Super Resolution30 Jun 2025
- 2025RSFAKE-1M: A Large-Scale Dataset for Detecting Diffusion-Generated Remote Sensing Forgeries29 May 2025
- 2024MMM-RS: A Multi-modal, Multi-GSD, Multi-scene Remote Sensing Dataset and Benchmark for Text-to-Image Generation26 Oct 2024
- 2024SatDiffMoE: A Mixture of Estimation Method for Satellite Image Super-resolution with Latent Diffusion Models14 Jun 2024
- 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Model18 Mar 2024
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagery6 Dec 2023
- 2023DataComp: In search of the next generation of multimodal datasets27 Apr 2023
- 2022DDPM-CD: Denoising Diffusion Probabilistic Models as Feature Extractors for Change Detection23 Jun 2022
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenescited by 14
- 2023Understanding prompt engineering may not require rethinking generalizationcited by 10
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Taskscited by 4
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Taskscited by 3
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks9 Jun 2026
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks10 Mar 2026
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes27 Nov 2025
- 2023Understanding prompt engineering may not require rethinking generalization6 Oct 2023
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2021Robust fine-tuning of zero-shot modelscited by 797
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
- 2021Domain Generalization: A Surveycited by 764
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 436
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 2022Exploring Visual Prompts for Adapting Large-Scale Modelscited by 274
- 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 249
- 2022Surgical Fine-Tuning Improves Adaptation to Distribution Shiftscited by 205
12 most cited of 286 All 286 (JSON)
- 2026Aperture: Training-Free Multiscale Concept Bottlenecks for Remote Sensing29 Sep 2026
- 2026The Devil is in the Spectrum Bias: Spectrum-Balanced Feature Matching for Robust Representation Distillation28 Sep 2026
- 2026Multi-source conformal prediction: leveraging heterogeneity via localization13 Sep 2026
- 2026SLED: Scalable Location Encoding via Distillation6 Aug 2026
- 2026Exploring Budgeted Image Classification with Content-Sensitive Resource Allocation27 Jul 2026
- 2026DA-MergeLoRA: Hypernetwork-Based LoRA Merging for Few-Shot Test-Time Domain Adaptation20 Jul 2026
- 2026What's in an Earth Embedding? An Explainability Analysis of Location Encoders23 Jun 2026
- 2026Bridging Domain Expertise and Generalization for Performance Estimation4 Jun 2026
- 2026Who Needs Labels? Adapting Vision Foundation Models With the Metadata You Already Have3 Jun 2026
- 2026MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modeling19 May 2026
- 2026No One Knows the State of the Art in Geospatial Foundation Models12 May 2026
- 2026TrajGANR: Trajectory-Centric Urban Multimodal Learning via Geospatially Aligned Neural Representations7 May 2026
12 newest of 286 All 286 (JSON)