Performance and Generalizability Impacts of Incorporating Location Encoders into Deep Learning for Dynamic PM2.5 Estimation
Not on the map. Why?
Abstract (arXiv)
Deep learning has shown strong performance in geospatial prediction tasks, but the role of geolocation information in improving accuracy and generalizability remains underexamined. Recent work has introduced location encoders that aim to represent spatial context in a transferable way, yet most evaluations have focused on static mapping tasks. Here, we study the effect of incorporating geolocation into deep learning for a dynamic and spatially heterogeneous application: estimating daily surface-level PM2.5 across the contiguous United States using satellite and ground-based observations. We compare three strategies for representing location: excluding geolocation, using raw latitude and longitude, and using pretrained location encoders. We evaluate each under within-region and out-of-region generalization settings. Results show that raw coordinates can improve performance within regions by supporting spatial interpolation, but can reduce generalizability across regions. In contrast, pretrained location encoders such as GeoCLIP improve both predictive accuracy and geographic transfer. However, we also observe spatial artifacts linked to encoder characteristics, and performance varies across encoder types (e.g., SatCLIP vs. GeoCLIP). This work provides the first systematic evaluation of location encoders in a dynamic environmental estimation context and offers guidance for incorporating geolocation into deep learning models for geospatial prediction.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 15 of its 64 references that are in the map. First posted on arXiv 24 May 2025.
Builds on
15 of 64 references.
References · 15
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Layer Normalizationcited by 5,669
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
- 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 187
- 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 151
- 2020A Generalizable and Accessible Approach to Machine Learning with Global Satellite Imagerycited by 88
3 more
- 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representationscited by 69
- 2021A Review of Location Encoding for GeoAI: Methods and Applicationscited by 54
- 2021A spatiotemporal machine learning approach to forecasting COVID-19 incidence at the county level in the USAcited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Localized, High-resolution Geographic Representations with Slepian Functionscited by 3
- 2026Tessellating The Earthcited by 2
- 2026A Proxy Consistency Loss for Grounded Fusion of Earth Observation and Location Encoderscited by 1
- 2026Chronosphere: Space-Time Tessellation of Local Climate Expertscited by 0
- 2026Chronosphere: Space-Time Tessellation of Local Climate Experts18 Sep 2026
- 2026Tessellating The Earth25 Jun 2026
- 2026A Proxy Consistency Loss for Grounded Fusion of Earth Observation and Location Encoders20 Apr 2026
- 2026Localized, High-resolution Geographic Representations with Slepian Functions30 Jan 2026