HLS-GPT: A Generative Pretrained Transformer (GPT) for Continental-Scale NASA Harmonized Landsat and Sentinel-2 (HLS) Reflectance Reconstruction Across All Bands on Arbitrary Dates
Not on the map. Why?
Abstract (arXiv)
Recent deep learning methods for Landsat and Sentinel-2 reflectance time series reconstruction remain limited by restricted spectral coverage, limited geographic scalability, or patch-based designs with short temporal contexts. We present HLS-GPT, a large-scale generative pretrained Transformer model for reconstructing NASA Harmonized Landsat Sentinel-2 30 m surface reflectance for all bands, any date, and any pixel location. HLS-GPT uses a hierarchical Transformer architecture to handle the different spectral band configurations of Landsat and Sentinel-2 and operates on single-pixel 12-month time series. To capture geographic and seasonal variability, the model was trained with nine years of HLS time series from more than 0.25 million training pixels across the conterminous United States. A random cropping and masking strategy extracts 12-month periods with varying start dates across epochs, masks 50% of valid observations, and trains the model to reconstruct the masked reflectance values from the remaining observations. Evaluation using more than 62,000 independent test pixels shows robust reconstruction under diverse land surface conditions, including complex crop phenology and sparse, irregular observations. Leave-one-observation-out evaluation achieved reconstruction RMSE below 0.026 for all HLS spectral bands, with relative RMSE below 35% for visible bands and below 13% for other bands. Red-edge band errors were comparable to red and near-infrared errors despite the absence of red-edge bands on Landsat. Sensitivity analyses that randomly masked 10% to 90% of test observations showed only modest degradation when 10% to 50% of observations were masked, with all-band RMSE below 0.028. Image reconstruction over nine independent 109 by 109 km CONUS HLS tiles further demonstrates that HLS-GPT outperforms two conventional methods and the NASA-IBM Prithvi model.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 115 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
15 of 115 references.
References · 15
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
- 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 144
- 2025Towards a Unified Copernicus Foundation Model for Earth Visioncited by 53
- 2021EarthNet2021: A large-scale dataset and challenge for Earth surface forecasting as a guided video prediction taskcited by 34
- 2022GLF-CR: SAR-Enhanced Cloud Removal with Global-Local Fusioncited by 24
- 2023Multi-modal learning for geospatial vegetation forecastingcited by 16
- 2021Seeing Through Clouds in Satellite Imagescited by 13
- 2020Cloud removal in remote sensing images using generative adversarial networks and SAR-to-optical image translationcited by 11
- 2025AgriFM: A Multi-source Temporal Remote Sensing Foundation Model for Agriculture Mappingcited by 9
- 2023U-TILISE: A Sequence-to-sequence Model for Cloud Removal in Optical Satellite Time Seriescited by 8
3 more
- 2021Long time-series NDVI reconstruction in cloud-prone regions via spatio-temporal tensor completioncited by 6
- 2024Paving the way toward foundation models for irregular and unaligned Satellite Image Time Seriescited by 6
- 2023OBSUM: An object-based spatial unmixing model for spatiotemporal fusion of remote sensing imagescited by 3
Built on by
Not cited yet.