The Last Remote Sensing Model Built by Humans? Casting Any Earth Observation Task as Recursive Self-Improvement
Not on the map. Why?
Abstract (arXiv)
Earth observation (EO) models are still built by hand. For each new task, experts design a training recipe and tune it against a benchmark. We show that this loop can be handed to an agent. Any verifiable task can be cast as a harness and a verifier, where the harness defines what the agent may use and the verifier defines what counts as success. Every EO task can be made verifiable, through labeled benchmarks, independent sensors, physical models or the repeated observation of the same place. Given only these two components, a general-purpose coding agent builds the EO model and improves it recursively on its own outputs. Settings long treated as separate research problems, from learning with a handful of labels to adapting across domains, become choices of harness and verifier. On six EO benchmarks spanning optical, SAR and multispectral time-series imagery, with outputs that range from land-cover maps and ship instances to canopy heights and answers about large images, agent-built models surpass the state of the art on every one, and on land-cover mapping, they do so from 11% of the training labels. This establishes a new paradigm for EO, in which people design harnesses and verifiers and agents build the models, so EO models improve as agents do.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 80 of its 110 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
80 of 110 references.
References · 80
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017Mask R-CNNcited by 7,277
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2023Let's Verify Step by Stepcited by 3,789
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
38 more
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2018DARTS: Differentiable Architecture Searchcited by 1,798
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
- 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 699
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2019Hybrid Task Cascade for Instance Segmentationcited by 481
- 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 470
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2019Cascade R-CNN: High Quality Object Detection and Instance Segmentationcited by 429
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 349
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 300
- 2019Mask Scoring R-CNNcited by 266
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 261
- 2025AIDE: AI-Driven Exploration in the Space of Codecited by 226
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
- 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 178
- 2022MIC: Masked Image Consistency for Context-Enhanced Domain Adaptationcited by 178
- 2024RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human expertscited by 175
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
- 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 167
- 2026Towards End-to-End Automation of AI Researchcited by 159
- 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 148
- 2020AutoML-Zero: Evolving Machine Learning Algorithms From Scratchcited by 143
- 2021Panoptic Segmentation of Satellite Image Time Series with Convolutional Temporal Attention Networkscited by 143
- 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 124
- 2024ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Modelcited by 120
- 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 104
- 2022OpenEarthMap: A Benchmark Dataset for Global High-Resolution Land Cover Mappingcited by 82
- 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 74
50 most cited of 80 All 80 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directions
- 2026EO-Gym: A Multimodal, Interactive Environment for Earth Observation Agents
- 2026IC-EO: Interpretable Code-based assistant for Earth Observation
- 2026Earth-Agent-Pro: Towards Real-World Full-Chain Earth Observation with Agents
- 2025Regression in EO: Are VLMs Up to the Challenge?
- 2025GeoVLM-R1: Reinforcement Fine-Tuning for Improved Remote Sensing Reasoning
- 2022EarthNets: Empowering AI in Earth Observation
- 2026GeoForge: Non-Parametric Self-Evolving Agents for Earth-Observation Reasoning