Remote Sensing-Oriented World Model
On the map: World models → World models for language agents
Abstract (arXiv)
World models have shown potential in artificial intelligence by predicting and reasoning about world states beyond direct observations. However, existing approaches are predominantly evaluated in synthetic environments or constrained scene settings, limiting their validation in real-world contexts with broad spatial coverage and complex semantics. Meanwhile, remote sensing applications urgently require spatial reasoning capabilities for disaster response and urban planning. This paper bridges these gaps by introducing the first framework for world modeling in remote sensing. We formulate remote sensing world modeling as direction-conditioned spatial extrapolation, where models generate semantically consistent adjacent image tiles given a central observation and directional instruction. To enable rigorous evaluation, we develop RSWISE (Remote Sensing World-Image Spatial Evaluation), a benchmark containing 1,600 evaluation tasks across four scenarios: general, flood, urban, and rural. RSWISE combines visual fidelity assessment with instruction compliance evaluation using GPT-4o as a semantic judge, ensuring models genuinely perform spatial reasoning rather than simple replication. Afterwards, we present RemoteBAGEL, a unified multimodal model fine-tuned on remote sensing data for spatial extrapolation tasks. Extensive experiments demonstrate that RemoteBAGEL consistently outperforms state-of-the-art baselines on RSWISE.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 30 of its 52 references that are in the map. First posted on arXiv 22 Sep 2025.
Builds on
30 of 52 references.
Closest ancestors · 1
Same direction, newest first
Other references · 29
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018World Modelscited by 1,513
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
- 2024Genie: Generative Interactive Environmentscited by 747
- 2022DayDreamer: World Models for Physical Robot Learningcited by 400
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 261
17 more
- 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
- 2020FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understandingcited by 181
- 2022TransDreamer: Reinforcement Learning with Transformer World Modelscited by 143
- 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 124
- 2024ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Modelcited by 120
- 2023Large Selective Kernel Network for Remote Sensing Object Detectioncited by 98
- 2024World Models for Autonomous Driving: An Initial Surveycited by 80
- 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 75
- 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Modelscited by 51
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 48
- 2023A New Learning Paradigm for Foundation Model-based Remote Sensing Change Detectioncited by 47
- 2024TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generationcited by 43
- 2023Remote Sensing Object Detection Meets Deep Learning: A Meta-review of Challenges and Advancescited by 20
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodalitycited by 19
- 2025Effective Cloud Removal for Remote Sensing Images by an Improved Mean-Reverting Denoising Model with Elucidated Design Spacecited by 12
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026RS-WorldModel: a Unified Model for Remote Sensing Understanding and Future Sense Forecasting
- 2024CHOICE: Benchmarking the Remote Sensing Capabilities of Large Vision-Language Models
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks
- 2026TerraLogic: A Benchmark for Hierarchical Geospatial Reasoning in Earth Observation
- 2025RemoteReasoner: Towards Unifying Geospatial Reasoning Workflow
- 2026EarthSpatialBench: Benchmarking Spatial Reasoning Capabilities of Multimodal LLMs on Earth Imagery
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes