RS-WorldModel: a Unified Model for Remote Sensing Understanding and Future Sense Forecasting
On the map: World models → Latent predictive world models
Abstract (arXiv)
Remote sensing world models aim to both explain observed changes and forecast plausible futures, two tasks that share spatiotemporal priors. Existing methods, however, typically address them separately, limiting cross-task transfer. We present RS-WorldModel, a unified world model for remote sensing that jointly handles spatiotemporal change understanding and text-guided future scene forecasting, and we build RSWBench-1.1M, a 1.1 million sample dataset with rich language annotations covering both tasks. RS-WorldModel is trained in three stages: (1) Geo-Aware Generative Pre-training (GAGP) conditions forecasting on geographic and acquisition metadata; (2) synergistic instruction tuning (SIT) jointly trains understanding and forecasting; (3) verifiable reinforcement optimization (VRO) refines outputs with verifiable, task-specific rewards. With only 2B parameters, RS-WorldModel surpasses open-source models up to 120 × larger on most spatiotemporal change question-answering metrics. It achieves an FID of 43.13 on text-guided future scene forecasting, outperforming all open-source baselines as well as the closed-source Gemini-2.5-Flash Image (Nano Banana).
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 51 of its 57 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
51 of 57 references.
References · 51
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
38 more
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
- 2022DayDreamer: World Models for Physical Robot Learningcited by 372
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2017Functional Map of the Worldcited by 338
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 204
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 181
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 164
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Modelcited by 133
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
- 2022MoVQ: Modulating Quantized Vectors for High-Fidelity Image Generationcited by 125
- 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 123
- 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 116
- 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Modelcited by 112
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 101
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 81
- 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 69
- 2021The Multi-Temporal Urban Development SpaceNet Datasetcited by 62
- 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Modelcited by 54
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
- 2025Perception-R1: Advancing Multimodal Reasoning Capabilities of MLLMs via Visual Perception Rewardcited by 45
- 2025DisasterM3: A Remote Sensing Vision-Language Dataset for Disaster Damage Assessment and Responsecited by 35
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2025DynamicVL: Benchmarking Multimodal Large Language Models for Dynamic City Understandingcited by 17
- 2025RSCC: A Large-Scale Remote Sensing Change Caption Dataset for Disaster Eventscited by 13
- 2024RS-GPT4V: A Unified Multimodal Instruction-Following Dataset for Remote Sensing Image Understandingcited by 9
- 2025GDiffRetro: Retrosynthesis Prediction with Dual Graph Enhanced Molecular Representation and Diffusion Generationcited by 6
- 2025SAMChat: Introducing Chain of Thought Reasoning and GRPO to a Multimodal Small Language Model for Small Scale Remote Sensingcited by 6
- 2025Secure Tug-of-War (SecTOW): Iterative Defense-Attack Training with Reinforcement Learning for Multimodal Model Securitycited by 4
- 2025Few-Shot Vision-Language Reasoning for Satellite Imagery via Verifiable Rewardscited by 3
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey
- 2025Remote Sensing-Oriented World Model
- 2026LongEarth-R1: Benchmarking and Aligning Vision-Language Models for Long-Horizon Earth Observation Reasoning
- 2025ChatENV: An Interactive Vision-Language Model for Sensor-Guided Environmental Monitoring and Scenario Simulation
- 2024ChangeChat: An Interactive Model for Remote Sensing Change Analysis via Multimodal Instruction Tuning
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models
- 2025GeoVLM-R1: Reinforcement Fine-Tuning for Improved Remote Sensing Reasoning