mlsanityData to 7 Oct 2026

RS-WorldModel: a Unified Model for Remote Sensing Understanding and Future Sense Forecasting

arXiv 2603.14941 ↗First posted 16 Mar 2026cs.AIcited by 2

On the map: World models → Latent predictive world models

Abstract (arXiv)

Remote sensing world models aim to both explain observed changes and forecast plausible futures, two tasks that share spatiotemporal priors. Existing methods, however, typically address them separately, limiting cross-task transfer. We present RS-WorldModel, a unified world model for remote sensing that jointly handles spatiotemporal change understanding and text-guided future scene forecasting, and we build RSWBench-1.1M, a 1.1 million sample dataset with rich language annotations covering both tasks. RS-WorldModel is trained in three stages: (1) Geo-Aware Generative Pre-training (GAGP) conditions forecasting on geographic and acquisition metadata; (2) synergistic instruction tuning (SIT) jointly trains understanding and forecasting; (3) verifiable reinforcement optimization (VRO) refines outputs with verifiable, task-specific rewards. With only 2B parameters, RS-WorldModel surpasses open-source models up to 120 × larger on most spatiotemporal change question-answering metrics. It achieves an FID of 43.13 on text-guided future scene forecasting, outperforming all open-source baselines as well as the closed-source Gemini-2.5-Flash Image (Nano Banana).

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 51 of its 57 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

51 of 57 references.

References · 51

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  7. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  8. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  9. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  10. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  11. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  12. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
38 more
  1. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  2. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
  3. 2022DayDreamer: World Models for Physical Robot Learningcited by 372
  4. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
  5. 2017Functional Map of the Worldcited by 338
  6. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
  7. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
  8. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
  9. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
  10. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
  11. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 204
  12. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 181
  13. 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
  14. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 164
  15. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
  16. 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Modelcited by 133
  17. 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
  18. 2022MoVQ: Modulating Quantized Vectors for High-Fidelity Image Generationcited by 125
  19. 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 123
  20. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
  21. 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 116
  22. 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Modelcited by 112
  23. 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 101
  24. 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 81
  25. 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 69
  26. 2021The Multi-Temporal Urban Development SpaceNet Datasetcited by 62
  27. 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Modelcited by 54
  28. 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
  29. 2025Perception-R1: Advancing Multimodal Reasoning Capabilities of MLLMs via Visual Perception Rewardcited by 45
  30. 2025DisasterM3: A Remote Sensing Vision-Language Dataset for Disaster Damage Assessment and Responsecited by 35
  31. 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
  32. 2025DynamicVL: Benchmarking Multimodal Large Language Models for Dynamic City Understandingcited by 17
  33. 2025RSCC: A Large-Scale Remote Sensing Change Caption Dataset for Disaster Eventscited by 13
  34. 2024RS-GPT4V: A Unified Multimodal Instruction-Following Dataset for Remote Sensing Image Understandingcited by 9
  35. 2025GDiffRetro: Retrosynthesis Prediction with Dual Graph Enhanced Molecular Representation and Diffusion Generationcited by 6
  36. 2025SAMChat: Introducing Chain of Thought Reasoning and GRPO to a Multimodal Small Language Model for Small Scale Remote Sensingcited by 6
  37. 2025Secure Tug-of-War (SecTOW): Iterative Defense-Attack Training with Reinforcement Learning for Multimodal Model Securitycited by 4
  38. 2025Few-Shot Vision-Language Reasoning for Satellite Imagery via Verifiable Rewardscited by 3

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey
  2. 2025Remote Sensing-Oriented World Model
  3. 2026LongEarth-R1: Benchmarking and Aligning Vision-Language Models for Long-Horizon Earth Observation Reasoning
  4. 2025ChatENV: An Interactive Vision-Language Model for Sensor-Guided Environmental Monitoring and Scenario Simulation
  5. 2024ChangeChat: An Interactive Model for Remote Sensing Change Analysis via Multimodal Instruction Tuning
  6. 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes
  7. 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models
  8. 2025GeoVLM-R1: Reinforcement Fine-Tuning for Improved Remote Sensing Reasoning