Uni-RS: A Spatially Faithful Unified Understanding and Generation Model for Remote Sensing
Not on the map. Why?
Abstract (arXiv)
Unified remote sensing multimodal models exhibit a pronounced spatial reversal curse: Although they can accurately recognize and describe object locations in images, they often fail to faithfully execute the same spatial relations during text-to-image generation, where such relations constitute core semantic information in remote sensing. Motivated by this observation, we propose Uni-RS, the first unified multimodal model tailored for remote sensing, to explicitly address the spatial asymmetry between understanding and generation. Specifically, we first introduce explicit Spatial-Layout Planning to transform textual instructions into spatial layout plans, decoupling geometric planning from visual synthesis. We then impose Spatial-Aware Query Supervision to bias learnable queries toward spatial relations explicitly specified in the instruction. Finally, we develop Image-Caption Spatial Layout Variation to expose the model to systematic geometry-consistent spatial transformations. Extensive experiments across multiple benchmarks show that our approach substantially improves spatial faithfulness in text-to-image generation, while maintaining strong performance on multimodal understanding tasks like image captioning, visual grounding, and VQA tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 39 references that are in the map. First posted on arXiv 25 Jan 2026.
Builds on
34 of 39 references.
References · 34
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Visual Instruction Tuningcited by 7,792
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Qwen-Image Technical Reportcited by 973
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
- 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 399
22 more
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 204
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 181
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 116
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 101
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
- 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Modelcited by 54
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
- 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generationcited by 41
- 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolutioncited by 41
- 2025SegEarth-R1: Geospatial Pixel Reasoning via Large Language Modelcited by 40
- 2022Txt2Img-MHN: Remote Sensing Image Generation from Text Using Modern Hopfield Networkscited by 28
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Modelscited by 17
- 2025GeoChain: Multimodal Chain-of-Thought for Geographic Reasoningcited by 16
- 2025GeoVLM-R1: Reinforcement Fine-Tuning for Improved Remote Sensing Reasoningcited by 15
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenescited by 13
- 2026GeoReason: Aligning Thinking And Answering In Remote Sensing Vision-Language Models Via Logical Consistency Reinforcement Learningcited by 10
- 2025TinyRS-R1: Compact Multimodal Language Model for Remote Sensingcited by 7
Built on by
Not cited yet.