One Domain, Many Tongues: Composing Domain and Language LoRAs for Cross-Lingual Remote-Sensing MLLMs without Paired Data
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Remote-sensing (RS) multimodal large language models (MLLMs) are trained and evaluated only in English, while text-only instruction data covers over 100 languages. We propose MODL (Mutually Orthogonal Domain-Language composition), a recipe that adds new languages to an English RS MLLM without a single multilingual RS example: a domain LoRA trained on English RS imagery and a language LoRA trained on text alone are learned jointly, under one loss term that keeps the two updates mutually orthogonal at every layer throughout training. This constraint is the recipe's active ingredient. Without it, the same training answers RS questions correctly but in English, erases much of the base model's multilingual text ability, and diverges on one seed in three; sixteen alternatives, from training-free merging to prior orthogonality variants, fail the same way. MODL repairs every failure on every seed: answers are correct and in the target language 56-71% of the time, where the best alternative reaches 27% and most stay below 8%, text ability stays at the level of the untrained base, and on Spanish it surpasses Qwen2.5-VL-7B, with zero multilingual-multimodal data. A single five-language adapter retains English, Spanish, and Vietnamese at full strength across three seeds; non-Latin scripts remain an open boundary.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 39 of its 55 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
39 of 55 references.
Closest ancestors · 8
Same direction, newest first
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
- 2024GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Tasks28 Nov
- 2024Multilingual Vision-Language Pre-training for the Remote Sensing Domain30 Oct
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
Other references · 31
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2016Learning without Forgettingcited by 2,496
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
- 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 445
- 2022Dataless Knowledge Fusion by Merging Weights of Language Modelscited by 387
- 2023Orthogonal Subspace Learning for Language Model Continual Learningcited by 312
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
- 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 254
- 2021Composable Sparse Fine-Tuning for Cross-Lingual Transfercited by 144
- 2024Model merging with SVD to tie the Knotscited by 122
19 more
- 2025MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluationcited by 79
- 2023Orthogonal Adaptation for Modular Customization of Diffusion Modelscited by 70
- 2024Pangea: A Fully Open Multilingual Multimodal LLM for 39 Languagescited by 64
- 2023Large Multilingual Models Pivot Zero-Shot Multimodal Learning across Languagescited by 52
- 2024LoRA Soups: Merging LoRAs for Practical Skill Composition Taskscited by 52
- 2023mBLIP: Efficient Bootstrapping of Multilingual Vision-LLMscited by 41
- 2024PALO: A Polyglot Large Multimodal Model for 5B Peoplecited by 34
- 2024AdaMergeX: Cross-Lingual Transfer with Large Language Models via Adaptive Adapter Mergingcited by 34
- 2025Aya Vision: Advancing the Frontier of Multilingual Multimodalitycited by 33
- 2023Language and Task Arithmetic with Parameter-Efficient Layers for Zero-Shot Summarizationcited by 28
- 2025AdaMMS: Model Merging for Heterogeneous Multimodal Large Language Models with Unsupervised Coefficient Optimizationcited by 25
- 2025Unraveling LoRA Interference: Orthogonal Subspaces for Robust Model Mergingcited by 19
- 2025Mitigating Parameter Interference in Model Merging via Sharpness-Aware Fine-Tuningcited by 16
- 2024Why do LLaVA Vision-Language Models Reply to Images in English?cited by 11
- 2025QR-LoRA: Efficient and Disentangled Fine-tuning via QR Decomposition for Customized Generationcited by 9
- 2025DyME: Dynamic Multi-Concept Erasure in Diffusion Models with Bi-Level Orthogonal LoRA Adaptationcited by 6
- 2025Breaking Language Barriers in Visual Language Models via Multilingual Textual Regularizationcited by 4
- 2025Rethinking Inter-LoRA Orthogonality in Adapter Merging: Insights from Orthogonal Monte Carlo Dropoutcited by 3
- 2025Model Merging via Multi-Teacher Knowledge Distillationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
- 2024From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives
- 2025A Benchmark for Multi-Lingual Vision-Language Learning in Remote Sensing Image Captioning
- 2023Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignment
- 2026OSMDA: OpenStreetMap-based Domain Adaptation for Remote Sensing VLMs