CrossVL: Complexity-Aware Feature Routing and Paired Curriculum for Cross-View Vision-Language Detection
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Vision-language models (VLMs) enable text-guided object detection but degrade severely under cross-view scenarios where ground and aerial viewpoints differ in altitude, scale, and spatial layout. These geometric changes introduce systematic complexity variations between viewpoints, e.g., ground view images contain dense and highly occluded structures, while aerial images are sparse and globally organized. Fixed VLM fusion mechanisms cannot handle this discrepancy. We propose CrossVL, a framework combining Complexity-Aware Pathway Aggregation (CPA) and Paired Curriculum Learning (PCL) for enhanced cross-view detection for VLM. CPA estimates scene complexity from multimodal statistics and routes visual features through multiple pathways to obtain view-specific representations. PCL leverages semantic consistency of synchronized ground-aerial pairs to provide stable early supervision and then gradually shifts toward randomized sampling. On MAVREC, CrossVL improves Florence-2's aerial mAP from 58.66% to 61.03% and reduces the ground-aerial performance gap from 8.63pp to 6.65pp, while also achieving a 3.3x reduction in variance across random seeds. CPA provides stable complexity-aware feature aggregation, and PCL enhances optimization dynamics. Together, they demonstrate that coordinated architectural and training adaptations are crucial for robust cross-view VLM detection.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 19 of its 25 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
19 of 25 references.
References · 19
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2022Token Merging: Your ViT But Fastercited by 995
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 577
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
- 2020Self-Supervised Learning for Domain Adaptation on Point-Cloudscited by 99
7 more
- 2018Unsupervised Geometry-Aware Representation for 3D Human Pose Estimationcited by 73
- 2020Multiview Detection with Feature Perspective Transformationcited by 70
- 2020Dynamic ReLUcited by 55
- 2023Towards Viewpoint-Invariant Visual Recognition via Adversarial Trainingcited by 19
- 2023Multiview Aerial Visual Recognition (MAVREC): Can Multi-view Improve Aerial Visual Perception?cited by 17
- 2024Unified Domain Generalization and Adaptation for Multi-View 3D Object Detectioncited by 13
- 2024Omniview-Tuning: Boosting Viewpoint Invariance of Vision-Language Pre-training Modelscited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025VK-Det: Visual Knowledge Guided Prototype Learning for Open-Vocabulary Aerial Object Detection
- 2026CoRe: A Comprehensive Framework for Cross-Image Comparative Reasoning in Vision-Language Models
- 2026SkyLink: A Large Vision-Language Model Driven Re-ranking Framework for Cross-View UAV geolocalization
- 2025TDBench: A Benchmark for Top-Down Image Understanding with Reliability Analysis of Vision-Language Models
- 2026Multi-View Mixture-of-Experts with Vision-Language Reranking for Cross-View Object Geo-Localization
- 2026GuideGround: VLM-guided Semantic Understanding and Viewpoint-aware Reasoning for 3D Visual Grounding
- 2026Can Vision-Language Models Think from the Sky? Unifying UAV Reasoning and Generation
- 2026CrossView Suite: Harnessing Cross-view Spatial Intelligence of MLLMs with Dataset, Model and Benchmark