Rethinking Air-Ground Collaboration: A Progressive Cross-Task Benchmark and Socialized Learning Framework
Not on the map. Why?
Abstract (arXiv)
Air-ground collaborative perception is crucial for robust visual understanding in real-world dynamic environments. However, existing studies typically formulate collaboration as single-task cross-view fusion, overlooking the functional dependencies among localization, target association, and fine-grained parsing. In addition, the heterogeneous nature of aerial and ground views introduces substantial geometric, scale, and occlusion discrepancies, making uniform feature sharing vulnerable to negative transfer. To tackle these issues, we model air-ground perception as a progressive cross-task collaboration task and construct the Air-Ground Progressive Collaboration (AGPC) benchmark, a spatio-temporally aligned benchmark comprising more than 745K raw video frames. Built upon this benchmark, we propose Socialized Co-Perception (SCP), a coarse-to-fine framework that organizes collaboration progressively from aerial global localization to ground target association and identity-aware parsing. Its core module, the Dual-Layer Router (DLR), decouples input-side multi-scale expert selection from output-side task-conditioned modulation, enabling selective cross-view and cross-task interaction while suppressing harmful interference. Extensive experiments demonstrate the effectiveness of SCP. It achieves a 3.73% coevolutionary gain and a 7.86% improvement in average downstream performance. These results show that task-conditioned collaboration is more effective than uniform fusion for heterogeneous air-ground perception. The code is available at https://github.com/g1136639260-spec/AGSCP.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 53 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
28 of 53 references.
References · 28
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 459
- 2022DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 273
- 2020VIGOR: Cross-View Image Geo-localization beyond One-to-one Retrievalcited by 189
- 2022TransGeo: Transformer Is All You Need for Cross-view Image Geo-localizationcited by 168
- 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecastingcited by 114
- 2022Multi-Task Learning with Multi-Query Transformer for Dense Predictioncited by 34
- 2023DI-V2X: Learning Domain-Invariant Representation for Vehicle-Infrastructure Collaborative 3D Object Detectioncited by 34
- 2021INTERN: A New Learning Paradigm Towards General Visioncited by 33
- 2024Collaborative Perception for Connected and Autonomous Driving: Challenges, Possible Solutions and Opportunitiescited by 32
16 more
- 2024AG-ReID.v2: Bridging Aerial and Ground Views for Person Re-identificationcited by 20
- 2023FedHCA2: Towards Hetero-Client Federated Multi-Task Learningcited by 17
- 2025Griffin: Aerial-Ground Cooperative Detection and Tracking Dataset and Benchmarkcited by 15
- 2023A Novel Approach for Effective Multi-View Clustering with Information-Theoretic Perspectivecited by 14
- 2025AG-VPReID: A Challenging Large-Scale Benchmark for Aerial-Ground Video-based Person Re-Identificationcited by 13
- 2025AGC-Drive: A Large-Scale Dataset for Real-World Aerial-Ground Collaboration in Driving Scenarioscited by 11
- 2020Learning Category- and Instance-Aware Pixel Embedding for Fast Panoptic Segmentationcited by 9
- 2025Research Challenges and Progress in the End-to-End V2X Cooperative Autonomous Driving Competitioncited by 9
- 2025Decoding with Structured Awareness: Integrating Directional, Frequency-Spatial, and Structural Attention for Medical Image Segmentationcited by 9
- 2025TADFormer : Task-Adaptive Dynamic Transformer for Efficient Multi-Task Learningcited by 5
- 2025MambaSeg: Harnessing Mamba for Accurate and Efficient Image-Event Semantic Segmentationcited by 4
- 2025SEMC: Structure-Enhanced Mixture-of-Experts Contrastive Learning for Ultrasound Standard Plane Recognitioncited by 3
- 2026Bidirectional Channel-selective Semantic Interaction for Semi-Supervised Medical Segmentationcited by 3
- 2023Multi-query Vehicle Re-identification: Viewpoint-conditioned Network, Unified Dataset and New Metriccited by 2
- 2024One Framework to Rule Them All: Unifying Multimodal Tasks with LLM Neural-Tuningcited by 1
- 2025A2VISR: An Active and Adaptive Ground-Aerial Localization System Using Visual Inertial and Single-Range Fusioncited by 1
Built on by
Not cited yet.