mlsanityData to 7 Oct 2026

Enhancing Lightweight Vision Language Models through Group Competitive Learning for Socially Compliant Navigation

arXiv 2603.11447 ↗First posted 12 Mar 2026cs.ROcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Social robot navigation requires a sophisticated integration of scene semantics and human social norms. Scaling up Vision Language Models (VLMs) generally improves reasoning and decision-making capabilities for socially compliant navigation. However, increased model size incurs substantial computational overhead, limiting suitability for real-time robotic deployment. Conversely, lightweight VLMs enable efficient inference but often exhibit weaker reasoning and decision-making performance in socially complex environments. Achieving both strong reasoning ability and efficiency remains an open challenge. To bridge this gap, we propose Group Competitive Learning (GCL), a strategy designed to amplify the capabilities of lightweight VLMs. Our strategy introduces the Group Competitive Objective (GCO) to harmonize global semantics with distributional regularization, alongside Asymmetric Group Optimization (AGO) to explore the upper limits of model performance. Empirical evaluations on social navigation benchmarks demonstrate that GCL significantly elevates VLM performance. Specifically, GCL enables the Qwen2.5-VL-3B learner model and guide Qwen3-VL-4B to achieve an F1 score of 0.968 and 0.914, representing 40% and 12% improvement over vanilla supervised fine-tuning (SFT). Notably, under vanilla SFT, the 3B model initially trails the 8B model (F1: 0.692 vs. 0.755). However, through the GCL, the 3B model outperforms (28%) the 8B baseline model. These results suggest that GCL provides an effective solution for achieving both high accuracy and computational efficiency in real-world deployment.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 36 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

26 of 36 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025SocialNav-MoE: A Mixture-of-Experts Vision Language Model for Socially Compliant Navigation with Reinforcement Fine-Tuning15 Dec
  2. 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Models30 Mar
  3. 2023Interactive Navigation in Environments with Traversable Obstacles Using Large Language and Vision-Language Models13 Oct

Other references · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
  5. 2022TinyViT: Fast Pretraining Distillation for Small Vision Transformerscited by 232
  6. 2021Core Challenges of Social Robot Navigation: A Surveycited by 97
  7. 2023SILC: Improving Vision Language Pretraining with Self-Distillationcited by 66
  8. 2023SocialCounterfactuals: Probing and Mitigating Intersectional Social Biases in Vision-Language Models with Counterfactual Examplescited by 53
  9. 2024Enhancing Video-LLM Reasoning via Agent-of-Thoughts Distillationcited by 36
  10. 2024FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Modelscited by 19
  11. 2024OLiVia-Nav: An Online Lifelong Vision Language Approach for Mobile Robot Social Navigationcited by 18
  12. 2023Rethinking Social Robot Navigation: Leveraging the Best of Two Worldscited by 14
11 more
  1. 2025VisBias: Measuring Explicit and Implicit Social Biases in Vision Language Modelscited by 14
  2. 2022Adversarial Contrastive Learning via Asymmetric InfoNCEcited by 13
  3. 2024AMD: Automatic Multi-step Distillation of Large-scale Vision Modelscited by 12
  4. 2024Robo-MUTUAL: Robotic Multimodal Task Specification via Unimodal Learningcited by 6
  5. 2025Multimodal Spatial Language Maps for Robot Navigation and Manipulationcited by 6
  6. 2026From Obstacles to Etiquette: Robot Social Navigation with VLM-Informed Path Selectioncited by 5
  7. 2025ImpedanceGPT: VLM-driven Impedance Control of Swarm of Mini-drones for Intelligent Navigation in Dynamic Environmentcited by 4
  8. 2025MUSON: A Reasoning-oriented Multimodal Dataset for Socially Compliant Navigation in Urban Environmentscited by 4
  9. 2025MAction-SocialNav: Multi-Action Socially Compliant Navigation via Reasoning-enhanced Prompt Tuningcited by 3
  10. 2024Reinforcement Learning via Auxiliary Task Distillationcited by 2
  11. 2025Toward Socially Aware Vision-Language Models: Evaluating Cultural Competence Through Multimodal Story Generationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Vision-Language Models for Deployable Social Robot Navigation: Bridging Semantic Reasoning and Low-Level Control
  2. 2026SOPD-SocialNav: Selective On-Policy Distillation for Vision-Language Social Navigation
  3. 2024Social-LLaVA: Enhancing Robot Navigation through Human-Language Reasoning in Social Spaces
  4. 2026G2-Nav: Grounded and Guarded Vision-Language Costmaps for Robot Social Navigation ↗
  5. 2025SocialNav-SUB: Benchmarking VLMs for Scene Understanding in Social Robot Navigation
  6. 2025ViLAM: Distilling Vision-Language Reasoning into Attention Maps for Social Robot Navigation
  7. 2026Think When It Matters: Conditional VLM Reasoning for Social Navigation with RL Policies
  8. 2026STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction