mlsanityData to 14 Oct 2026

FedVLA: Federated Vision-Language-Action Learning with Dual Gating Mixture-of-Experts for Robotic Manipulation

arXiv 2508.02190 ↗First posted 4 Aug 2025cs.RO cs.AIcited by 18

On the map: Vision-language-action models → Generalist VLA models and benchmarks

also in 1 more
Abstract (arXiv)

Vision-language-action (VLA) models have significantly advanced robotic manipulation by enabling robots to interpret language instructions for task execution. However, training these models often relies on large-scale user-specific data, raising concerns about privacy and security, which in turn limits their broader adoption. To address this, we propose FedVLA, the first federated VLA learning framework, enabling distributed model training that preserves data privacy without compromising performance. Our framework integrates task-aware representation learning, adaptive expert selection, and expert-driven federated aggregation, enabling efficient and privacy-preserving training of VLA models. Specifically, we introduce an Instruction Oriented Scene-Parsing mechanism, which decomposes and enhances object-level features based on task instructions, improving contextual understanding. To effectively learn diverse task patterns, we design a Dual Gating Mixture-of-Experts (DGMoE) mechanism, where not only input tokens but also self-aware experts adaptively decide their activation. Finally, we propose an Expert-Driven Aggregation strategy at the federated server, where model aggregation is guided by activated experts, ensuring effective cross-client knowledge transfer.Extensive simulations and real-world robotic experiments demonstrate the effectiveness of our proposals. Notably, DGMoE significantly improves computational efficiency compared to its vanilla counterpart, while FedVLA achieves task success rates comparable to centralized training, effectively preserving data privacy.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 21 of its 33 references that are in the map. First posted on arXiv 4 Aug 2025.

Builds on

21 of 33 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 19

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  5. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  6. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
  7. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  8. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
  9. 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 565
  10. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
  11. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
  12. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
7 more
  1. 2024MoE-LLaVA: Mixture of Experts for Large Vision-Language Modelscited by 300
  2. 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 255
  3. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
  4. 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 148
  5. 2023FedHCA2: Towards Hetero-Client Federated Multi-Task Learningcited by 17
  6. 2023MAS: Towards Resource-Efficient Federated Multiple-Task Learningcited by 9
  7. 2022FedVLN: Privacy-preserving Federated Vision-and-Language Navigationcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 15.

18 papers.

Sort:

By area:

  1. 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
  2. 2026HapticVLA: Contact-Rich Manipulation via Vision-Language-Action Model without Inference-Time Tactile Sensingcited by 10
  3. 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
  4. 2026Aggregation Alignment for Federated Learning with Mixture-of-Experts under Data Heterogeneitycited by 4
  5. 2026TORL-VLA: Tactile Guided Online Reinforcement Learning for Contact-Rich Manipulationcited by 4
  6. 2025Beyond Success: Refining Elegant Robot Manipulation from Mixed-Quality Data via Just-in-Time Interventioncited by 2
  7. 2026LayerRoute: Action-Conditioned Mixture-of-Layers Routing for Vision-Language-Action Policiescited by 2
  8. 2026DeepAFL: Deep Analytic Federated Learningcited by 1
  9. 2026Move-Then-Operate: Behavioral Phasing for Human-Like Robotic Manipulationcited by 1
  10. 2026Position: Embodied AI Requires a Privacy-Utility Trade-offcited by 1
  11. 2026ForgeVLA: Federated Vision-Language-Action Learning without Language Annotationscited by 1
  12. 2026pFedNavi: Structure-Aware Personalized Federated Vision-Language Navigation for Embodied AIcited by 0
6 more
  1. 2026Fisher-Routed Mixture of Experts for Federated Class-Incremental Learningcited by 0
  2. 2026Modality-Decoupled Federated Learning for Privacy-Preserving Embodied Intelligence in 6Gcited by 0
  3. 2026Co-VLA: Consensus-based Federated Training for Vision-Language-Action Modelscited by 0
  4. 2026An Empirical Study and Open Testbed for Federated Fine-Tuning of Vision-Language-Action Modelscited by 0
  5. 2026Federated Subspace Guided Vision-Language-Action Policy Distillation for Non-IID Multi-Robot Manipulationcited by 0
  6. 2026RoboFL: Federated Expert Assembly for World Action Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts
  2. 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models
  3. 2025VITA-VLA: Efficiently Teaching Vision-Language Models to Act via Action Expert Distillation
  4. 2025Expertise need not monopolize: Action-Specialized Mixture of Experts for Vision-Language-Action Learning
  5. 2026FineVLA: Fine-Grained Instruction Alignment for Steerable Vision-Language-Action Policies
  6. 2026M2-VLA: Boosting Vision-Language Models for Generalizable Manipulation via Layer Mixture and Meta-Skills
  7. 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
  8. 2025See Once, Then Act: Vision-Language-Action Model with Task Learning from One-Shot Video Demonstrations