mlsanityData to 13 Oct 2026

HiBerNAC: Hierarchical Brain-inspired Robotic Neural Agent Collective for Disentangling Complex Manipulation

arXiv 2506.08296 ↗First posted 9 Jun 2025cs.ROcited by 1

On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA

Abstract (arXiv)

Recent advances in multimodal vision-language-action (VLA) models have revolutionized traditional robot learning, enabling systems to interpret vision, language, and action in unified frameworks for complex task planning. However, mastering complex manipulation tasks remains an open challenge, constrained by limitations in persistent contextual memory, multi-agent coordination under uncertainty, and dynamic long-horizon planning across variable sequences. To address this challenge, we propose HiBerNAC, a Hierarchical Brain-emulated robotic Neural Agent Collective, inspired by breakthroughs in neuroscience, particularly in neural circuit mechanisms and hierarchical decision-making. Our framework combines: (1) multimodal VLA planning and reasoning with (2) neuro-inspired reflection and multi-agent mechanisms, specifically designed for complex robotic manipulation tasks. By leveraging neuro-inspired functional modules with decentralized multi-agent collaboration, our approach enables robust and enhanced real-time execution of complex manipulation tasks. In addition, the agentic system exhibits scalable collective intelligence via dynamic agent specialization, adapting its coordination strategy to variable task horizons and complexity. Through extensive experiments on complex manipulation tasks compared with state-of-the-art VLA models, we demonstrate that HiBerNAC reduces average long-horizon task completion time by 23%, and achieves non-zero success rates (12textendash 31%) on multi-path tasks where prior state-of-the-art VLA models consistently fail. These results provide indicative evidence for bridging biological cognition and robotic learning mechanisms.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 50 of its 76 references that are in the map. First posted on arXiv 9 Jun 2025.

Builds on

50 of 76 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul

Other references · 49

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,823
  2. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,321
  3. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,218
  4. 2024Octo: An Open-Source Generalist Robot Policycited by 1,450
  5. 2023PaLM 2 Technical Reportcited by 1,162
  6. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,065
  7. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,032
  8. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 862
  9. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 857
  10. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 678
  11. 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 461
  12. 2023Cognitive Architectures for Language Agentscited by 427
37 more
  1. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 426
  2. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 397
  3. 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 292
  4. 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 278
  5. 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 213
  6. 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 171
  7. 2021Episodic Transformer for Vision-and-Language Navigationcited by 155
  8. 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 152
  9. 2023Large Language Models for Robotics: A Surveycited by 132
  10. 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 121
  11. 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 116
  12. 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 104
  13. 2021Skill Induction and Planning with Latent Languagecited by 99
  14. 2023RoboTAP: Tracking Arbitrary Points for Few-Shot Visual Imitationcited by 88
  15. 2023SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networkscited by 84
  16. 2023Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agentscited by 66
  17. 2021Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completioncited by 58
  18. 2025Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learningcited by 58
  19. 2023Grounding Complex Natural Language Commands for Temporal Tasks in Unseen Environmentscited by 52
  20. 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Taskscited by 52
  21. 2025Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructionscited by 50
  22. 2024A Dual Process VLA: Efficient Robotic Manipulation Leveraging VLMcited by 44
  23. 2021Hierarchical Skills for Efficient Explorationcited by 37
  24. 2023Action-Quantized Offline Reinforcement Learning for Robotic Skill Learningcited by 34
  25. 2024LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environmentscited by 32
  26. 2021Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulationcited by 31
  27. 2024TwoStep: Multi-agent Task Planning using Classical Planners and Large Language Modelscited by 29
  28. 2021Learning Transferable Motor Skills with Hierarchical Latent Mixture Policiescited by 26
  29. 2024Bi-VLA: Vision-Language-Action Model-Based System for Bimanual Robotic Dexterous Manipulationscited by 20
  30. 2024Probabilistically Correct Language-based Multi-Robot Planning using Conformal Predictioncited by 18
  31. 2022Spike-based local synaptic plasticity: A survey of computational models and neuromorphic circuitscited by 13
  32. 2024SRL-VIC: A Variable Stiffness-Based Safe Reinforcement Learning for Contact-Rich Robotic Taskscited by 12
  33. 2025Neural Brain: A Neuroscience-inspired Framework for Embodied Agentscited by 10
  34. 2024Autonomous Behavior Planning For Humanoid Loco-manipulation Through Grounded Language Modelcited by 8
  35. 2021Sharing to learn and learning to share; Fitting together Meta-Learning, Multi-Task Learning, and Transfer Learning: A meta reviewcited by 6
  36. 2020Scalability in Computing and Roboticscited by 3
  37. 2025Bresa: Bio-inspired Reflexive Safe Reinforcement Learning for Contact-Rich Robotic Taskscited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025FrankenBot: Brain-Morphic Modular Orchestration for Robotic Manipulation with Vision-Language Models
  2. 2026What Matters in Orchestrating Robot Policies: A Systematic Study of Hierarchical VLA Agents
  3. 2026Beyond Flat Policies: Hierarchical Post-Training for Embodied Agents in Robotic Manipulation
  4. 2026Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-horizon Manipulation
  5. 2025Agentic Robot: A Brain-Inspired Framework for Vision-Language-Action Models in Embodied Agents
  6. 2024MALMM: Multi-Agent Large Language Models for Zero-Shot Robotics Manipulation
  7. 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulation
  8. 2022VIMA: General Robot Manipulation with Multimodal Prompts