HiBerNAC: Hierarchical Brain-inspired Robotic Neural Agent Collective for Disentangling Complex Manipulation
On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA
Abstract (arXiv)
Recent advances in multimodal vision-language-action (VLA) models have revolutionized traditional robot learning, enabling systems to interpret vision, language, and action in unified frameworks for complex task planning. However, mastering complex manipulation tasks remains an open challenge, constrained by limitations in persistent contextual memory, multi-agent coordination under uncertainty, and dynamic long-horizon planning across variable sequences. To address this challenge, we propose HiBerNAC, a Hierarchical Brain-emulated robotic Neural Agent Collective, inspired by breakthroughs in neuroscience, particularly in neural circuit mechanisms and hierarchical decision-making. Our framework combines: (1) multimodal VLA planning and reasoning with (2) neuro-inspired reflection and multi-agent mechanisms, specifically designed for complex robotic manipulation tasks. By leveraging neuro-inspired functional modules with decentralized multi-agent collaboration, our approach enables robust and enhanced real-time execution of complex manipulation tasks. In addition, the agentic system exhibits scalable collective intelligence via dynamic agent specialization, adapting its coordination strategy to variable task horizons and complexity. Through extensive experiments on complex manipulation tasks compared with state-of-the-art VLA models, we demonstrate that HiBerNAC reduces average long-horizon task completion time by 23%, and achieves non-zero success rates (12textendash 31%) on multi-path tasks where prior state-of-the-art VLA models consistently fail. These results provide indicative evidence for bridging biological cognition and robotic learning mechanisms.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 50 of its 76 references that are in the map. First posted on arXiv 9 Jun 2025.
Builds on
50 of 76 references.
Closest ancestors · 1
Same direction, newest first
Other references · 49
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,823
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,321
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,218
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,450
- 2023PaLM 2 Technical Reportcited by 1,162
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,065
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,032
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 862
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 857
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 678
- 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 461
- 2023Cognitive Architectures for Language Agentscited by 427
37 more
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 426
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 397
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 292
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 278
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 213
- 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 171
- 2021Episodic Transformer for Vision-and-Language Navigationcited by 155
- 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 152
- 2023Large Language Models for Robotics: A Surveycited by 132
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 121
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 116
- 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 104
- 2021Skill Induction and Planning with Latent Languagecited by 99
- 2023RoboTAP: Tracking Arbitrary Points for Few-Shot Visual Imitationcited by 88
- 2023SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networkscited by 84
- 2023Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agentscited by 66
- 2021Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completioncited by 58
- 2025Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learningcited by 58
- 2023Grounding Complex Natural Language Commands for Temporal Tasks in Unseen Environmentscited by 52
- 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Taskscited by 52
- 2025Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructionscited by 50
- 2024A Dual Process VLA: Efficient Robotic Manipulation Leveraging VLMcited by 44
- 2021Hierarchical Skills for Efficient Explorationcited by 37
- 2023Action-Quantized Offline Reinforcement Learning for Robotic Skill Learningcited by 34
- 2024LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environmentscited by 32
- 2021Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulationcited by 31
- 2024TwoStep: Multi-agent Task Planning using Classical Planners and Large Language Modelscited by 29
- 2021Learning Transferable Motor Skills with Hierarchical Latent Mixture Policiescited by 26
- 2024Bi-VLA: Vision-Language-Action Model-Based System for Bimanual Robotic Dexterous Manipulationscited by 20
- 2024Probabilistically Correct Language-based Multi-Robot Planning using Conformal Predictioncited by 18
- 2022Spike-based local synaptic plasticity: A survey of computational models and neuromorphic circuitscited by 13
- 2024SRL-VIC: A Variable Stiffness-Based Safe Reinforcement Learning for Contact-Rich Robotic Taskscited by 12
- 2025Neural Brain: A Neuroscience-inspired Framework for Embodied Agentscited by 10
- 2024Autonomous Behavior Planning For Humanoid Loco-manipulation Through Grounded Language Modelcited by 8
- 2021Sharing to learn and learning to share; Fitting together Meta-Learning, Multi-Task Learning, and Transfer Learning: A meta reviewcited by 6
- 2020Scalability in Computing and Roboticscited by 3
- 2025Bresa: Bio-inspired Reflexive Safe Reinforcement Learning for Contact-Rich Robotic Taskscited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025FrankenBot: Brain-Morphic Modular Orchestration for Robotic Manipulation with Vision-Language Models
- 2026What Matters in Orchestrating Robot Policies: A Systematic Study of Hierarchical VLA Agents
- 2026Beyond Flat Policies: Hierarchical Post-Training for Embodied Agents in Robotic Manipulation
- 2026Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-horizon Manipulation
- 2025Agentic Robot: A Brain-Inspired Framework for Vision-Language-Action Models in Embodied Agents
- 2024MALMM: Multi-Agent Large Language Models for Zero-Shot Robotics Manipulation
- 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulation
- 2022VIMA: General Robot Manipulation with Multimodal Prompts