# HARMONIC: A Content-Centric Cognitive Robotic Architecture

arXiv: https://arxiv.org/abs/2509.13279 · HTML: https://mlsanity.com/paper/2509.13279/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 18 of its 42 references that are in the map.
- First posted on arXiv 16 Sep 2025.

## Builds on (most cited first, 18 of 18)

- [RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control](https://mlsanity.com/paper/2307.15818/) (2023)
- [OpenVLA: An Open-Source Vision-Language-Action Model](https://mlsanity.com/paper/2406.09246/) (2024)
- [π0: A Vision-Language-Action Flow Model for General Robot Control](https://mlsanity.com/paper/2410.24164/) (2024)
- [Do As I Can, Not As I Say: Grounding Language in Robotic Affordances](https://mlsanity.com/paper/2204.01691/) (2022)
- [GR00T N1: An Open Foundation Model for Generalist Humanoid Robots](https://mlsanity.com/paper/2503.14734/) (2025)
- [Open X-Embodiment: Robotic Learning Datasets and RT-X Models](https://mlsanity.com/paper/2310.08864/) (2023)
- [Hallucination of Multimodal Large Language Models: A Survey](https://mlsanity.com/paper/2404.18930/) (2024)
- [Behavior Trees in Robotics and AI: An Introduction](https://mlsanity.com/paper/1709.00084/) (2017)
- [AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents](https://mlsanity.com/paper/2401.12963/) (2024)
- [Real-World Robot Applications of Foundation Models: A Review](https://mlsanity.com/paper/2402.05741/) (2024)
- [Practical Verification of Decision-Making in Agent-Based Autonomous Systems](https://mlsanity.com/paper/1310.2431/) (2013)
- [On the Implementation of Behavior Trees in Robotics](https://mlsanity.com/paper/2106.15227/) (2021)
- [RoBridge: A Hierarchical Architecture Bridging Cognition and Execution for General Robotic Manipulation](https://mlsanity.com/paper/2505.01709/) (2025)
- [BOSS: Benchmark for Observation Space Shift in Long-Horizon Task](https://mlsanity.com/paper/2502.15679/) (2025)
- [KT-BT: A Framework for Knowledge Transfer Through Behavior Trees in Multi-Robot Systems](https://mlsanity.com/paper/2209.02886/) (2022)
- [Automating Knowledge Acquisition for Content-Centric Cognitive Agents Using LLMs](https://mlsanity.com/paper/2312.16378/) (2023)
- [HARMONIC: A Framework for Explanatory Cognitive Robots](https://mlsanity.com/paper/2409.18037/) (2024)
- [Heterogeneous Full-body Control of a Mobile Manipulator with Behavior Trees](https://mlsanity.com/paper/2210.08600/) (2022)

## Abstract (arXiv)

This paper introduces HARMONIC, a cognitive-robotic architecture designed for robots in human-robotic teams. HARMONIC supports semantic perception interpretation, human-like decision-making, and intentional language communication. It addresses the issues of safety and quality of results; aims to solve problems of data scarcity, explainability, and safety; and promotes transparency and trust. Two proof-of-concept HARMONIC-based robotic systems are demonstrated, each implemented in both a high-fidelity simulation environment and on physical robotic platforms.