WCM: World-Cognition Model for Generalizable Human-Robot Interaction
Not on the map. Why?
Abstract (arXiv)
Language agents can now interact fluently with users in software, but robots still struggle to bring comparable interaction to physical tasks. Current robot-control paradigms, including vision-language-action policies and world-model-based planners, are mainly optimized for instruction execution, leaving users with little visibility into why an action is chosen and few mechanisms to redirect, correct, or teach the robot through interaction. To solve this problem, we present the World-Cognition Model (WCM), a human-centered embodied agent built on the SLAK architecture (Sensing, Logic, Action, and Knowledge) and an asynchronous runtime. SLAK separates perception, reasoning, control, and memory, while the runtime allows reasoning, dialogue, and execution to proceed concurrently. WCM further introduces a human-in-the-loop teaching mode that enables users to interactively teach the robot difficult or long-horizon tasks. Teaching episodes and autonomous task rollouts are refined into chain-of-thought supervision to continually improve the model. WCM achieves a 73.8% average success rate across nine real-world human-robot interaction tasks, including tasks held out from CoT fine-tuning and a long-horizon task learned through teaching.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 37 references that are in the map. First posted on arXiv 25 Jul 2026.
Builds on
32 of 37 references.
References · 32
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Let's Verify Step by Stepcited by 3,789
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2018World Modelscited by 1,513
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
20 more
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024Genie: Generative Interactive Environmentscited by 747
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 737
- 2022DayDreamer: World Models for Physical Robot Learningcited by 400
- 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Stepcited by 235
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
- 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 195
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Modelscited by 179
- 2023Implicit Chain of Thought Reasoning via Knowledge Distillationcited by 176
- 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 111
- 2026GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulationcited by 8
- 2024You've Got to Feel It To Believe It: Multi-Modal Bayesian Inference for Semantic and Property Predictioncited by 7
- 2026Stream3D: Sequential Multi-View 3D Generation via Evidential Memorycited by 7
- 2025MatPredict: a dataset and benchmark for learning material properties of diverse indoor objectscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Language to Action: Can LLM-Based Agents Be Used for Embodied Robot Cognition?
- 2025CLEA: Closed-Loop Embodied Agent for Enhancing Task Execution in Dynamic Environments
- 2025Robix: A Unified Model for Robot Interaction, Reasoning and Planning
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence
- 2026World-Action Models for Robot Learning and Control: A Survey
- 2023Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents
- 2026Towards Agentic Robots: Model, Data, Environment, and Harness
- 2025RoBridge: A Hierarchical Architecture Bridging Cognition and Execution for General Robotic Manipulation