System Design for Maintaining Internal State Consistency in Long-Horizon Robotic Tabletop Games
Not on the map. Why?
Abstract (arXiv)
Long-horizon tabletop games pose a distinct systems challenge for robotics: small perceptual or execution errors can invalidate accumulated task state, propagate across decision-making modules, and ultimately derail interaction. This paper studies how to maintain internal state consistency in turn-based, multi-human robotic tabletop games through deliberate system design rather than isolated component improvement. Using Mahjong as a representative long-horizon setting, we present an integrated architecture that explicitly maintains perceptual, execution, and interaction state, partitions high-level semantic reasoning from time-critical perception and control, and incorporates verified action primitives with tactile-triggered recovery to prevent premature state corruption. We further introduce interaction-level monitoring mechanisms to detect turn violations and hidden-information breaches that threaten execution assumptions. Beyond demonstrating complete-game operation, we provide an empirical characterization of failure modes, recovery effectiveness, cross-module error propagation, and hardware-algorithm trade-offs observed during deployment. Our results show that explicit partitioning, monitored state transitions, and recovery mechanisms are critical for sustaining executable consistency over extended play, whereas monolithic or unverified pipelines lead to measurable degradation in end-to-end reliability. The proposed system serves as an empirical platform for studying system-level design principles in long-horizon, turn-based interaction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 39 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
25 of 39 references.
References · 25
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023Segment Anythingcited by 8,158
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2025DINOv3cited by 1,297
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2023Putting the Object Back into Video Object Segmentationcited by 182
- 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectivescited by 88
13 more
- 2025DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Graspingcited by 87
- 2023ChessGPT: Bridging Policy Learning and Language Modelingcited by 73
- 2025MemER: Scaling Up Memory for Robot Control via Experience Retrievalcited by 64
- 2024Real-World Robot Applications of Foundation Models: A Reviewcited by 60
- 2020Suphx: Mastering Mahjong with Deep Reinforcement Learningcited by 55
- 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Taskscited by 51
- 2025RoboGround: Robotic Manipulation with Grounded Vision-Language Priorscited by 50
- 2024UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Modelscited by 6
- 2025Hierarchical Task Decomposition for Execution Monitoring and Error Recovery: Understanding the Rationale Behind Task Demonstrationscited by 4
- 2022Deep Instance Segmentation and Visual Servoing to Play Jenga with a Cost-Effective Robotic Systemcited by 1
- 2023Integration of Robotics, Computer Vision, and Algorithm Design: A Chinese Poker Self-Playing Robotcited by 1
- 2024An Open-Source Reproducible Chess Robot for Human-Robot Interaction Researchcited by 1
- 2025Gondola: Grounded Vision Language Planning for Robotic Manipulationcited by 1
Built on by
Not cited yet.