PAC-MAN: Perception-Aware CBF-RL for Whole-Body Safety in Humanoid Dodgeball
Not on the map. Why?
Abstract (arXiv)
We present PAC-MAN, a perception-aware CBF-RL framework that couples control-barrier safety with deployment-realistic onboard sensing for whole-body humanoid dodgeball. The deployed policy sees the ball only as segmentation-masked depth from a head-mounted camera, while training-time CBF guidance represents clearance to every body link, and an adversarial motion prior regularizes the resulting evasive reflexes. We evaluate on a controlled any-link contact benchmark with seeded throws in two regimes: single throws and a deployment loop in which the robot walks back to its station and recovers between throws. On this benchmark, the policy comes within a few points of a privileged state oracle: a fixed onboard camera alone is adequate for evasion. We find that usable barrier structure depends on perceptual observability: Joint-CBF gives the best performance with accurate ball states, degrades under fixed-camera observations when used only as training guidance, and recovers with a ball-tracking gimbal or privileged runtime filter. We therefore deploy a lightweight Link-CBF policy zero-shot on the Unitree G1 in the real world, where it tolerates imperfect perception, succeeds on 95% of throws, and uses semantic segmentation to dodge different balls.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 36 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
29 of 36 references.
References · 29
- 2016Control Barrier Function Based Quadratic Programs for Safety Critical Systemscited by 261
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
- 2023Extreme Parkour with Legged Robotscited by 120
- 2023ANYmal Parkour: Learning Agile Navigation for Quadrupedal Robotscited by 105
- 2021Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robotscited by 95
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 72
- 2024Humanoid Parkour Learningcited by 66
- 2025Retargeting Matters: General Motion Retargeting for Humanoid Motion Trackingcited by 60
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interactioncited by 57
- 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotioncited by 53
- 2025Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learningcited by 52
17 more
- 2025AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Controlcited by 47
- 2023Sim-to-Real Learning for Humanoid Box Loco-Manipulationcited by 30
- 2025HITTER: A HumanoId Table TEnnis Robot via Hierarchical Planning and Learningcited by 29
- 2024Opt2Skill: Imitating Dynamically-feasible Whole-Body Trajectories for Versatile Humanoid Loco-Manipulationcited by 28
- 2025RSL-RL: A Learning Library for Robotics Researchcited by 28
- 2025VisualMimic: Visual Humanoid Loco-Manipulation via Motion Tracking and Generationcited by 21
- 2022A Collision-Free MPC for Whole-Body Dynamic Locomotion and Manipulationcited by 15
- 2025SMP: Reusable Score-Matching Motion Priors for Physics-Based Character Controlcited by 14
- 2026mjlab: A Lightweight Framework for GPU-Accelerated Robot Learningcited by 13
- 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matchingcited by 13
- 2025CBF-RL: Safety Filtering Reinforcement Learning in Training with Control Barrier Functionscited by 8
- 2026Deep Whole-body Parkourcited by 5
- 2026Walk the PLANC: Physics-Guided RL for Agile Humanoid Locomotion on Constrained Footholdscited by 4
- 2026CReF: Cross-modal and Recurrent Fusion for Depth-conditioned Humanoid Locomotioncited by 2
- 2026BAT: Balancing Agility and Stability via Online Policy Switching for Long-Horizon Whole-Body Humanoid Controlcited by 1
- 2026Egocentric Tactile and Proximity Sensors as Observation Priors for Humanoid Collision Avoidancecited by 1
- 2026TAGA: Terrain-aware Active Gaze Learning for Generalizable Agile Humanoid Locomotioncited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.