Strategy and Skill Learning for Physics-based Table Tennis Animation
Not on the map. Why?
Abstract (arXiv)
Recent advancements in physics-based character animation leverage deep learning to generate agile and natural motion, enabling characters to execute movements such as backflips, boxing, and tennis. However, reproducing the selection and use of diverse motor skills in dynamic environments to solve complex tasks, as humans do, still remains a challenge. We present a strategy and skill learning approach for physics-based table tennis animation. Our method addresses the issue of mode collapse, where the characters do not fully utilize the motor skills they need to perform to execute complex tasks. More specifically, we demonstrate a hierarchical control system for diversified skill learning and a strategy learning framework for effective decision-making. We showcase the efficacy of our method through comparative analysis with state-of-the-art methods, demonstrating its capabilities in executing various skills for table tennis. Our strategy learning framework is validated through both agent-agent interaction and human-agent interaction in Virtual Reality, handling both competitive and cooperative tasks.
Key facts. Cited by 17 papers in the map (data through 13 Oct 2026). Builds on 16 of its 49 references that are in the map. First posted on arXiv 23 Jul 2024.
Builds on
16 of 49 references.
References · 16
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 890
- 2018DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skillscited by 153
- 2018Neural probabilistic motor primitives for humanoid controlcited by 96
- 2023CALM: Conditional Adversarial Latent Models for Directable Virtual Characterscited by 91
- 2023C·ASE: Learning Conditional Adversarial Skill Embeddings for Physics-based Characterscited by 53
- 2023Deep Imitation Learning for Humanoid Loco-manipulation through Human Teleoperationcited by 49
- 2021Adversarial Skill Chaining for Long-Horizon Robot Manipulation via Terminal State Regularizationcited by 44
- 2023PMP: Learning to Physically Interact with Environments using Part-wise Motion Priorscited by 38
- 2023Neural Categorical Priors for Physics-Based Character Controlcited by 37
- 2023Composite Motion Learning with Task Controlcited by 26
- 2017Learnings Options End-to-End for Continuous Action Taskscited by 24
- 2022ControlVAE: Model-Based Learning of Generative Controllers for Physics-Based Characterscited by 21
4 more
- 2023Animating Human Athleticscited by 16
- 2018Safe Option-Critic: Learning Safety in the Option-Critic Architecturecited by 10
- 2023Explainable Human-Robot Training and Cooperation with Augmented Realitycited by 6
- 2021Assessing Human Interaction in Virtual Reality With Continually Learning Prediction Agents Based on Reinforcement Learning Algorithms: A Pilot Studycited by 5
Built on by
Citing papers per year: 2024: 3; 2025: 10; 2026: 4.
17 papers.
Sort:
By area:
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 105
- 2024ExBody2: Advanced Expressive Humanoid Whole-Body Controlcited by 76
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 68
- 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 48
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Controlcited by 41
- 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generationcited by 32
- 2025PARC: Physics-based Augmentation with Reinforcement Learning for Character Controllerscited by 24
- 2025SkillMimic-V2: Learning Robust and Generalizable Interaction Skills from Sparse and Noisy Demonstrationscited by 23
- 2025CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objectscited by 11
- 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactionscited by 10
- 2025Learning to Ball: Composing Policies for Long-Horizon Basketball Movescited by 6
- 2025InterAgent: Physics-based Multi-agent Command Execution via Diffusion on Interaction Graphscited by 4
5 more
- 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Sizecited by 4
- 2025Egocentric Event-Based Vision for Ping Pong Ball Trajectory Predictioncited by 3
- 2026Learning Human-Like Badminton Skills for Humanoid Robotscited by 3
- 2026DeVI: Physics-based Dexterous Human-Object Interaction via Synthetic Video Imitationcited by 1
- 2024LocoVR: Multiuser Indoor Locomotion Dataset in Virtual Realitycited by 0
- 2026DeVI: Physics-based Dexterous Human-Object Interaction via Synthetic Video Imitation22 Apr 2026
- 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Size9 Mar 2026
- 2026Learning Human-Like Badminton Skills for Humanoid Robots9 Feb 2026
- 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactions5 Feb 2026
- 2025InterAgent: Physics-based Multi-agent Command Execution via Diffusion on Interaction Graphs8 Dec 2025
- 2025Learning to Ball: Composing Policies for Long-Horizon Basketball Moves26 Sep 2025
- 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation11 Sep 2025
- 2025Egocentric Event-Based Vision for Ping Pong Ball Trajectory Prediction9 Jun 2025
- 2025CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objects27 May 2025
- 2025PARC: Physics-based Augmentation with Reinforcement Learning for Character Controllers6 May 2025
- 2025SkillMimic-V2: Learning Robust and Generalizable Interaction Skills from Sparse and Noisy Demonstrations4 May 2025
- 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenization25 Mar 2025
5 more
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactions27 Feb 2025
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills3 Feb 2025
- 2024ExBody2: Advanced Expressive Humanoid Whole-Body Control17 Dec 2024
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Control10 Dec 2024
- 2024LocoVR: Multiuser Indoor Locomotion Dataset in Virtual Reality9 Oct 2024
- 2025PARC: Physics-based Augmentation with Reinforcement Learning for Character Controllerscited by 24
- 2025SkillMimic-V2: Learning Robust and Generalizable Interaction Skills from Sparse and Noisy Demonstrationscited by 23
- 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactionscited by 10
- 2025Learning to Ball: Composing Policies for Long-Horizon Basketball Movescited by 6
- 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactions5 Feb 2026
- 2025Learning to Ball: Composing Policies for Long-Horizon Basketball Moves26 Sep 2025
- 2025PARC: Physics-based Augmentation with Reinforcement Learning for Character Controllers6 May 2025
- 2025SkillMimic-V2: Learning Robust and Generalizable Interaction Skills from Sparse and Noisy Demonstrations4 May 2025
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 105
- 2024ExBody2: Advanced Expressive Humanoid Whole-Body Controlcited by 76
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 68
- 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 48
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Controlcited by 41
- 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generationcited by 32
- 2025CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objectscited by 11
- 2025InterAgent: Physics-based Multi-agent Command Execution via Diffusion on Interaction Graphscited by 4
- 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Sizecited by 4
- 2025Egocentric Event-Based Vision for Ping Pong Ball Trajectory Predictioncited by 3
- 2026Learning Human-Like Badminton Skills for Humanoid Robotscited by 3
- 2026DeVI: Physics-based Dexterous Human-Object Interaction via Synthetic Video Imitationcited by 1
12 most cited of 13 All 13 (JSON)
- 2026DeVI: Physics-based Dexterous Human-Object Interaction via Synthetic Video Imitation22 Apr 2026
- 2026TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Size9 Mar 2026
- 2026Learning Human-Like Badminton Skills for Humanoid Robots9 Feb 2026
- 2025InterAgent: Physics-based Multi-agent Command Execution via Diffusion on Interaction Graphs8 Dec 2025
- 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation11 Sep 2025
- 2025Egocentric Event-Based Vision for Ping Pong Ball Trajectory Prediction9 Jun 2025
- 2025CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objects27 May 2025
- 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenization25 Mar 2025
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactions27 Feb 2025
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills3 Feb 2025
- 2024ExBody2: Advanced Expressive Humanoid Whole-Body Control17 Dec 2024
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Control10 Dec 2024
12 newest of 13 All 13 (JSON)