Towards Professional Tennis Styles for Humanoid Robots with Adaptive Motion Planning and Tracking

Towards Professional Tennis Styles for Humanoid Robots with Adaptive Motion Planning and Tracking

Tao Huang, Ruofei Liu, Xuchen Tang, Xinyin Zhang, Junli Ren, Huayi Wang, Feiyu Jia, Yukai Qi, Kangning Yin, Weishuai Zeng, Lipeng Chen, Xi Li, Ting Wu, Kailin Li, Ruoli Dai, Jingbo Wang, Lei Han, Jiangmiao Pang · N/A · 2026

Framework

N/A

License

N/A

Stars

N/A

Summary

Humanoid robots have recently demonstrated promising capabilities in real-world ball sports. However, achieving professional motion styles while maintaining strong task performance remains challenging.

Abstract Summary

Humanoid robots have recently demonstrated promising capabilities in real-world ball sports. However, achieving professional motion styles while maintaining strong task performance remains challenging. In this work, we propose AdaPT, an Adaptive Motion Planning and Tracking framework that learns professional tennis serving and rally styles directly from broadcast videos. This hierarchical design is motivated by the key insight that the planner generates stylistic kinematic motions, while the tracker executes them with minimal interference with planning. Despite its effectiveness in simulation, a substantial sim-to-real gap emerges: tracking performance inevitably degrades on real robots, and this degradation is partially overlooked by autoregressive planning and further compounded by noisy perception. To address these issues, our adaptation mechanism improves tracking robustness by learning to track randomized execution speeds, while conditioning the planner on a learned motion-speed adapter to mitigate compounding errors. Real-world experiments on the Unitree G1 demonstrate the effectiveness of our adaptation mechanism in bridging the sim-to-real gap. We further deploy AdaPT policies on the full-size Dobot Atom humanoid robot (1.7m) and demonstrate in-the-wild serving without motion capture. Beyond these results, our real-world experiments reveal both algorithmic and engineering insights for future humanoid ball-sports systems. Videos and code are available on our \href{https://humanoidtennis.github.io/AdaPT/}{project website}.

Key Points

  • Humanoid robots have recently demonstrated promising capabilities in real-world ball sports
  • However, achieving professional motion styles while maintaining strong task performance remains challenging.
  • In this work, we propose AdaPT, an Adaptive Motion Planning and Tracking framework that learns professional tennis serving and rally styles directly from broadcast videos.
  • This hierarchical design is motivated by the key insight that the planner generates stylistic kinematic motions, while the tracker executes them with minimal interference with planning.
  • Despite its effectiveness in simulation, a substantial sim-to-real gap emerges: tracking performance inevitably degrades on real robots, and this degradation is partially overlooked by autoregressive planning and further compounded by noisy perception.

AdaPT: Ada ptive Motion P lanning and T racking for Humanoid Tennis

Our goal is to learn professional humanoid tennis skills through the decoupled motion planning and tracking framework, where the motion planning is performed independently of environment dynamics and focuses on generating kinematic motions to ensure stylistic imitation ( Fig. 2 ). Intuitively, rally and serve exhibit fundamentally different characteristics, motivating distinct method designs.

AdaPT: Ada ptive Motion P lanning and T racking for Humanoid Tennis — Towards Professional Tennis Styles for Humanoid Robots with Adaptive Motion Planning and Tracking
Figure 2: AdaPT learns stylized humanoid tennis skills through the pipeline: (a) broadcast videos are reconstructed, retargeted, and physically corrected to obtain tennis motions; (b) speed-adaptive policies learn to track serve and rally motions; (c) high-level planners select or generate style-consistent motions for serve and rally; (d) our robot localization or ball detection modules enable sim-to-real deployment, especially for serving without MoCap.

Experiments

The main experiments are conducted in an approximately $20\mathrm{m}\times 8\mathrm{m}$ motion-capture arena equipped with 35 Noitom MCC-400 cameras [ 25 ] for tracking the robot root pose and ball position. We use the Unitree G1 robot for testing. The tennis ball is customized to be reflective by attaching reflective materials to standard tennis balls.

Due to the limited capture space, we adopt the ‘Tennis 10s’ system, whose singles court size is approximately $18\times 6.5$ m.

Experiments — Towards Professional Tennis Styles for Humanoid Robots with Adaptive Motion Planning and Tracking
Figure 3: Serve hardware.

Sources and Demonstrations

Figures are reproduced from Huang et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.

Share

Related Papers

A Sim-to-Real Integration Pipeline for Training and Deployment of Chunk-Based VLA Manipulation Policies
arXiv preprint

A Sim-to-Real Integration Pipeline for Training and Deployment of Chunk-Based VLA Manipulation Policies

Mathilde Kappel, Clémence Grislain, Mohamed Chetouani et al.

Vision-Language-Action (VLA) models have become a prominent paradigm for mapping multimodal inputs, including semantic instructions, visual observations of the scene, and proprioceptive observations, to robot actions.

manipulation vision vla reinforcement-learning sim-to-real control learning-from-demonstration benchmark
PDF Advanced