Humanoid-Gym: Reinforcement Learning for Humanoid Robot with Zero-Shot Sim2Real Transfer
Wang J., Xiao B., Wang J., Heider P., Li H., Zhang Y. · RobotEra / K-Scale Labs · 2024
Framework
Isaac Gym / PyTorch
License
MIT
Stars
10
Summary
An Isaac-Gym-based training framework for humanoid locomotion that enables zero-shot sim-to-real transfer on XBot-L/XBot-S robots via domain randomization.
Abstract Summary
Key Points
- Isaac-Gym PPO training at 4096 parallel environments with humanoid-specific rewards.
- Zero-shot sim-to-real demonstrated on XBot-L and XBot-S hardware.
- Built-in sim2sim pipeline (Isaac Gym -> MuJoCo) for pre-transfer validation.
- Domain randomization across terrain, actuator dynamics, and sensor delay.
- Open-source release with URDF, training configs, and deployment scripts.
Additional Notes
Training Tips
- Start training at ~2.5 m/s target speed; increase only after policy shows stable foot contact patterns.
- Use the terrain curriculum: rolling friction -> box obstacles -> rough terrain over several iterations.
- Ensure GPU driver 525+ to avoid Isaac Gym rendering crashes on some workstation setups.
Related Papers
- Isaac Gym (Makoviychuk et al., 2021)
- RSL-RL (Rudin et al., 2022)
- Berkeley Humanoid (Kousik et al., 2024)
Related Papers
Berkeley Humanoid: A Low-Cost 3D-Printed Humanoid for Research
Zachary Kousik, Shanpu Fang, Rohan Thakker et al. · arXiv · 2024
An open-source 3D-printed humanoid robot platform designed for reinforcement-learning based locomotion research with affordable hardware.
SafeManip: A Property-Driven Benchmark for Temporal Safety Evaluation in Robotic Manipulation
Chengyue Huang, Khang Vo Huynh, Sebastian Elbaum et al. · arXiv · May 2026
Robotic manipulation is typically evaluated by task success, but successful completion does not guarantee safe execution. Many rl failures are temporal: a robot may touch a clean surface after contamination or release an object before it is...
Unitree Go2: Learning Vision-Based Quadrupedal Locomotion End-to-End
Nikita Rudin, Fabian Jenelten, Timon Homberger et al. · ICRA 2024 · May 2024
Unitree Go2 uses cross-modal vision + proprioception transformers trained in Isaac Gym to achieve agile navigation over rough terrain with minimal sim-to-real gap.
Legged Gym: A Framework for Massively Parallel Reinforcement Learning of Legged Locomotion
Nikita Rudin, David Hoeller, Philipp Reist et al. · RSS 2022 Workshop / arXiv 2109.11978 · Jun 2022
Legged Gym is an open-source training framework built on NVIDIA Isaac Gym that enables massively parallel deep RL for legged robot locomotion, achieving policy training times of minutes rather than days.