LeRobot: A Library for Real-World Robot Learning

LeRobot: A Library for Real-World Robot Learning

Featured

Remi Cadene, Simon Alibert, Alexander Soare, Quentin Gallouedec, Etienne Arlaud, Austin Patel, Milan Schmid, Xavier Lagorce, Yann Lecun, Yann LeCun · Hugging Face, Meta, Sorbonne · 2024

Framework

PyTorch

License

Apache-2.0

Stars

24,333

Summary

Hugging Face's LeRobot is an open-source PyTorch framework providing pretrained models, datasets, and training scripts for imitation and reinforcement learning on real robots, lowering the entry barrier to robot learning.

Abstract Summary

LeRobot is Hugging Face's answer to the fragmentation in robot learning codebases. Instead of every lab maintaining its own implementation of Diffusion Policy, ACT, or Octo, LeRobot provides a single, well-documented PyTorch library with pretrained weights, standard datasets (ALOHA, Push-T, etc.), and training scripts that work out-of-the-box on real hardware. The library is built around four pillars: datasets (the `LeRobotDataset` format stores raw sensor data on disk and only loads what's needed), models (pretrained weights for ACT, Diffusion Policy, and Octo on Hugging Face Hub), examples (training scripts for imitation and RL), and simulation (basic MuJoCo and habitat integration). The key design philosophy is composability: you can swap out the backbone, the policy head, or the data augmentation pipeline without rewriting the training loop. LeRobot also introduces `OpenPi0`, a community replication of Physical Intelligence's π₀ VLA model, available entirely in PyTorch. This makes it possible to run a state-of-the-art policy on a consumer GPU without needing proprietary infrastructure. Perhaps the most impactful feature is the `lerobot` CLI: with a one-liner (`pip install lerobot`), researchers can download pretrained models, visualize datasets in 3D, and fine-tune policies on their own robot data. The accompanying dataset viewer and hardware integration guides make it one of the most accessible entry points for newcomers to robot learning.

Key Points

  • Unified PyTorch library for imitation and reinforcement learning on real robots.
  • Pretrained models (ACT, Diffusion Policy, Octo, OpenPi0) hosted on Hugging Face Hub.
  • Standard dataset format with efficient on-disk storage and lazy loading.
  • CLI tools for dataset visualization, model inference, and hardware integration.
  • Active community: 2,300+ GitHub stars, weekly PRs, extensive hardware tutorials.
Share

Related Papers

X-Imitator: Spatial-Aware Imitation Learning via Bidirectional Action-Pose Interaction

X-Imitator: Spatial-Aware Imitation Learning via Bidirectional Action-Pose Interaction

Kai Xiong, Hongjie Fang, Lixin Yang et al. · arXiv · May 2026

Effectively handling the interplay between spatial perception and action generation remains a critical bottleneck in robotic manipulation. Existing methods typically treat spatial perception and action execution as decoupled or strictly...

imitation-learning manipulation foundation-models
PDF Intermediate
No code repo May 2026
DROID: A Large-Scale In-the-Wild Robot Manipulation Dataset

DROID: A Large-Scale In-the-Wild Robot Manipulation Dataset

Alexander Khazatsky, Karl Pertsch, Suraj Nair et al. · RSS 2024 · Jul 2024

A 350-hour dataset of diverse real-world robot manipulation across 22 robots in 71 scenes, designed to train scalable and generalist imitation learning policies.

imitation-learning manipulation foundation-models
Code PDF Advanced
GitHub ★ 362 Code updated: May 2026