π0: A Vision-Language-Action Flow Model for General Robot Control

π0: A Vision-Language-Action Flow Model for General Robot Control

Featured

Karl Pertsch, Oliver Groth, Jonas Frey, Mingtian Zhang, Huy Ha, Xuanlin Li, Xialing Li, Kuan Fang, Kevin Black, Dorsa Sadigh, Quan Vuong, Sergey Levine · Physical Intelligence (π0) · 2024

Framework

PyTorch

License

Apache-2.0

Stars

11,990

Summary

π0 is a 3.5B-parameter VLA flow model from Physical Intelligence that achieves state-of-the-art general robot manipulation by mixing online RL with high-quality human demonstrations, available as an open-source PyTorch implementation.

Abstract Summary

π0 (pi-zero) is the open-source implementation of Physical Intelligence's VLA model, one of the most talked-about robotics foundation models of 2024. Unlike prior VLAs that treat action generation as next-token prediction, π0 models actions as a flow: it denoises an action trajectory from Gaussian noise to a clean, executable trajectory conditioned on visual observations and language instructions. This diffusion-inspired approach captures the multimodal nature of manipulation—there are many valid ways to pick up a cup—and produces smooth, human-like motions. The model architecture combines a 3.5B-parameter vision-language backbone (a fine-tuned VLM that processes camera images and language) with a flow-matching action head that outputs 7-DoF end-effector poses at 10 Hz. Training uses a mixture of internet-scale vision-language pretraining (for scene understanding) and robot-specific flow-matching pretraining (for action generation). The authors report that π0 outperforms RT-2-X, Octo, and OpenVLA on 7 real-world manipulation tasks, especially on bimanual and deformable-object tasks where action multimodality is critical. The open-source release (OpenPI) includes the full model weights, training code, evaluation suite on SimplerEnv, and a Gradio demo that runs on a single RTX 4090. The model supports both absolute pose control and delta pose control, making it compatible with most robot arms out of the box. The codebase also includes data loaders for ALOHA, BridgeData V2, and custom datasets, plus a distillation script for training smaller student models. π0 represents a shift in robot foundation models: rather than treating the robot as an afterthought bolted onto a VLM, it co-designs the vision-language and action representations so that the model truly "understands" physical interactions.

Key Points

  • 3.5B-parameter VLA model using flow matching for action generation.
  • Diffusion-inspired trajectory denoising captures multimodal manipulation.
  • Outperforms RT-2-X, Octo, and OpenVLA on real-world manipulation.
  • Open-source weights + training code + Gradio demo on RTX 4090.
  • Compatible with 7-DoF pose and delta control; ALOHA/Bridge data loaders.
Share

Related Papers

RT-1: Robotics Transformer for Real-World Control at Scale

RT-1: Robotics Transformer for Real-World Control at Scale

Anthony Brohan, Yevgen Chebotar, Chelsea Finn et al. · RSS 2023 · Jul 2023

RT-1 is a 35M-parameter transformer trained on 130K robot demonstrations that generalizes to new tasks, objects, and environments, forming the foundation for Google's RT-2 and RT-X line of VLA models.

foundation-models vla il manipulation
Code PDF Intermediate
GitHub ★ 1,723 Code updated: May 2026
DynaFLIP: Rethinking Robotics Perception via Tri-Modal-Dynamics Guided Representation

DynaFLIP: Rethinking Robotics Perception via Tri-Modal-Dynamics Guided Representation

Jusuk Lee, Seungjae Lee, Jonghun Shin et al. · arXiv preprint · May 2026

Robot manipulation critically depends on perception that preserves the action-relevant aspects of a scene. Yet most robot learning pipelines are built upon visual encoders pre-trained for static recog

foundation-models perception manipulation representation-learning vla
PDF Intermediate
No code repo Code updated: May 2026