Diffusion Policy: Visuomotor Policy Learning via Action Diffusion
FeaturedCheng Chi, Siyuan Feng, Yilun Du, Zhenjia Xu, Eric Cousineau, Benjamin Burchfiel, Shuran Song · Columbia University, University of Tokyo, Toyota Research Institute · 2023
Framework
PyTorch
License
MIT
Stars
4,194
Summary
A behavior cloning approach that models robot policies as conditional diffusion processes, enabling multimodal action distributions and smooth action sequences.
Abstract Summary
Key Points
- Formulates behavior cloning as conditional diffusion over action sequences.
- Handles multimodal action distributions, avoiding deterministic averaging artifacts.
- Predicts action chunks (short horizons) for temporal smoothness and consistency.
- Compatible with CNN, Transformer, or MLP denoising backbones.
- Strong results on Push-T, Franka Kitchen, and real robot manipulation tasks.
Additional Notes
Training Tips
- Use the provided data augmentation pipelines for vision-based tasks; they are critical for generalization.
- Action horizon (prediction chunk length) is a key hyperparameter: longer horizons improve smoothness but increase inference cost.
- DDIM sampling with 10-20 steps is usually sufficient for real-time control.
Related Papers
- ACT (Zhao et al., 2023)
- Implicit Behavioral Cloning (Florence et al., 2022)
- RoboDiffusion (not a real paper, but many follow-ups exist)
Related Papers
EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Camera
Christen Millerdurai, Shaoxiang Wang, Yaxu Xie et al. · SIGGRAPH 2026 · May 2026
Reconstructing the absolute 3D pose and shape of the hands from the user's viewpoint using a single head-mounted camera is crucial for practical egocentric interaction in AR/VR, telepresence, and hand-centric manipulation tasks, where sensing must...
Aligning Flow Map Policies with Optimal Q-Guidance
Christos Ziakas, Alessandra Russo, Avishek Joey Bose · arXiv · May 2026
Generative policies based on expressive model classes, such as diffusion-models and flow matching, are well-suited to complex control problems with highly multimodal action distributions. Their expressivity, however, comes at a significant inference cost:...
MonoDuo: Using One Robot Arm to Learn Bimanual Policies
Sandeep Bajamahal, Lawrence Yunliang Chen, Toru Lin et al. · ICRA 2026 · May 2026
Bimanual coordination is essential for many real-world manipulation tasks, yet learning bimanual robot policies is limited by the scarcity of bimanual robots and datasets. Single-arm robots, however,
One Demonstration Is Enough for Real-World Robotic Reinforcement Learning
Yuwan Liu, Hongze Yu, Song Liu et al. · arXiv preprint · Jul 2026
Learning effective robot control policies on physical hardware is challenging due to costly data collection and the difficulty of reward specification. Prior work has incorporated ...