iGibson: Interactive Gibson Benchmark for Real-World Navigation and Manipulation

iGibson: Interactive Gibson Benchmark for Real-World Navigation and Manipulation

Bokui Shen, Fei Xia, Chengshu Li, Roberto Martin-Martin, Linxi Fan, Guanzhi Wang, Yunfei Bai, De-An Huang, Dinesh Jayaraman, Yuke Zhu, Li Fei-Fei, Anima Anandkumar, Isaac Kamwa, Jiajun Wu, Biao Jiang, Shengjie Lin, Yunhai Feng, Silvio Savarese · Stanford, NVIDIA, BIGAI, UT Austin · 2021

Framework

PyTorch + PyBullet

License

MIT

Stars

806

Summary

iGibson is a photorealistic, physics-based indoor simulation platform with 15 interactive scenes, 500+ object categories, and GPU-accelerated rendering, enabling RL and VLA training for mobile manipulation and embodied AI.

Abstract Summary

iGibson is the standard simulation platform for indoor robot navigation and manipulation research. Built on PyBullet for physics and iGibson renderer for photorealistic RGB, the platform provides 15 fully interactive scanned scenes (apartments, offices, houses) with 500+ object categories that can be opened, closed, picked, and placed. Unlike synthetic environments like Habitat or AI2-THOR, iGibson scenes are reconstructed from real-world scans, preserving accurate geometry, lighting, and object arrangements. iGibson 2.0 adds interactive physics: doors have hinges, drawers slide on rails, and liquids pour with particle simulation. This enables training policies for complex long-horizon tasks like "make coffee" (fill kettle → boil water → pour into cup) or "tidy the living room" (pick up objects → navigate to storage → place). The observation space includes RGB, depth, semantic segmentation, and scene graphs, making it compatible with both pure-vision RL and VLA models. The benchmark suite includes 50+ tasks: point-goal navigation, object-goal navigation, social navigation (avoiding virtual humans), rearrangement, and manipulation. Evaluation is standardized with generalization splits: train on apartment A, test on apartment B with different furniture layouts. iGibson is the evaluation platform for BEHAVIOR-1K, the largest embodied AI benchmark to date. For practitioners, iGibson installs via `pip install igibson` and integrates with Gymnasium, ROS2, and Habitat APIs. The asset downloader fetches scenes on-demand (total ~50GB). The included ROS2 bridge lets you run SLAM and navigation stacks (e.g., FAST-LIO2 + Nav2) in simulation before real-world deployment.

Key Points

  • 15 photorealistic scanned scenes with 500+ interactive objects.
  • Real-world accurate geometry, lighting, and object arrangements.
  • Interactive physics: doors, drawers, liquids, deformable objects.
  • 50+ tasks: navigation, rearrangement, manipulation, social nav.
  • ROS2 bridge + Gymnasium API for rapid sim-to-real transfer.
Share

Related Papers

Eureka: Human-Level Reward Design via Coding Large Language Models

Eureka: Human-Level Reward Design via Coding Large Language Models

Yecheng Jason Ma, William Liang, Guanzhi Wang et al. · ICLR 2024 (Oral) · May 2024

Eureka uses GPT-4 to write reward functions for RL environments, achieving human-level reward design on 29 tasks and enabling zero-shot sim-to-real transfer on Shadow Hand dexterous manipulation.

rl foundation-models sim-to-real
Code PDF Intermediate
GitHub ★ 3,161 Code updated: May 2026
Gymnasium: A Standard Interface for Reinforcement Learning Environments

Gymnasium: A Standard Interface for Reinforcement Learning Environments

Farama Foundation, Jordan Terry, Mark Towers et al. · JMLR 2023 · Mar 2023

Gymnasium is the maintained successor to OpenAI Gym, providing a standardized API for RL environments with 100+ built-in tasks, vectorized parallel execution, and native support for physics engines like MuJoCo, PyBullet, and IsaacGym.

rl foundation-models sim-to-real
Code Beginner
GitHub ★ 11,943 Code updated: May 2026
ManiSkill: A Unified Benchmark for Generalizable Manipulation Skills

ManiSkill: A Unified Benchmark for Generalizable Manipulation Skills

Jiayuan Gu, Sean Xiang, Stone Tao et al. · ICLR 2023 (Oral) · Jan 2023

ManiSkill is a GPU-parallelized robotics simulation benchmark with 20+ manipulation tasks, PartNet-Mobility assets, and unified observation/action spaces, supporting RL, IL, and VLA training at millions of steps per hour.

sim-to-real rl manipulation foundation-models
Code PDF Beginner
GitHub ★ 2,914 Code updated: May 2026