Large language models integrated into robotic reasoning and planning.
Moo Jin Kim, Karl Pertsch, Siddharth Karamcheti et al.
A 7B-parameter open-source Vision-Language-Action model pre-trained on 970k real-world robot demonstrations, achieving strong generalization across robots and tasks.
Anthony Brohan, Noah Brown, Justice Carbajal et al.
Google DeepMind's VLA model combining a vision-language foundation model with robot action outputs, showing emergent generalization to novel objects, backgrounds, and semantic instructions far beyond training data.
Anthony Brohan, Noah Brown, Justice Carbajal et al.
A large transformer model trained on 130k episodes of real robot manipulation to output discretized arm-and-gripper actions from RGB images and natural language instructions.
Wenlong Huang, Chen Wang, Ruohan Zhang et al.
VoxPoser uses LLMs to compose 3D value maps from free-form language instructions, enabling zero-shot closed-loop manipulation planning with model-based trajectory synthesis over dynamic environments.
Read these papers in order to build expertise in LLM Robotics.
Moo Jin Kim, Karl Pertsch et al. · 2024
Anthony Brohan, Noah Brown et al. · 2024
Anthony Brohan, Noah Brown et al. · 2023
Wenlong Huang, Chen Wang et al. · 2023
