3DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training
Jiaxin Shi, Xidong Zhang, Fucai Zhu, Zhe Li, Siyu Zhu, Weihao Yuan · N/A · 2026
Framework
N/A
License
N/A
Stars
N/A
Summary
We propose a 3D-thinking-guided co-training framework that enables vision-language-action (VLA) models to perform 3D spatial reasoning implicitly during action prediction.
Abstract Summary
Key Points
- Addresses dexterous manipulation challenges
- Integrates vision-language models for robotic action generation
- Uses simulation or synthetic data for training
- Uses knowledge distillation to compress models
- Leverages 3D geometric reasoning for perception
Method
We present 3DThinkVLA, a 3D-thinking-guided VLA co-training framework as shown in Figure 2 . The key idea is to enrich action prediction with two complementary latent cues during training: (i) low-level geometry-aware cues distilled from the 3D geometry foundation model and (ii) high-level reasoning-aware cues transferred from a teacher reasoning pathway and online self-distillation strategy.
Importantly, these auxiliary supervision sources ( i.e. , the 3D foundation model and the teacher reasoning pathway) are utilized only during training.
Experiments
We adopt the StarVLA framework Ye et al. (2026a) , utilizing Qwen3-VL 2B Bai et al. (2025) as the base model and using OFT-style action head for action prediction. All models are trained on 8 NVIDIA A100 (80GB) GPUs, and the fine-tuned models are deployed on a single NVIDIA A100 (80GB) GPU for evaluation. We evaluate our method on three widely used simulation benchmarks: LIBERO Liu et al.
(2023) , LIBERO-PLUS Fei et al. (2025) , and SimplerEnv Li et al. (2024c) .
Sources and Demonstrations
Figures are reproduced from Shi et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.
Related Papers
A Sim-to-Real Integration Pipeline for Training and Deployment of Chunk-Based VLA Manipulation Policies
Mathilde Kappel, Clémence Grislain, Mohamed Chetouani et al.
Vision-Language-Action (VLA) models have become a prominent paradigm for mapping multimodal inputs, including semantic instructions, visual observations of the scene, and proprioceptive observations, to robot actions.
Memorize, Adapt, Ignore: Diagnosing Robot Learning Mechanisms under Training Data Variation
Ke Zhang, Danica J. Sutherland, Chao Liu
Training data variation, whether through designing a domain randomization (DR) scheme in simulation or curating demonstrations for imitation learning, is a primary lever for improving the robustness of robotic manipulation policies.
A Phenomenology of Neural Geometry in Vision-Language-Action Models
Mozes Jacobs, Aiden Swann, Mathilde Papillon et al.
Robotic manipulation is inherently geometric, but what shape does the world take inside the policy that performs it?
Beyond Reconstruction: What Matters in Action Tokenization for Robot Policies?
Haoran Chen, Jingtian Ji, Samuel Wheeler et al.
Autoregressive action-token policies such as vision-language-action models require action tokenizers to translate discrete token sequences into precise control actions in continuous space. Many action tokenizers learn the mapping between tokens and actions via a reconstruction objective.