Co-VLA: Coordination-Aware Structured Action Modeling for Dual-Arm Vision-Language-Action Systems

Co-VLA: Coordination-Aware Structured Action Modeling for Dual-Arm Vision-Language-Action Systems

Featured

Yandong Wang, Jiaqian Yu, Xiongfeng Peng, Lu Xu, Yamin Mao, Weiming Li, Jaewook Yoo, Dongwook Lee, Daehyun Ji, Mingbo Zhao, Chao Zhang · · 2026

Framework

N/A

License

N/A

Stars

N/A

Summary

Vision-language-action (VLA) models show strong capabilities in single and dual-arm robotic manipulation. Prior works show coordinated bimanual behaviors can emerge from end-to-end learning, leveraging large vision-language backbones with continuous action prediction.

Abstract Summary

Vision-language-action (VLA) models show strong capabilities in single and dual-arm robotic manipulation. Prior works show coordinated bimanual behaviors can emerge from end-to-end learning, leveraging large vision-language backbones with continuous action prediction. However, as bimanual tasks become tightly coupled and execution constraints become critical, implicit coordination alone is insufficient to ensure reliable, interpretable, and stable behavior. In this work, we propose Co-VLA, a coordination-aware bimanual manipulation framework introducing explicit structural priors into VLA models. We instantiate our method on a state-of-the-art vision-language backbone by replacing its monolithic action head with a Structured Action Expert (SAE) designed for bimanual coordination. Specifically, we introduce explicit structure at the action generation level with a modular coordination-aware loss that shapes shared and residual latents according to task-specific structures. The shared latent encodes task-level coordination intent, while residual latents capture execution adjustments for each arm. At deployment, a Latent-Aware Controller (LAC) interprets the learned representations to modulate synchronization strength, execution asymmetry, smoothness, and safety constraints in real time. LAC operates at the joint-command level and remains compatible with standard control pipelines without requiring force or impedance control. Experiments across simulation and real-world benchmarks show Co-VLA significantly outperforms monolithic baselines, achieving a 27% success rate gain in tight-coordination tasks, more than doubling performance in OOD real-world scenarios (from 13% to 27%), and reducing task completion time by up to 25%.

Key Points

  • Proposes Co-VLA for robotics.
  • Evaluated on real or simulated robotic tasks.
  • Primary contribution in ar-vr.

Method

Our approach extends exisiting VLA framework by introducing structured action modeling and execution refinement for coordinated bimanual manipulation. As illustrated in Fig. , The system comprises three components: Structured Action Expert (SAE) a shared–residual decomposition that explicitly separates task-level coordination intent from arm-specific execution (Sec.

Method — Co-VLA: Coordination-Aware Structured Action Modeling for Dual-Arm Vision-Language-Action Systems
Fig. 2 : Structured Action Expert (SAE) architecture.

Experiment

RoboTwin tasks Real-World tasks At training stage, we adopt a two-phase strategy. In Phase 1 (warm-up), we freeze the pretrained backbone and train only the newly introduced SAE layers, including the shared and residual action projections as well as the share-to-arm routing modules, for 1,000 steps with a peak learning rate of $5\times 10^{-5}$.

This allows the new parameters to reach a reasonable initialization without disrupting the pretrained representations.

Experiment — Co-VLA: Coordination-Aware Structured Action Modeling for Dual-Arm Vision-Language-Action Systems
Fig. 3 : Visualization of sequential motion paradigm (left) and our designed collaborative motion paradigm (right).

Sources and Demonstrations

Figures are reproduced from Wang et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.

Share

Related Papers

Invertible Neural Network Adapter for One-Step Flow Matching in Robot Manipulation
arXiv preprint

Invertible Neural Network Adapter for One-Step Flow Matching in Robot Manipulation

Yu Zhang, Kangyi Ji, Yongxiang Zou et al.

This paper presents an invertible neural network adapter for general robotic manipulation, designed to generate precise high-dimensional actions conditioned on multimodal observations, including visual, linguistic, and proprioceptive inputs, through a one-step denoising process.

ar-vr evaluation generation
PDF Intermediate
Invertible Neural Network Adapter for One-Step Flow Matching in Robot Manipulation
arXiv preprint

Invertible Neural Network Adapter for One-Step Flow Matching in Robot Manipulation

Yu Zhang, Kangyi Ji, Yongxiang Zou et al.

This paper presents an invertible neural network adapter for general robotic manipulation, designed to generate precise high-dimensional actions conditioned on multimodal observations, including visual, linguistic, and proprioceptive inputs, through a one-step denoising process.

ar-vr evaluation generation
PDF Intermediate