ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models
Gehan Zheng, Matthew Johnson-Roberson, Weiming Zhi · N/A · 2026
Framework
N/A
License
N/A
Stars
N/A
Summary
Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper--object views help observe contact, but a poor approach may already push, miss, slip, or disturb the object before conventional de...
Abstract Summary
Key Points
- Contact-rich manipulation failures are often detected only after the robot has committed to contact
- This is especially limiting in wrist-camera setups: close gripper--object views help observe cont...
- We introduce \emph{ContactGuard}, a pre-contact execution monitor for chunked visuomotor policies
- Given the policy's planned action chunk, ContactGuard predicts its short-horizon consequence in l...
- Its latent world model is trained from unlabelled robot trajectories to predict compact multi-vie...
ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models
|Authors: Gehan Zheng, Matthew Johnson-Roberson, Weiming Zhi
|Venue: arXiv preprint | Year: 2026
|arXiv: 2608.13438v1
Abstract
Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper—object views help observe contact, but a poor approach may already push, miss, slip, or disturb the object before conventional detectors react. We introduce \emph{ContactGuard}, a pre-contact execution monitor for chunked visuomotor policies. Given the policy’s planned action chunk, ContactGuard predicts its short-horizon consequence in latent visual space and aborts if the predicted future latent indicates likely failure. Its latent world model is trained from unlabelled robot trajectories to predict compact multi-view visual embeddings under planned actions, avoiding pixel-level video prediction. A lightweight failure probe is then trained from a small labelled set of pre-contact clips. At deployment, ContactGuard anchors prediction before an imminent contact event, rolls the model forward under the policy’s own actions, and verifies the predicted post-contact latent. Across real-world contact-rich manipulation tasks, ContactGuard predicts failure more accurately than direct and corrupted-action ablations, and transfers to live robot as a pre-contact abort signal without modifying the underlying policy.
Key Contributions
- Contact-rich manipulation failures are often detected only after the robot has committed to contact
- This is especially limiting in wrist-camera setups: close gripper—object views help observe cont…
- We introduce \emph{ContactGuard}, a pre-contact execution monitor for chunked visuomotor policies
- Given the policy’s planned action chunk, ContactGuard predicts its short-horizon consequence in l…
- Its latent world model is trained from unlabelled robot trajectories to predict compact multi-vie…
Topics
- manipulation
- vision
- reinforcement-learning
Code & Data
No code repository linked in paper metadata.
BibTeX
@article{Zheng2026_260813438v1,
title = {ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models},
author = {Gehan Zheng and Matthew Johnson-Roberson and Weiming Zhi},
year = {2026},
eprint = {2608.13438v1},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2608.13438v1}
}
Related Papers
3DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training
Jiaxin Shi, Xidong Zhang, Fucai Zhu et al. · arXiv preprint · Jun 2026
We propose a 3D-thinking-guided co-training framework that enables vision-language-action (VLA) models to perform 3D spatial reasoning implicitly during action prediction. Our core insight is that 3D geometry perception and 3D spatial reasoning are distinct capabilities that can be disentangled and ...
Adaptive Vision-Language Grasping via Composable Foundation Priors and Generalizable Grasp Synthesis
Sixu Yan, Shikang Wang, Binhua Huang et al. · arXiv preprint · Sep 2026
This paper proposes AdaRoboVLG, a task-adaptive Vision-Language-Grasp (VLG) framework that supports generalizable grasp synthesis across different robotic hands. Unlike existing VLG methods that tightly couple foundation models with end-to-end grasp policies, AdaRoboVLG learns an efficient genera...
Decoding Task Progress from VLA Representations
Atiksh Bhardwaj, Edward Weiyi Duan, Prithwish Dan et al. · arXiv preprint · Aug 2026
Vision-language-action models (VLAs) are moving rapidly towards deployment as general-purpose manipulation policies, but we currently lack basic tools for understanding what these models represent internally or for monitoring them at runtime. Leveraging ideas from mechanistic interpretability, we...
DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation
Siyuan Ma, Boshi Zhang, Yutian Zhang et al. · arXiv preprint · Aug 2026
Mobile manipulation requires a robot to predict how locomotion and arm motion jointly alter future observations and control. Existing world-action models, developed largely for fixed-base platforms, do not explicitly distinguish camera ego-motion from base and arm actions. Here we introduce DECOW...