ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models

ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models

Gehan Zheng, Matthew Johnson-Roberson, Weiming Zhi · N/A · 2026

Framework

N/A

License

N/A

Stars

N/A

Summary

Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper--object views help observe contact, but a poor approach may already push, miss, slip, or disturb the object before conventional de...

Abstract Summary

Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper--object views help observe contact, but a poor approach may already push, miss, slip, or disturb the object before conventional detectors react. We introduce \emph{ContactGuard}, a pre-contact execution monitor for chunked visuomotor policies. Given the policy's planned action chunk, ContactGuard predicts its short-horizon consequence in latent visual space and aborts if the predicted future latent indicates likely failure. Its latent world model is trained from unlabelled robot trajectories to predict compact multi-view visual embeddings under planned actions, avoiding pixel-level video prediction. A lightweight failure probe is then trained from a small labelled set of pre-contact clips. At deployment, ContactGuard anchors prediction before an imminent contact event, rolls the model forward under the policy's own actions, and verifies the predicted post-contact latent. Across real-world contact-rich manipulation tasks, ContactGuard predicts failure more accurately than direct and corrupted-action ablations, and transfers to live robot as a pre-contact abort signal without modifying the underlying policy.

Key Points

  • Contact-rich manipulation failures are often detected only after the robot has committed to contact
  • This is especially limiting in wrist-camera setups: close gripper--object views help observe cont...
  • We introduce \emph{ContactGuard}, a pre-contact execution monitor for chunked visuomotor policies
  • Given the policy's planned action chunk, ContactGuard predicts its short-horizon consequence in l...
  • Its latent world model is trained from unlabelled robot trajectories to predict compact multi-vie...

ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models

|Authors: Gehan Zheng, Matthew Johnson-Roberson, Weiming Zhi

|Venue: arXiv preprint | Year: 2026

|arXiv: 2608.13438v1

Abstract

Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper—object views help observe contact, but a poor approach may already push, miss, slip, or disturb the object before conventional detectors react. We introduce \emph{ContactGuard}, a pre-contact execution monitor for chunked visuomotor policies. Given the policy’s planned action chunk, ContactGuard predicts its short-horizon consequence in latent visual space and aborts if the predicted future latent indicates likely failure. Its latent world model is trained from unlabelled robot trajectories to predict compact multi-view visual embeddings under planned actions, avoiding pixel-level video prediction. A lightweight failure probe is then trained from a small labelled set of pre-contact clips. At deployment, ContactGuard anchors prediction before an imminent contact event, rolls the model forward under the policy’s own actions, and verifies the predicted post-contact latent. Across real-world contact-rich manipulation tasks, ContactGuard predicts failure more accurately than direct and corrupted-action ablations, and transfers to live robot as a pre-contact abort signal without modifying the underlying policy.

Key Contributions

  • Contact-rich manipulation failures are often detected only after the robot has committed to contact
  • This is especially limiting in wrist-camera setups: close gripper—object views help observe cont…
  • We introduce \emph{ContactGuard}, a pre-contact execution monitor for chunked visuomotor policies
  • Given the policy’s planned action chunk, ContactGuard predicts its short-horizon consequence in l…
  • Its latent world model is trained from unlabelled robot trajectories to predict compact multi-vie…

Topics

  • manipulation
  • vision
  • reinforcement-learning

Code & Data

No code repository linked in paper metadata.

BibTeX

@article{Zheng2026_260813438v1,
  title     = {ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models},
  author    = {Gehan Zheng and Matthew Johnson-Roberson and Weiming Zhi},
  year      = {2026},
  eprint    = {2608.13438v1},
  archivePrefix = {arXiv},
  primaryClass  = {cs.RO},
  url       = {https://arxiv.org/abs/2608.13438v1}
}
Share

Related Papers

3DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training

3DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training

Jiaxin Shi, Xidong Zhang, Fucai Zhu et al. · arXiv preprint · Jun 2026

We propose a 3D-thinking-guided co-training framework that enables vision-language-action (VLA) models to perform 3D spatial reasoning implicitly during action prediction. Our core insight is that 3D geometry perception and 3D spatial reasoning are distinct capabilities that can be disentangled and ...

sim-to-real reinforcement-learning vision vla manipulation
PDF Advanced
No code repo Jun 2026
Adaptive Vision-Language Grasping via Composable Foundation Priors and Generalizable Grasp Synthesis

Adaptive Vision-Language Grasping via Composable Foundation Priors and Generalizable Grasp Synthesis

Sixu Yan, Shikang Wang, Binhua Huang et al. · arXiv preprint · Sep 2026

This paper proposes AdaRoboVLG, a task-adaptive Vision-Language-Grasp (VLG) framework that supports generalizable grasp synthesis across different robotic hands. Unlike existing VLG methods that tightly couple foundation models with end-to-end grasp policies, AdaRoboVLG learns an efficient genera...

manipulation vision reinforcement-learning
Code PDF Advanced
GitHub ★ — Sep 2026
Decoding Task Progress from VLA Representations

Decoding Task Progress from VLA Representations

Atiksh Bhardwaj, Edward Weiyi Duan, Prithwish Dan et al. · arXiv preprint · Aug 2026

Vision-language-action models (VLAs) are moving rapidly towards deployment as general-purpose manipulation policies, but we currently lack basic tools for understanding what these models represent internally or for monitoring them at runtime. Leveraging ideas from mechanistic interpretability, we...

manipulation vision vla reinforcement-learning control
PDF Intermediate
No code repo Aug 2026
DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation

DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation

Siyuan Ma, Boshi Zhang, Yutian Zhang et al. · arXiv preprint · Aug 2026

Mobile manipulation requires a robot to predict how locomotion and arm motion jointly alter future observations and control. Existing world-action models, developed largely for fixed-base platforms, do not explicitly distinguish camera ego-motion from base and arm actions. Here we introduce DECOW...

manipulation locomotion vision reinforcement-learning control benchmark
PDF Intermediate
No code repo Aug 2026