BadWAM: When World-Action Models Dream Right but Act Wrong

BadWAM: When World-Action Models Dream Right but Act Wrong

Qi Li, Xingyi Yang, Xinchao Wang · N/A · 2026

Framework

N/A

License

N/A

Stars

N/A

Summary

World-action models (WAMs) are emerging as a promising foundation for embodied control: rather than predicting actions alone, they learn representations that couple action generation with future world prediction.

Abstract Summary

World-action models (WAMs) are emerging as a promising foundation for embodied control: rather than predicting actions alone, they learn representations that couple action generation with future world prediction. This coupling is often viewed as a source of robustness, interpretability, and safety, as a robot's action can in principle be checked against its imagined future. In this paper, we show that this assumption is fragile. We introduce BadWAM, a unified framework for modeling and evaluating World-Action Drift Attacks: a new class of WAM-specific adversarial attacks that use small visual perturbations to break the alignment between what a WAM imagines and what it executes. BadWAM characterizes this attack surface along two natural criteria: attack strength and stealthiness. When the adversary prioritizes disruption, BadWAM instantiates an action-only adversarial attack, which directly drives the model toward task-failing actions. When the adversary additionally prioritizes stealth, BadWAM instantiates an imagination-preserving adversarial attack, which seeks to induce harmful action shifts while keeping the model's predicted future close to its clean imagination. Together, these two attacks capture a spectrum of WAM-specific failures: from overt action hijacking to stealthier cases where the model appears to imagine a plausible future but executes a desynchronized action. We evaluate BadWAM across different variants of WAMs. Results show that our attacks substantially reduce task success rates under closed-loop execution. For example, our action-only attack reduces the model performance from 96.5% to 43.1% success. The results of our imagination-preserving attack further exposes a WAM-specific vulnerability: moderate future-preserving regularization can maintain strong attack performance while reducing future imagination drift.

Key Points

  • World-action models (WAMs) are emerging as a promising foundation for embodied control: rather than predicting actions alone, they learn representations that couple action generation with future world prediction.
  • This coupling is often viewed as a source of robustness, interpretability, and safety, as a robot's action can in principle be checked against its imagined future.
  • In this paper, we show that this assumption is fragile
  • We introduce BadWAM, a unified framework for modeling and evaluating World-Action Drift Attacks: a new class of WAM-specific adversarial attacks that use small visual perturbations to break the alignment between what a WAM imagines and what it executes.
  • BadWAM characterizes this attack surface along two natural criteria: attack strength and stealthiness.

Threat Model

We study inference-time attacks against deployed WAM-based robot policies. Following the notation introduced above, the robot observes $o_{t}$ and receives an instruction or goal $g$ at each replanning step. The WAM then outputs an action chunk $a_{t:t+H-1}$ and, depending on the model interface, may also expose an imagined future in latent form $z_{t+1:t+K}$ or decoded video form $v_{t+1:t+K}$.

The robot executes part of the predicted action chunk, observes the environment again, and repeats this process in closed loop.

Threat Model — BadWAM: When World-Action Models Dream Right but Act Wrong
(a) Imagined future without preservation.

BadWAM

BadWAM is a unified framework for modeling and evaluating world-action drift attacks. As shown in Figure 3 . The framework treats a WAM as a queryable predictive-action system and optimizes bounded visual perturbations at each replanning step.

Its two attack instantiations correspond to two points on the attack-strength/stealthiness spectrum: an action-only adversarial attack that prioritizes execution failure, and an imagination-preserving adversarial attack that additionally constrains predicted-future drift.

BadWAM — BadWAM: When World-Action Models Dream Right but Act Wrong
(b) Imagined future with preservation.

Evaluation

Attack effectiveness. How much can bounded observation perturbations reduce closed-loop WAM reliability? Systematicity. Are the failures concentrated in a few tasks, or do they persist across suites and repeated trials? Failure mechanism. What do BadWAM failures look like during execution, and how does the query-based search produce them? Stealth under matched strength.

Under matched attack strength, what does imagination preservation buy? Sensitivity and efficiency.

Evaluation — BadWAM: When World-Action Models Dream Right but Act Wrong
Figure 8 : Per-suite success rates on LIBERO. The attack is especially damaging on spatial and long-horizon tasks, while object-centric tasks remain comparatively more robust.

Sources and Demonstrations

Figures are reproduced from Li et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.

Share

Related Papers

A Sim-to-Real Integration Pipeline for Training and Deployment of Chunk-Based VLA Manipulation Policies
arXiv preprint

A Sim-to-Real Integration Pipeline for Training and Deployment of Chunk-Based VLA Manipulation Policies

Mathilde Kappel, Clémence Grislain, Mohamed Chetouani et al.

Vision-Language-Action (VLA) models have become a prominent paradigm for mapping multimodal inputs, including semantic instructions, visual observations of the scene, and proprioceptive observations, to robot actions.

manipulation vision vla reinforcement-learning sim-to-real control learning-from-demonstration benchmark
PDF Advanced
Aim Short to Reach Far: Your Frozen World Model Can Plan Better Than You Think
arXiv preprint

Aim Short to Reach Far: Your Frozen World Model Can Plan Better Than You Think

Xvyuan Liu, Jianjie Fang, Chen Gao et al.

Planners built on visual world models commonly score each predicted outcome by its distance to the encoded goal image. We show that this target can limit control even with exact dynamics and globally optimal short-horizon search: reaching a goal may require actions that initially move away from it.

vision reinforcement-learning planning control human-robot-interaction benchmark
PDF Intermediate