Bounded-Fidelity Sim-as-Demo-Stage: Mocap Handoff for Governance Benchmarks

Bounded-Fidelity Sim-as-Demo-Stage: Mocap Handoff for Governance Benchmarks

Xue Qin, Simin Luan, Cong Yang, Zhijun Li · N/A · 2026

Framework

N/A

License

N/A

Stars

N/A

Summary

Sim-to-real research pursues physics fidelity as a primary objective: simulators are judged by how closely they reproduce real-world contact dynamics.

Abstract Summary

Sim-to-real research pursues physics fidelity as a primary objective: simulators are judged by how closely they reproduce real-world contact dynamics. For governance benchmarking of LLM-driven robots, where the simulator demonstrates that an admission/policy/contract/audit pipeline behaves correctly, contact fidelity at object handoffs (grasp, carry, place) becomes a liability: contact-force integration noise injects audit-chain divergence that is structurally unrelated to the governance property under test. We propose bounded-fidelity sim-as-demo-stage, a design pattern that suppresses contact physics within explicitly bracketed handoff envelopes while preserving full dynamics elsewhere. The construction uses MuJoCo's mocap-body primitive driven by a 220-line Python adapter that the governance bridge invokes via structured intents. We formalise audit-chain stability as byte-equality of the hashed event log across replays and identify two structural envelope properties that imply it. Across N=1000 replays per posture, the mocap variant produces one distinct audit-chain hash (1000/1000 byte-identical; Wilson 95% CI [0.997, 1.000]); the contact-force baseline produces 584 distinct hashes (993/1000 diverged; CI [0.987, 0.998]). A timestep sweep (1, 2, 5, 10 ms) shows the divergence is structural, not a tuning artefact: it stays at 0.985 at every timestep. Envelope-edge timing jitter (+/-10 simulation steps, 1,400 replays) produces 0 divergence, and audit chains remain byte-equal across K in {1, 2, 3} sequentially handed-off objects (1,500 replays) with sub-linear per-pick-and-place overhead. The pattern gives benchmark designers audit-chain reproducibility at near-zero engineering cost; we also map where it is harmful (sim-to-real validation, policy training, contact-rich tasks) so it is not mis-deployed.

Key Points

  • Sim-to-real research pursues physics fidelity as a primary objective: simulators are judged by how closely they reproduce real-world contact dynamics.
  • For governance benchmarking of LLM-driven robots, where the simulator demonstrates that an admission/policy/contract/audit pipeline behaves correctly, contact fidelity at object handoffs (grasp, carry, place) becomes a liability: contact-force integration noise injects audit-chain divergence that is structurally unrelated to the governance property under test.
  • We propose bounded-fidelity sim-as-demo-stage, a design pattern that suppresses contact physics within explicitly bracketed handoff envelopes while preserving full dynamics elsewhere.
  • The construction uses MuJoCo's mocap-body primitive driven by a 220-line Python adapter that the governance bridge invokes via structured intents.
  • We formalise audit-chain stability as byte-equality of the hashed event log across replays and identify two structural envelope properties that imply it.

The Bounded-Fidelity Pattern

MuJoCo’s mocap body is a body whose pose is driven externally via data.mocap_pos and data.mocap_quat , rather than by the contact-force integrator. Within a single simulation step, the mocap body is treated as a kinematic constraint: it does not respond to applied forces, and any contact with non-mocap geoms is resolved as if the mocap body’s pose were authoritative.

The Bounded-Fidelity Pattern — Bounded-Fidelity Sim-as-Demo-Stage: Mocap Handoff for Governance Benchmarks
Figure 2: The handoff envelope. During carry the cup is pose-tracked to the gripper (mocap body, no contact physics). During approach and place the cup is a normal dynamic body. Boundaries are opened/closed by structured intents grasp and place dispatched by the governance bridge.

Experiments

The construction is implemented as a ${\sim}220$-LOC MocapAdapter module in the AEROS runtime, shipped as src/mocap_adapter.py in the artifact repository. The reference environment is Python $3.11.7$ with MuJoCo $3.1.4$ and mujoco $3.1.4$ Python bindings on macOS $14.5$; Section 4.7 reports a byte-equal reproduction on an independent Ubuntu host.

All replays in Section 4.3 –§ 4.6 use the fixed seed 12345 (the default for both reference harnesses, harness/envelope_precision.py and harness/multi_object.py ; override via --seed ).

Sources and Demonstrations

Figures are reproduced from Qin et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.

Share

Related Papers

A Sim-to-Real Integration Pipeline for Training and Deployment of Chunk-Based VLA Manipulation Policies
arXiv preprint

A Sim-to-Real Integration Pipeline for Training and Deployment of Chunk-Based VLA Manipulation Policies

Mathilde Kappel, Clémence Grislain, Mohamed Chetouani et al.

Vision-Language-Action (VLA) models have become a prominent paradigm for mapping multimodal inputs, including semantic instructions, visual observations of the scene, and proprioceptive observations, to robot actions.

manipulation vision vla reinforcement-learning sim-to-real control learning-from-demonstration benchmark
PDF Advanced
Beyond Reconstruction: What Matters in Action Tokenization for Robot Policies?
arXiv preprint

Beyond Reconstruction: What Matters in Action Tokenization for Robot Policies?

Haoran Chen, Jingtian Ji, Samuel Wheeler et al.

Autoregressive action-token policies such as vision-language-action models require action tokenizers to translate discrete token sequences into precise control actions in continuous space. Many action tokenizers learn the mapping between tokens and actions via a reconstruction objective.

manipulation vision vla reinforcement-learning control benchmark
PDF Intermediate