MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics

MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics

Jiaxu Wang, Junhao He, Jingkai Sun, Yi Gu, Yunyang Mo, Jiahang Cao, Qiang Zhang, Renjing Xu · Chinese University of Hong Kong (Shenzhen) · 2026

Summary

MoSA closes the real-to-sim gap for continuum robots by learning a residual stress field that captures anisotropic material behavior missed by standard simulators.

Abstract Summary

Continuum robots—such as soft manipulators, endoscopes, and growing robots—suffer from a severe real-to-sim gap because standard physical simulators assume homogeneous, isotropic materials. MoSA (Motion-constrained Stress Adaptation) closes this gap by learning a neural residual stress field that captures anisotropic material behavior that physics engines inherently miss. The method uses a neural network trained on visual observations of a deforming soft body. By comparing real deformation sequences with simulator predictions, the network learns to predict a residual stress field that, when added as a correction force in the simulator, brings its dynamics into close agreement with reality. Crucially, this approach does not require explicit calibration of material parameters such as Young's modulus or Poisson's ratio, which are difficult to measure for soft tissues and custom elastomers. Experiments are conducted on a cable-driven continuum manipulator performing trajectory tracking and contact-rich tasks. MoSA reduces trajectory tracking error by over 60 percent compared to uncorrected simulators and enables successful model-predictive control (MPC) on hardware that fails when using the baseline physics model. The learned residuals generalize across different cable tensions and external loads, suggesting that the network captures material-level structure rather than merely memorizing specific trajectories.

Key Points

  • Targets the real-to-sim gap in continuum and soft robots.
  • Learns residual anisotropy from visual deformation observations.
  • Corrects simulator dynamics without explicit material parameter calibration.
  • Enables model-predictive control on real continuum robot hardware.
  • Reduces trajectory tracking error by over 60% compared to standard simulators.

Methodology

Problem Definition . This work aims to learn real-to-sim dynamics from multi-view videos by preserving an isotropic constitutive prior as the backbone and modeling the residual effects induced by mild anisotropy and heterogeneity.

Methodology — MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics
Figure 3 : Qualitative Comparisons between our methods and baselines. More Visualization can be seen in the Appendix .

Experiments

Dataset. We thoroughly evaluate our method on both synthetic and real-world datasets. For synthetic evaluation, we use the dataset released by PAC-NeRF ( Li et al., 2023 ) , which provides multi-view RGB sequences together with 3D ground-truth geometry trajectories across diverse materials.

This synthetic benchmark allows us to quantitatively evaluate 3D trajectory accuracy, prove the dynamics grounding, and to verify that our residual stress corrections do not introduce spurious anisotropy when an isotropic backbone is sufficient.

Experiments — MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics
Figure 4 : Comparisons of long-term dynamics (a) and sensitivity of physical laws (b).

mpact Statement

MoSA improves the fidelity of real-to-sim continuum dynamics by modeling mild residual anisotropy and heterogeneity beyond standard isotropic assumptions. This can benefit a broad range of applications that rely on reliable physical simulation, including graphics, embodied interaction, and robotics, by enabling more accurate and data-efficient dynamics identification and reducing failures caused by model mismatch.

mpact Statement — MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics
Figure 5 : Applications of zero-shot robot manipulation transfer.

Sources and Demonstrations

Figures are reproduced from Wang et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.

Share

Related Papers

EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Camera
SIGGRAPH 2026

EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Camera

Christen Millerdurai, Shaoxiang Wang, Yaxu Xie et al.

Reconstructing the absolute 3D pose and shape of the hands from the user's viewpoint using a single head-mounted camera is crucial for practical egocentric interaction in AR/VR, telepresence, and hand-centric manipulation tasks, where sensing must remain compact and unobtrusive.

manipulation manipulation simulation
Code PDF Intermediate
Code ★ 0