SI-Diff: A Framework for Learning Search and High-Precision Insertion with a Force-Domain Diffusion Policy

SI-Diff: A Framework for Learning Search and High-Precision Insertion with a Force-Domain Diffusion Policy

Yibo Liu, Stanko Oparnica, Simon Shewchun-Jakaitis, Guoyi Fu, Jie Wang, Jun Yang, Anand Jagannathan, Tony Hong-Yau Lo · · 2026

Framework

N/A

License

N/A

Stars

0

Summary

Contact-rich manipulation is fundamental in robotics but poses significant challenges due to uncertainties in relative poses, such as misalignments and small clearances in peg-in-hole tasks.

Abstract Summary

Contact-rich manipulation is fundamental in robotics but poses significant challenges due to uncertainties in relative poses, such as misalignments and small clearances in peg-in-hole tasks. Existing approaches typically address search and high-precision insertion separately, because these tasks involve distinct action patterns. However, supporting both tasks within a single model, without switching models or weights, is desirable for intelligent manipulation systems. In this work, we propose SI-Diff, a framework that learns both search and high-precision insertion through a force-domain diffusion policy. To this end, we introduce a new mode-conditioning mechanism that enables the policy to capture distinct action behaviors under a single framework. Moreover, we develop a new search teacher policy that can generate diverse trajectories. By training on successful and efficient demonstrations provided by the teacher policy, the model learns the mapping from tactile and end-effector velocity observations to effective action behaviors. We conduct thorough experiments to show that SI-Diff extends the tolerance to x-y misalignments from 2 mm to 5 mm compared to the state-of-the-art baseline, TacDiffusion, while also demonstrating strong zero-shot transferability to unseen shapes.

Key Points

  • Introduces SI-Diff, advancing manipulation research.
  • Detailed evaluation demonstrates effectiveness on benchmarks and real-world scenarios.
  • Provides insights into methodology and architectural choices.

Methodology

Our system learns and executes two distinct behaviors within a single framework, requiring consistent representations during both training and inference. We next describe how this requirement guides our design.

The second-order dynamic model of an $\boldsymbol{n}$-Degree-of-Freedom (DoF) torque-controlled robot [ 1 ] is as follows: where $\boldsymbol{q}\in\mathbb{R}^{n}$ denotes the joint states, and $\mathbf{M}(\boldsymbol{q})\in\mathbb{R}^{n\times n}$ denotes the mass matrix.

Methodology — SI-Diff: A Framework for Learning Search and High-Precision Insertion with a Force-Domain Diffusion Policy
Fig. 2: An illustration of the architecture of the proposed force-domain diffusion policy with mode conditioning.

Experiments

As shown in Fig. 5 (a), we employ a 7-DoF Franka Emika robot to gather the training demonstrations. For the search teacher policy, we rely on Algorithm 1 to obtain 300 samples. For each trial, the peg is randomly placed in contact at the rim of the hole within a 5 mm range to cover different initial misalignment conditions.

Experiments — SI-Diff: A Framework for Learning Search and High-Precision Insertion with a Force-Domain Diffusion Policy
Fig. 3: (a) An illustration of the trajectory of the vanilla spiral search. (b) The same initial search direction can lead to different efficiency and success outcomes, as it may either guide the peg toward the hole (Case A) or drive it away (Case B), depending on the initial misalignment.

Sources and Demonstrations

Figures are reproduced from Liu et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.

Share

Related Papers

Edge-Native Temporal--Graph Dual-Expert Inference for Dexterous Grasp Classification
arXiv preprint

Edge-Native Temporal--Graph Dual-Expert Inference for Dexterous Grasp Classification

Jiajian Zheng, Bin Zhang, Wen Fan et al.

Multi-finger hands contact objects at different times, so a global close command can overload early-contact fingers while others are still moving. Dense tactile arrays address this problem but add hardware, calibration, bandwidth, and computation.

manipulation reinforcement-learning tactile benchmark
PDF Intermediate