Optimize, Learn, Refine: Whole-Body Grasping and Pick-and-Throw with a Spiral Soft Robot

Optimize, Learn, Refine: Whole-Body Grasping and Pick-and-Throw with a Spiral Soft Robot

Marwah Basuhai, Tingcong Liu, Ibrahim Alsarraj, Yuhao Wang, Ke Wu · N/A · 2026

Framework

N/A

License

N/A

Stars

N/A

Summary

Soft continuum robots can exploit distributed compliance for whole-body manipulation, but synthesizing behavior through changing contacts remains difficult. We address whole-body grasping and pick-and-throw from an initially ungrasped state through outcome-based actuation-space optimization.

Abstract Summary

Soft continuum robots can exploit distributed compliance for whole-body manipulation, but synthesizing behavior through changing contacts remains difficult. We address whole-body grasping and pick-and-throw from an initially ungrasped state through outcome-based actuation-space optimization. Grasping is quantified by tip angular sweep and body-object enclosure, while throwing further incorporates release-direction alignment and minimum release speed. These objectives allow grasping, acceleration, and release to emerge from compliant interaction without prescribing contact forces, contact locations, or body configurations. Because the resulting actuation-to-outcome mapping is nonsmooth, we utilize derivative-free CMA-ES within an optimize-learn-refine framework. CMA-ES generates solutions for sampled conditions, a task-conditioned predictor learns warm starts, and CMA-ES refines them for unseen conditions. In simulation, the method achieves 492/500 successful grasps (98.4%) and success rates of 98%, 97%, and 94% across three directional throwing trials. Learned initialization increases grasping success from 78.6% to 98.4% while reducing the median rollout count from 1184 to 816 in CMA-ES. Hardware experiments achieve a 100% grasping success rate across 50 executions and a 100% pick-and-throw success rate across 30 executions, with 10 repetitions per direction. Together, these simulation and hardware results demonstrate the effectiveness of the proposed framework across both simulated and physical whole-body manipulation tasks.

Key Points

  • Soft continuum robots can exploit distributed compliance for whole-body manipulation, but synthesizing behavior through changing contacts remains difficult.
  • We address whole-body grasping and pick-and-throw from an initially ungrasped state through outcome-based actuation-space optimization.
  • Grasping is quantified by tip angular sweep and body-object enclosure, while throwing further incorporates release-direction alignment and minimum release speed.
  • These objectives allow grasping, acceleration, and release to emerge from compliant interaction without prescribing contact forces, contact locations, or body configurations.
  • Because the resulting actuation-to-outcome mapping is nonsmooth, we utilize derivative-free CMA-ES within an optimize-learn-refine framework.

Problem Statement

This section defines the grasping and pick-and-throw tasks considered in this work and introduces the tendon-driven soft robot SpiRob. We use SpiRob, the spiral-inspired tendon-driven soft robot shown in the central panel of Fig. 1 , as the experimental platform [ 18 ] .

Fabricated from flexible polymers through additive manufacturing, SpiRob has a logarithmic-spiral-inspired backbone whose curvature and stiffness vary continuously from a relatively rigid base to a highly compliant tip.

Problem Statement — Optimize, Learn, Refine: Whole-Body Grasping and Pick-and-Throw with a Spiral Soft Robot
Fig. 2 : Methodological pipeline from task objectives to physical execution.

Methodology

As shown in Fig. 2 , the proposed methodology specifies the three components needed to solve the actuation-space problem in Eq. ( 2 ). First, we define the task-dependent outcome cost $J$ for whole-body grasping and pick-and-throw. Second, we represent the continuous tendon-command trajectory $\mathbf{u}(\cdot)$ with a finite-dimensional parameter vector for numerical search.

Finally, we solve the parameterized problem through an optimize–learn–refine strategy that reuses prior solutions across task conditions.

Methodology — Optimize, Learn, Refine: Whole-Body Grasping and Pick-and-Throw with a Spiral Soft Robot
Fig. 3 : Pick-and-throw sequence comprising initial configuration, approach, grasp, enclosure, momentum generation, and release along the desired direction.

Optimization and Learning in Simulation

The framework was evaluated in MuJoCo for randomized whole-body grasping and pick-and-throw. The grasping task used Eq. ( 7 ), whereas pick-and-throw used Eq. ( 10 ). All simulation rollouts used a $3.5~\mathrm{s}$ control horizon. For whole-body grasping, the 84 training positions and 500 test positions were sampled from the same robot-centered workspace shown in Fig.

5 , spanning For each training position, CMA–ES generated an optimized condition–parameter pair $(\boldsymbol{\xi}_{i},\mathbf{p}_{i}^{\mathrm{CMA}})$ for neural training.

Optimization and Learning in Simulation — Optimize, Learn, Refine: Whole-Body Grasping and Pick-and-Throw with a Spiral Soft Robot
(a) Simulated whole-body grasping trials.

Experimental Validation

The SpiRob platform described in Section II-A was used for the hardware experiments and mounted above a planar workspace with two displacement-controlled tendon motors. An overhead camera recorded the robot–object interaction for offline evaluation without providing online feedback.

The refined tendon commands were sent to the motors at $100~\mathrm{Hz}$, with the tendon displacement rate limited to $80~\mathrm{mm\,s^{-1}}$.

Experimental Validation — Optimize, Learn, Refine: Whole-Body Grasping and Pick-and-Throw with a Spiral Soft Robot
(b) Simulated pick-and-throw trials.

Sources and Demonstrations

Figures are reproduced from Basuhai et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.

Share

Related Papers

EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Camera
SIGGRAPH 2026

EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Camera

Christen Millerdurai, Shaoxiang Wang, Yaxu Xie et al.

Reconstructing the absolute 3D pose and shape of the hands from the user's viewpoint using a single head-mounted camera is crucial for practical egocentric interaction in AR/VR, telepresence, and hand-centric manipulation tasks, where sensing must remain compact and unobtrusive.

manipulation manipulation simulation
Code PDF Intermediate
Code ★ 0