Physical Twins: Accelerating and Enabling Robot Learning with Phantom Platforms

Physical Twins: Accelerating and Enabling Robot Learning with Phantom Platforms

Elizabeth Peiros, Derek Chen, Lucas Yager, Edward Lee, Kevin Wang, Zoe Samuels, Michael C. Yip · N/A · 2026

reinforcement-learning human-robot-interaction

Framework

N/A

License

N/A

Stars

N/A

Summary

Improvements in human-robot physical interaction (pHRI) can have major implications for physical therapy, search and rescue, and telemedicine. However, a major challenge concerns human constraints and safety in human-robot physical experiments.

Abstract Summary

Improvements in human-robot physical interaction (pHRI) can have major implications for physical therapy, search and rescue, and telemedicine. However, a major challenge concerns human constraints and safety in human-robot physical experiments. Concerns about human studies also include repeatability, scalability, and participant diversity. To conduct such experiments, an IRB and willing human participants are required. In this work, we present an improved phantom device, a physical twin, that enables real-world RL-type testing for physically interactive algorithms. The new device not only replicates the ball-and-socket motion of the shoulder but also renders scapular and protraction/retraction motions. The experiments showcase the device's ability to render multiple 3D joint limits and demonstrate a Franka Panda arm sensing limits and interacting with the device as an arm for ADLs (activities of daily living) and pHRI tasks.

Key Points

  • Improvements in human-robot physical interaction (pHRI) can have major implications for physical therapy, search and rescue, and telemedicine.
  • However, a major challenge concerns human constraints and safety in human-robot physical experiments
  • Concerns about human studies also include repeatability, scalability, and participant diversity
  • To conduct such experiments, an IRB and willing human participants are required
  • In this work, we present an improved phantom device, a physical twin, that enables real-world RL-type testing for physically interactive algorithms.

Methods

Our physical twin design features a mechanical mechanism that emulates the complex anatomy of the shoulder, with attention to realistic grasping and maneuvering points: the wrist, arm, and armpit, typically used for lifting, dressing, and weight shifting.

The device provides the robot manipulator with forces that are sensible at a scale safe for the lab environment and supports an infinite number of individual user profiles, enabling proper testing of the true safety of a robotically assisted task.

Methods — Physical Twins: Accelerating and Enabling Robot Learning with Phantom Platforms
Figure 2: Top image, Fig (a), highlights the rotation of the clavicle bone when x-rayed. The labeling shows both the angular change and the translational motion of the shoulder socket. Bottom image, Fig (b), shows the translation of joint motion into a mechanical mechanism. From top to bottom the acromioclavicular joint is transformed into a pivot joint, the shoulder socket is transformed into a spherical manipulator, and the scapular motion is re-imagined as a 4-bar mechanism.

Experiments and Results

Taking the Jacobian for the three unique joints, the overall reachable space can be defined using the superposition (addition) of each joint’s ROM. A number of these results can be seen in Table I The humeral rotation given the initial pose, where the $\mathcal{B}$ and $\mathcal{C}$ frames are aligned, is [+330°, -270°]. Analysis of the force capabilities and singularities was done and is shown in Figure 5 (a).

Experiments and Results — Physical Twins: Accelerating and Enabling Robot Learning with Phantom Platforms
Figure 3: (a) Model of the haptic shoulder with each components range of motion demonstrated in yellow, pink, and cyan (b) The Spherical Parallel Manipulator (SPM) Mechanism separated out (c) The concentric shaft coupling of the SPM with linked linkages demonstrated with the same color (d) The capstan drive mechanism for the SPM with steel string highlighted in yellow (e) The four-bar and pivot mechanisms separated out (f) Individual components of the four-bar mechanics with yellow being the driving motor, green and blue being the linkages, and red being the PTFE slides (g) Components of the pivot with the motor being highlighted in yellow

Sources and Demonstrations

Figures are reproduced from Peiros et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.

Share

Related Papers

Aim Short to Reach Far: Your Frozen World Model Can Plan Better Than You Think
arXiv preprint

Aim Short to Reach Far: Your Frozen World Model Can Plan Better Than You Think

Xvyuan Liu, Jianjie Fang, Chen Gao et al.

Planners built on visual world models commonly score each predicted outcome by its distance to the encoded goal image. We show that this target can limit control even with exact dynamics and globally optimal short-horizon search: reaching a goal may require actions that initially move away from it.

vision reinforcement-learning planning control human-robot-interaction benchmark
PDF Intermediate
Assessing Physical Frailty and Fall-Risk Indicators with Social Robots: An in situ Evaluation with Older Adults
arXiv preprint

Assessing Physical Frailty and Fall-Risk Indicators with Social Robots: An in situ Evaluation with Older Adults

Aniol Civit, Antonio Andriella, Alba Martínez et al.

Frailty assessments are crucial to evaluate the risk of adverse events and the health and social care needs of older adults, yet their administration remains resource-intensive and typically relies on coarse clinical outcomes, such as task completion times, which may overlook biomechanical indicators of functional decline.

vision reinforcement-learning human-robot-interaction benchmark
PDF Intermediate
Catch, Throw, Repeat: Planning for Human-Robot Partner Juggling
arXiv preprint

Catch, Throw, Repeat: Planning for Human-Robot Partner Juggling

Jonathan Rainer Lippert, Kai Ploeger, Abir Chowdhury et al.

Dynamic object exchange between humans and robots remains a challenging problem due to uncertainty in perception, timing, and contact-rich interaction.

vision reinforcement-learning planning control human-robot-interaction
PDF Intermediate
Development of a Humanoid Robot Prototype for Multimodal Human-Robot Interaction
arXiv preprint

Development of a Humanoid Robot Prototype for Multimodal Human-Robot Interaction

Thang Tran Viet, Thanh Nguyen Canh, Huy Uong Gia et al.

Human-robot interaction (HRI) enables intuitive and intelligent collaboration between humans and robots in real-world environments. This paper introduces a humanoid robot prototype designed as a flexible testbed for developing and integrating artificial intelligence (AI) modules in HRI tasks.

manipulation vision vla reinforcement-learning control human-robot-interaction
Code PDF Intermediate
GitHub ★ —