Robot Learning from Human Demonstrations: Handwritten Alphabet Trajectories and Human-Likeness Evaluation
Alperen Kenan, Paul Bremner, Manuel Giuliani · N/A · 2026
Framework
N/A
License
N/A
Stars
N/A
Summary
Learning from demonstration (LfD) provides a developmental framework through which robots can develop motor skills by observing and imitating human dynamics, reducing reliance on explicit programming to teach a skill to a robot.
Abstract Summary
Key Points
- Learning from demonstration (LfD) provides a developmental framework through which robots can develop motor skills by observing and imitating human dynamics, reducing reliance on explicit programming to teach a skill to a robot.
- The resulting human-like robot motion is recognised as a key factor in building trust and enabling natural collaboration in human-robot interaction.
- This paper presents a framework for learning human-like robot motion from demonstration, including data collection, probabilistic trajectory learning, and perceptual user evaluation.
- A dataset of 3,142 handwriting demonstrations was collected from 22 participants across all 52 Latin alphabet character-case combinations via a touchscreen teleoperation interface, capturing planar position, contact force, and timing.
- Building on the widely used Gaussian Mixture Model and Gaussian Mixture Regression approach for learning from demonstration, the framework is extended in this work by incorporating force and normalised time dimensions to enable richer representation of human dynamics, and adapting it to handle non-continuous, multi-segment trajectories, enabling generalisation across demonstrations.
Methodology
Two separate user studies were conducted. The first collected human writing trajectory data while participants teleoperated a simulated robot, capturing position, speed, and force. The second evaluated whether the robot trained on this data produces human-like motion compared to the original fonts.
The characters chosen were the 26 Latin alphabet characters in both uppercase and lowercase versions, that are highly nonlinear and complex, with discontinuities that make them challenging to program manually.
Robot Learning Algorithm
Recorded position data is used to categorise characters by their region, and the corresponding force values are filtered such that any data point below a threshold of 0.1 N is rejected to remove recordings where there was no pen contact with the surface. For each recording, the absolute timestamp is adjusted so that each character instance starts from zero.
Results
Demonstration trajectories capture the complete writing motion as a time series of planar position, normal contact force, and timestamp, recorded at 40 Hz. Table I summarises the key statistical properties of the dataset computed across all valid trajectories.
The spatial coverage across all demonstrations spans 3.53 - 36.11 mm along the $x$-axis and 0.00 - 37.03 mm along the $y$-axis, indicating effective utilisation of the available workspace.
Sources and Demonstrations
Figures are reproduced from Kenan et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.
Related Papers
Design and Evaluation of a Touchscreen-Based Teleoperation Interface for Robotic Manipulators
Juan José García Cárdenas, Alperen Kenan, Hamidreza Raei et al.
Intuitive teleoperation interfaces are crucial for the safe and effective operation of robotic manipulators in challenging environments.
FACT: A Multimodal Force-Action-Track Foundation Model for Human-to-Robot Dexterity
Zhi Cao, Yining Hong, Jiaolong Yang et al.
Human demonstrations offer a scalable alternative to costly robot data collection for dexterous manipulation, but most human datasets lack force measurements.
HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark
Dairu Liu, Zekun Qi, Jiayu Zeng et al.
Humanoid motion tracking is central to teleoperation and whole-body imitation, yet evaluation often disagrees with what people perceive in videos.
SoTa: Soft Tactile Skins for Dexterous Manipulation
Jingyun Yang, Baiyu Shi, Timothy Yu et al.
A growing body of work suggests that tactile sensing gives robot policies contact information that complements vision in dexterous manipulation. However, visuo-tactile robot data remains scarce: dexterous demonstrations require teleoperating robots, which limits dataset scale.