DIGIT: A Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulation

DIGIT: A Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulation

Mike Lambeta, Po-Wei Chou, Stephen Tian, Brian Yang, Benjamin Maloon, Victoria Rose Most, Dougal Sutherland, Alexander Melnikov, Ellen K. Li, Zhenyu Jing, Huazhe Xu, Kuang-Huei Lee, Tingfan Wu, Yuanyuan Li, Jonathan Tremblay, Stan Birchfield, Freddy Mwinyi, Karan Khare, Rene Holladay, Bill Wen, Yunhao Ba, Roberto Calandra · Meta AI / New York University · 2020

Framework

ROS / Python

License

MIT

Stars

650

Summary

An affordable, compact, high-resolution vision-based tactile sensor optimized for in-hand manipulation with real-time fingertip deformation sensing.

Abstract Summary

DIGIT is a low-cost, compact, vision-based tactile sensor specifically engineered for robotic in-hand manipulation tasks. Developed by researchers at Meta AI and NYU, the sensor consists of a soft gel fingertip cover deformed by contact forces, a small camera underneath capturing the deformation field, and a thin elastomer membrane that creates a high-contrast pattern when pushed. By analyzing images of the interior finger surface, the system reconstructs the spatial distribution of contact forces and local geometry at sub-millimeter resolution. The design philosophy behind DIGIT prioritizes manufacturability and affordability. Each sensor costs approximately $25 in parts, can be assembled with off-the-shelf cameras and 3D-printed molds, and is small enough (15 mm diameter) to be mounted on standard robotic fingertips. Unlike previous vision-based tactile sensors that required bulky optics or complicated mounting jigs, DIGIT achieves miniaturization by using a wide-angle lens placed extremely close to the deformable gel surface, capturing roughly 640-by-480 pixel images at over 60 Hz. In evaluation, DIGIT demonstrates superior performance in grasp stability prediction, slip detection, and object surface-texture classification. When mounted on a dexterous hand, it enables precise force-controlled object reorientation, insertion, and surface following. The sensor’s output lends itself naturally to learning-based approaches: recent studies feed raw DIGIT images directly into convolutional and transformer-based policy networks, bypassing explicit force reconstruction and learning manipulation strategies from raw tactile pixels. DIGIT has become the de facto open-source tactile sensor in manipulation research. The hardware design files, embedded firmware, and driver code are publicly released, and a growing ecosystem of compatible robotic hands (including the Meta/MyoHand and several Franka-compatible grippers) has emerged. For researchers working on contact-rich tasks, adding DIGIT provides rich local contact information that is either invisible or noisy when relying solely on wrist force/torque sensing.

Key Points

  • Compact 15-mm vision-based tactile sensor with sub-millimeter deformation imaging.
  • Parts cost ~$25; assembled from off-the-shelf camera, gel, 3D-printed housing.
  • Captures 640×480 at >60 Hz; tested for slip detection and grasp stability.
  • Open-source hardware, firmware, and driver widely adopted in manipulation labs.
  • Enables direct tactile-pixel training for dexterous manipulation policies.

Additional Notes

Setup Tips

  • Use translucent soft silicone with 1:10 curing ratio for consistent gel elasticity.
  • Keep lens and gel surface clean of dust; any speckle pattern is treated as tactile signal.
  • USB3 camera connection is preferred over USB2 to maintain high frame rate at full resolution.
  • GelSight (Yuan et al., 2017)
  • OmniTact (Padmanabha et al., 2020)
  • Tactile Dexterity with DIGIT (Bhirangi et al., 2022)
Share

Related Papers

SI-Diff: A Framework for Learning Search and High-Precision Insertion with a Force-Domain Diffusion Policy

SI-Diff: A Framework for Learning Search and High-Precision Insertion with a Force-Domain Diffusion Policy

Yibo Liu, Stanko Oparnica, Simon Shewchun-Jakaitis et al. · arXiv · May 2026

Contact-rich manipulation is fundamental in robotics but poses significant challenges due to uncertainties in relative poses, such as misalignments and small clearances in peg-in-hole tasks. Existing approaches typically address search and...

manipulation tactile manipulation
Code PDF Intermediate
Code ★ 0 May 2026
Design and Evaluation of a Touchscreen-Based Teleoperation Interface for Robotic Manipulators

Design and Evaluation of a Touchscreen-Based Teleoperation Interface for Robotic Manipulators

Juan José García Cárdenas, Alperen Kenan, Hamidreza Raei et al. · arXiv preprint · Aug 2026

Intuitive teleoperation interfaces are crucial for the safe and effective operation of robotic manipulators in challenging environments. In the nuclear industry, surface contact tasks such as swab sampling require precise path and force tracking, obstacle avoidance, and sustained operator attenti...

manipulation vision reinforcement-learning control learning-from-demonstration tactile benchmark
PDF Intermediate
No code repo Aug 2026
DynaFLIP: Rethinking Robotics Perception via Tri-Modal-Dynamics Guided Representation

DynaFLIP: Rethinking Robotics Perception via Tri-Modal-Dynamics Guided Representation

Jusuk Lee, Seungjae Lee, Jonghun Shin et al. · arXiv preprint · May 2026

Robot manipulation critically depends on perception that preserves the action-relevant aspects of a scene. Yet most robot learning pipelines are built upon visual encoders pre-trained for static recog

foundation-models perception manipulation representation-learning vla
PDF Intermediate
No code repo Code updated: May 2026