Robust in-hand manipulation of variously sized and shaped objects

Satoshi Funabashi, Alexander Schmitz, Takashi Sato, Sophon Somlor, Shigeki Sugano

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)

Abstract

Moving objects within the hand is challenging, especially if the objects are of various shape and size. In this paper we use machine learning to learn in-hand manipulation of such various sized and shaped objects. The TWENDY-ONE hand is used, which has various properties that makes it well suited for in-hand manipulation: a high number of actuated joints, passive degrees of freedom and soft skin, six-axis force/torque (F/T) sensors in each fingertip, and distributed tactile sensors in the skin. A dataglove is used to gather training samples for teaching the required behavior. The object size information is extracted from the initial grasping posture. After training a neural network, the robot is able to manipulate objects of untrained sizes and shape. The results show the importance of size and tactile information. Compared to interpolation control, the adaptability for the initial posture gap could be greatly extended. Final results show that with deep learning the number of required training sets can be drastically reduced.

Original languageEnglish
Title of host publicationIEEE International Conference on Intelligent Robots and Systems
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages257-263
Number of pages7
Volume2015-December
ISBN (Print)9781479999941
DOIs
Publication statusPublished - 2015 Dec 11
EventIEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2015 - Hamburg, Germany
Duration: 2015 Sep 282015 Oct 2

Other

OtherIEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2015
CountryGermany
CityHamburg
Period15/9/2815/10/2

Fingerprint

Skin
Sensors
Learning systems
Interpolation
Teaching
Torque
Robots
Neural networks
Deep learning

Keywords

  • IEEE Xplore
  • Portable document format

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Cite this

Funabashi, S., Schmitz, A., Sato, T., Somlor, S., & Sugano, S. (2015). Robust in-hand manipulation of variously sized and shaped objects. In IEEE International Conference on Intelligent Robots and Systems (Vol. 2015-December, pp. 257-263). [7353383] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IROS.2015.7353383

Robust in-hand manipulation of variously sized and shaped objects. / Funabashi, Satoshi; Schmitz, Alexander; Sato, Takashi; Somlor, Sophon; Sugano, Shigeki.

IEEE International Conference on Intelligent Robots and Systems. Vol. 2015-December Institute of Electrical and Electronics Engineers Inc., 2015. p. 257-263 7353383.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Funabashi, S, Schmitz, A, Sato, T, Somlor, S & Sugano, S 2015, Robust in-hand manipulation of variously sized and shaped objects. in IEEE International Conference on Intelligent Robots and Systems. vol. 2015-December, 7353383, Institute of Electrical and Electronics Engineers Inc., pp. 257-263, IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2015, Hamburg, Germany, 15/9/28. https://doi.org/10.1109/IROS.2015.7353383
Funabashi S, Schmitz A, Sato T, Somlor S, Sugano S. Robust in-hand manipulation of variously sized and shaped objects. In IEEE International Conference on Intelligent Robots and Systems. Vol. 2015-December. Institute of Electrical and Electronics Engineers Inc. 2015. p. 257-263. 7353383 https://doi.org/10.1109/IROS.2015.7353383
Funabashi, Satoshi ; Schmitz, Alexander ; Sato, Takashi ; Somlor, Sophon ; Sugano, Shigeki. / Robust in-hand manipulation of variously sized and shaped objects. IEEE International Conference on Intelligent Robots and Systems. Vol. 2015-December Institute of Electrical and Electronics Engineers Inc., 2015. pp. 257-263
@inproceedings{904ce8ba1336474b86541c6d3116230f,
title = "Robust in-hand manipulation of variously sized and shaped objects",
abstract = "Moving objects within the hand is challenging, especially if the objects are of various shape and size. In this paper we use machine learning to learn in-hand manipulation of such various sized and shaped objects. The TWENDY-ONE hand is used, which has various properties that makes it well suited for in-hand manipulation: a high number of actuated joints, passive degrees of freedom and soft skin, six-axis force/torque (F/T) sensors in each fingertip, and distributed tactile sensors in the skin. A dataglove is used to gather training samples for teaching the required behavior. The object size information is extracted from the initial grasping posture. After training a neural network, the robot is able to manipulate objects of untrained sizes and shape. The results show the importance of size and tactile information. Compared to interpolation control, the adaptability for the initial posture gap could be greatly extended. Final results show that with deep learning the number of required training sets can be drastically reduced.",
keywords = "IEEE Xplore, Portable document format",
author = "Satoshi Funabashi and Alexander Schmitz and Takashi Sato and Sophon Somlor and Shigeki Sugano",
year = "2015",
month = "12",
day = "11",
doi = "10.1109/IROS.2015.7353383",
language = "English",
isbn = "9781479999941",
volume = "2015-December",
pages = "257--263",
booktitle = "IEEE International Conference on Intelligent Robots and Systems",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Robust in-hand manipulation of variously sized and shaped objects

AU - Funabashi, Satoshi

AU - Schmitz, Alexander

AU - Sato, Takashi

AU - Somlor, Sophon

AU - Sugano, Shigeki

PY - 2015/12/11

Y1 - 2015/12/11

N2 - Moving objects within the hand is challenging, especially if the objects are of various shape and size. In this paper we use machine learning to learn in-hand manipulation of such various sized and shaped objects. The TWENDY-ONE hand is used, which has various properties that makes it well suited for in-hand manipulation: a high number of actuated joints, passive degrees of freedom and soft skin, six-axis force/torque (F/T) sensors in each fingertip, and distributed tactile sensors in the skin. A dataglove is used to gather training samples for teaching the required behavior. The object size information is extracted from the initial grasping posture. After training a neural network, the robot is able to manipulate objects of untrained sizes and shape. The results show the importance of size and tactile information. Compared to interpolation control, the adaptability for the initial posture gap could be greatly extended. Final results show that with deep learning the number of required training sets can be drastically reduced.

AB - Moving objects within the hand is challenging, especially if the objects are of various shape and size. In this paper we use machine learning to learn in-hand manipulation of such various sized and shaped objects. The TWENDY-ONE hand is used, which has various properties that makes it well suited for in-hand manipulation: a high number of actuated joints, passive degrees of freedom and soft skin, six-axis force/torque (F/T) sensors in each fingertip, and distributed tactile sensors in the skin. A dataglove is used to gather training samples for teaching the required behavior. The object size information is extracted from the initial grasping posture. After training a neural network, the robot is able to manipulate objects of untrained sizes and shape. The results show the importance of size and tactile information. Compared to interpolation control, the adaptability for the initial posture gap could be greatly extended. Final results show that with deep learning the number of required training sets can be drastically reduced.

KW - IEEE Xplore

KW - Portable document format

UR - http://www.scopus.com/inward/record.url?scp=84958179269&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84958179269&partnerID=8YFLogxK

U2 - 10.1109/IROS.2015.7353383

DO - 10.1109/IROS.2015.7353383

M3 - Conference contribution

SN - 9781479999941

VL - 2015-December

SP - 257

EP - 263

BT - IEEE International Conference on Intelligent Robots and Systems

PB - Institute of Electrical and Electronics Engineers Inc.

ER -