Estimation of flat object deformation using rgb-d sensor for robot reproduction

Xin He*, Takafumi Matsumaru

*この研究の対応する著者

研究成果査読

抄録

This paper introduces a system that can estimate the deformation process of a deformed flat object (folded plane) and generate the input data for a robot with human-like dexterous hands and fingers to reproduce the same deformation of another similar object. The system is based on processing RGB data and depth data with three core techniques: a weighted graph clustering method for non-rigid point matching and clustering; a refined region growing method for plane detection on depth data based on an offset error defined by ourselves; and a novel sliding checking model to check the bending line and adjacent relationship between each pair of planes. Through some evaluation experiments, we show the improvement of the core techniques to conventional studies. By applying our approach to different deformed papers, the performance of the entire system is confirmed to have around 1.59 degrees of average angular error, which is similar to the smallest angular discrimination of human eyes. As a result, for the deformation of the flat object caused by folding, if our system can get at least one feature point cluster on each plane, it can get spatial information of each bending line and each plane with acceptable accuracy. The subject of this paper is a folded plane, but we will develop it into a robotic reproduction of general object deformation.

本文言語English
論文番号105
ページ(範囲)1-36
ページ数36
ジャーナルSensors (Switzerland)
21
1
DOI
出版ステータスPublished - 2021 1 1

ASJC Scopus subject areas

  • 分析化学
  • 生化学
  • 原子分子物理学および光学
  • 器械工学
  • 電子工学および電気工学

フィンガープリント

「Estimation of flat object deformation using rgb-d sensor for robot reproduction」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル