Palpation Robot System - Reproduction Method by Deep Neural Network of Skin Palpation Judgment Focusing on Softness Classification

Fumihiro Kato*, Takeya Adachi, Takumi Handa, Kaito Kamishima, Hiroyasu Iwata

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In recent years, the spread of infectious diseases, such as COVID-19, has increased the need for medical examinations to avoid contact between doctors and patients. Most treatments, especially dermatology, require palpation, and its impact is significant. In this study, we aimed to reproduce the judgment of the softness and surface textures of diseased parts, which is important to dermatologists for determining the condition, using a simple robot device. Five levels of softness and three types of surface textures labeled with 14 types of materials were obtained from interviews with dermatologists. To acquire a haptic response from materials during pushing, 1) a single-rod probe with a haptic sensor using a linear actuator and 2) a dual-rod type configuration to obtain vibration propagation was constructed. Frequency-analyzed images were produced from the obtained waveforms of force and acceleration. A total of 343 images from 13 materials were used for transfer learning and were classified using AlexNet. The classification accuracy of the single-rod probe was 93.0%, and that of the dual-probe configuration was 95.2%. The classification accuracy was improved using the dual probe configuration than the single one; the softness classification accuracy was improved from 93.8% (single-rod) to 95.7% (dual-rod configuration). The surface texture classification accuracy was improved from 91.9% (single-rod) to 92.8% (dual-rod configuration), respectively. Therefore, the proposed method enables the reproduction of the judgment of five-level softness and three types of surface texture judgment by dermatologists.

Original languageEnglish
Title of host publicationProceedings - International Symposium on Measurement and Control in Robotics
Subtitle of host publicationRobotics and Virtual Tools for a New Era, ISMCR 2022
EditorsZafar Taqvi, Simone Keller Fuchter, Geraldo Gurgel Filho
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665454964
DOIs
Publication statusPublished - 2022
Event25th International Symposium on Measurement and Control in Robotics, ISMCR 2022 - Virtual, Online, United States
Duration: 2022 Sep 282022 Sep 30

Publication series

NameProceedings - International Symposium on Measurement and Control in Robotics: Robotics and Virtual Tools for a New Era, ISMCR 2022

Conference

Conference25th International Symposium on Measurement and Control in Robotics, ISMCR 2022
Country/TerritoryUnited States
CityVirtual, Online
Period22/9/2822/9/30

Keywords

  • dermatology
  • machine learning
  • palpation
  • robotic medical system
  • telexistence

ASJC Scopus subject areas

  • Artificial Intelligence
  • Mechanical Engineering
  • Control and Optimization
  • Instrumentation

Fingerprint

Dive into the research topics of 'Palpation Robot System - Reproduction Method by Deep Neural Network of Skin Palpation Judgment Focusing on Softness Classification'. Together they form a unique fingerprint.

Cite this