Learning to restore deteriorated line drawing

Kazuma Sasaki, Satoshi Iizuka, Edgar Simo-Serra, Hiroshi Ishikawa

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

We propose a fully automatic approach to restore aged old line drawings. We decompose the task into two subtasks: the line extraction subtask, which aims to extract line fragments and remove the paper texture background, and the restoration subtask, which fills in possible gaps and deterioration of the lines to produce a clean line drawing. Our approach is based on a convolutional neural network that consists of two sub-networks corresponding to the two subtasks. They are trained as part of a single framework in an end-to-end fashion. We also introduce a new dataset consisting of manually annotated sketches by Leonardo da Vinci which, in combination with a synthetic data generation approach, allows training the network to restore deteriorated line drawings. We evaluate our method on challenging 500-year-old sketches and compare with existing approaches with a user study, in which it is found that our approach is preferred 72.7% of the time.

Original languageEnglish
Pages (from-to)1077-1085
Number of pages9
JournalVisual Computer
Volume34
Issue number6-8
DOIs
Publication statusPublished - 2018 Jun 1

Keywords

  • Convolutional neural network
  • Image manipulation
  • Image restoration
  • Line drawings

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Learning to restore deteriorated line drawing'. Together they form a unique fingerprint.

  • Cite this