Manga character clustering with DBSCAN using fine-tuned CNN model

Hideaki Yanagisawa, Takuro Yamashita, Watanabe Hiroshi

研究成果: Conference contribution

2 被引用数 (Scopus)


Manga (Japanese comic) is popular content worldwide. In Japan, e-comic accounts for about 80% of e-book market. In recent years, metadata extraction from manga image has been studied for providing e-comic service. Manga character is one of the important contents for story understanding. In conventional research, some character identification methods are proposed those classify characters' face images using k-means clustering. However, there are two problems. First, kmeans method needs to specify the number of clusters, however the number of characters in target manga images is commonly unknown. Second, manga includes characters with few appearing, so it is difficult to classify characters with high purity. To solve these problems, we propose clustering method using DBSCAN which decides number of clusters automatically and is robust to noise data. In our prior research, it is experimented that character face clustering using DBSCAN and general CNN features. However, general CNN model is difficult to capture detailed features of manga characters. In this paper, we apply DBSCAN to fine-tuned CNN with manga character faces to improve the clustering accuracy. We also compare the optimal parameter determination method of DBSCAN. Experimental results showed that the dimensional reduction using Kernel PCA and UMAP is effective. In addition, we confirmed the validity of proposed method that determining the parameters of DBSCAN based on the slope changing of k-distance graph.

ホスト出版物のタイトルInternational Workshop on Advanced Image Technology, IWAIT 2019
編集者Yung-Lyul Lee, Sanun Srisuk, Qian Kemao, Wen-Nung Lie, Kazuya Hayase, Lu Yu, Phooi Yee Lau
出版ステータスPublished - 2019
イベントInternational Workshop on Advanced Image Technology 2019, IWAIT 2019 - Singapore, Singapore
継続期間: 2019 1月 62019 1月 9


名前Proceedings of SPIE - The International Society for Optical Engineering


ConferenceInternational Workshop on Advanced Image Technology 2019, IWAIT 2019

ASJC Scopus subject areas

  • 電子材料、光学材料、および磁性材料
  • 凝縮系物理学
  • コンピュータ サイエンスの応用
  • 応用数学
  • 電子工学および電気工学


「Manga character clustering with DBSCAN using fine-tuned CNN model」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。