A Pre-Saliency Map Based Blind Image Quality Assessment via Convolutional Neural Networks

Zhengxue Cheng, Masaru Takeuchi, Jiro Katto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Citations (Scopus)

Abstract

In recent years, various approaches have been investigated towards blind image quality assessment (IQA) with high accuracy and low complexity. In this paper we develop a pre-saliency map based blind IQA method, which takes advantage of saliency information in prior of quality prediction for performance enhancement by two steps. 1) We split the image into patches and design a convolution neural network (CNN) to predict the patch-wise quality score. Then we explore the relation between image saliency information and CNN prediction error to present a statistical analysis. 2) Based on the analysis, we propose a patch quality aggregation algorithm by removing non-salient patches which are likely to bring large prediction error and assigning large weights for salient patches. Experimental results validate that our method can achieve high accuracy (0.978) with subjective quality scores, which outperforms existing IQA methods. Meanwhile, the proposed method can reduce 52.7% computational time than the IQA without pre-saliency map.

Original languageEnglish
Title of host publicationProceedings - 2017 IEEE International Symposium on Multimedia, ISM 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages77-82
Number of pages6
ISBN (Electronic)9781538629369
DOIs
Publication statusPublished - 2017 Dec 28
Event19th IEEE International Symposium on Multimedia, ISM 2017 - Taichung, Taiwan, Province of China
Duration: 2017 Dec 112017 Dec 13

Publication series

NameProceedings - 2017 IEEE International Symposium on Multimedia, ISM 2017
Volume2017-January

Other

Other19th IEEE International Symposium on Multimedia, ISM 2017
CountryTaiwan, Province of China
CityTaichung
Period17/12/1117/12/13

Keywords

  • Blind image quality assessment
  • Convolutional neural network
  • Pre-saliency map

ASJC Scopus subject areas

  • Media Technology
  • Sensory Systems

Fingerprint Dive into the research topics of 'A Pre-Saliency Map Based Blind Image Quality Assessment via Convolutional Neural Networks'. Together they form a unique fingerprint.

Cite this