A Pre-Saliency Map Based Blind Image Quality Assessment via Convolutional Neural Networks

Zhengxue Cheng, Masaru Takeuchi, Jiro Katto

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    9 Citations (Scopus)

    Abstract

    In recent years, various approaches have been investigated towards blind image quality assessment (IQA) with high accuracy and low complexity. In this paper we develop a pre-saliency map based blind IQA method, which takes advantage of saliency information in prior of quality prediction for performance enhancement by two steps. 1) We split the image into patches and design a convolution neural network (CNN) to predict the patch-wise quality score. Then we explore the relation between image saliency information and CNN prediction error to present a statistical analysis. 2) Based on the analysis, we propose a patch quality aggregation algorithm by removing non-salient patches which are likely to bring large prediction error and assigning large weights for salient patches. Experimental results validate that our method can achieve high accuracy (0.978) with subjective quality scores, which outperforms existing IQA methods. Meanwhile, the proposed method can reduce 52.7% computational time than the IQA without pre-saliency map.

    Original languageEnglish
    Title of host publicationProceedings - 2017 IEEE International Symposium on Multimedia, ISM 2017
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages77-82
    Number of pages6
    Volume2017-January
    ISBN (Electronic)9781538629369
    DOIs
    Publication statusPublished - 2017 Dec 28
    Event19th IEEE International Symposium on Multimedia, ISM 2017 - Taichung, Taiwan, Province of China
    Duration: 2017 Dec 112017 Dec 13

    Other

    Other19th IEEE International Symposium on Multimedia, ISM 2017
    CountryTaiwan, Province of China
    CityTaichung
    Period17/12/1117/12/13

    Keywords

    • Blind image quality assessment
    • Convolutional neural network
    • Pre-saliency map

    ASJC Scopus subject areas

    • Media Technology
    • Sensory Systems

    Fingerprint Dive into the research topics of 'A Pre-Saliency Map Based Blind Image Quality Assessment via Convolutional Neural Networks'. Together they form a unique fingerprint.

    Cite this