Adaptive image compression using GAN based semantic-perceptual residual compensation

Ruojing Wang, Zitang Sun, Sei Ichiro Kamata

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Image compression is a basic task in image processing. The existing methods always have problems such as the loss of image details and the reconstructed image does not conform to human vision. This paper presents an adaptive image compression algorithm that relies on GAN based semantic-perceptual residual compensation, which is available to offer visually pleasing reconstruction at a low bitrate. Our method derive from a U-shaped encoder-decoder structure accompanied by a well-designed dense residual connection with a strip pooling module to improve the original auto-encoder. Besides, we utilize the idea of adversarial learning by introducing a discriminator, thus constructed a complete GAN. To improve the coding efficiency, we creatively designed an adaptive semantic-perception residual compensation block based on the Grad-CAM algorithm. Through the strategy of adversarial learning, the reconstructed image is more towards the distribution of the real image, and further semantic perception can achieve higher quality compression of the region of interest from the human attention. Besides, we combine multiple existing quantitative methods, including the latest FLIF lossless compression algorithm, BPG vector compression algorithm and soft-quantization to perform deeper compression on the image. Experimental results, including PSNR, MS-SSIM demonstrate that the proposed approach outperforms the current state-of-the-art image compression methods.

Original languageEnglish
Title of host publicationProceedings of ICPR 2020 - 25th International Conference on Pattern Recognition
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages9030-9037
Number of pages8
ISBN (Electronic)9781728188089
DOIs
Publication statusPublished - 2020
Event25th International Conference on Pattern Recognition, ICPR 2020 - Virtual, Milan, Italy
Duration: 2021 Jan 102021 Jan 15

Publication series

NameProceedings - International Conference on Pattern Recognition
ISSN (Print)1051-4651

Conference

Conference25th International Conference on Pattern Recognition, ICPR 2020
Country/TerritoryItaly
CityVirtual, Milan
Period21/1/1021/1/15

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Fingerprint

Dive into the research topics of 'Adaptive image compression using GAN based semantic-perceptual residual compensation'. Together they form a unique fingerprint.

Cite this