F-LIC: FPGA-based Learned Image Compression with a Fine-grained Pipeline

Heming Sun*, Qingyang Yi, Fangzheng Lin, Lu Yu, Jiro Katto, Masahiro Fujita

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recently, learned image compression (LIC) has shown a superior ability in the compression ratio as well as the quality of the reconstructed image. By adopting the framework of variational autoencoder, LIC [1] can outperform the intra prediction of the latest traditional coding standard VVC. To accelerate the coding speed, most LIC frameworks are operated on GPU with the floating-point arithmetic. However, the mismatch of floating-point calculation results on various hardware platforms will cause the decoding error if encoding and decoding are performed on different platforms. Therefore, LIC with a fixed-point arithmetic [2-3] is highly required. This paper gives an FPGA design for a LIC with 8-bit fixed-point quantization. Different from existing FPGA accelerators [4-6], we propose a fine-grained pipeline architecture to realize high DSP efficiency. Cascading DSP and the deconvolution with zero skipping are also developed to enhance the hardware performance.

Original languageEnglish
Title of host publication2022 IEEE Asian Solid-State Circuits Conference, A-SSCC 2022 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665471435
DOIs
Publication statusPublished - 2022
Event2022 IEEE Asian Solid-State Circuits Conference, A-SSCC 2022 - Taipei, Taiwan, Province of China
Duration: 2022 Nov 62022 Nov 9

Publication series

Name2022 IEEE Asian Solid-State Circuits Conference, A-SSCC 2022 - Proceedings

Conference

Conference2022 IEEE Asian Solid-State Circuits Conference, A-SSCC 2022
Country/TerritoryTaiwan, Province of China
CityTaipei
Period22/11/622/11/9

ASJC Scopus subject areas

  • Hardware and Architecture
  • Signal Processing
  • Electrical and Electronic Engineering
  • Safety, Risk, Reliability and Quality
  • Instrumentation
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'F-LIC: FPGA-based Learned Image Compression with a Fine-grained Pipeline'. Together they form a unique fingerprint.

Cite this