A selective fusion module for video super resolution with recurrent architecture

Zichen Gong*, Toshiya Hori, Hiroshi Watanabe, Tomohiro Ikai, Takeshi Chujoh, Eiichi Sasaki, Norio Ito

*この研究の対応する著者

研究成果: Conference contribution

抄録

As an important subtask of video restoration, video super-resolution has attracted a lot of attention in the community as it can eventually promote a wide range of technologies, e.g., video transmission system. Recent video super resolution model1 achieves cutting-edge performance. It efficiently utilizes recurrent architecture with neural networks to gradually aggregate details from previous frames. Nevertheless, this method faces a serious drawback that it is sensitive to occlusion, blur, and large motion changes since it only takes the previous generated output as recurrent input for the super resolution model. This will lead to undesirable rapid information loss during the recurrently generating process, and performance will therefore be dramatically decreased. Our works focus on addressing the issue of rapid information loss in video super-resolution model with recurrent architecture. By producing attention maps through selective fusion module, the recurrent model can adaptively aggregate necessary details across all previously generated high-resolution (HR) frames according to their informativeness. The proposed method is useful for preserving high frequency details collected progressively from each frame while being capable of removing noisy artifacts. This significantly improves the average quality of the super resolution video.

本文言語English
ホスト出版物のタイトルInternational Workshop on Advanced Imaging Technology, IWAIT 2020
編集者Phooi Yee Lau, Mohammad Shobri
出版社SPIE
ISBN(電子版)9781510638358
DOI
出版ステータスPublished - 2020
イベントInternational Workshop on Advanced Imaging Technology, IWAIT 2020 - Yogyakarta, Indonesia
継続期間: 2020 1 52020 1 7

出版物シリーズ

名前Proceedings of SPIE - The International Society for Optical Engineering
11515
ISSN(印刷版)0277-786X
ISSN(電子版)1996-756X

Conference

ConferenceInternational Workshop on Advanced Imaging Technology, IWAIT 2020
国/地域Indonesia
CityYogyakarta
Period20/1/520/1/7

ASJC Scopus subject areas

  • 電子材料、光学材料、および磁性材料
  • 凝縮系物理学
  • コンピュータ サイエンスの応用
  • 応用数学
  • 電子工学および電気工学

フィンガープリント

「A selective fusion module for video super resolution with recurrent architecture」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル