Performance Analysis of Generated Predictive Frames Using PredNet Bi-directionally

Kanato Sakama*, Shunichi Sekiguchi, Wataru Kameyama

*この研究の対応する著者

研究成果: Conference contribution

抄録

For generating motion-compensated predictive frames, which is one of the video coding processes, there has been a lot of studies on using DNN without using motion vectors. Conventional methods of generating motion-compensated predictive frames using DNN use only the source frames for prediction in the forward direction. However, in the ever-standardized video coding schemes, it has been confirmed that the bi-directional prediction, e.g., B-picture, improves coding efficiency. Thus, for generating motion-compensated predictive frames to be used in video coding, we propose to apply PredNet bidirectionally, that is a future frame generation model using DNN based on the prediction process of visual input stimuli in brain. In this paper, the performance of the predictive frames generated by the proposed method is evaluated by using MSE and SSIM compared with the prediction accuracy applying PredNet only to the forward direction. In addition, we also investigate whether the prediction accuracy of the predicted frames can be improved by increasing the amount of training frames in videos chosen from YouTube-8M. The results show the effectiveness of the proposed method in terms of less prediction error compared with the forward-only PredNet, as well as the performance increasing by more training data.

本文言語English
ホスト出版物のタイトルInternational Workshop on Advanced Imaging Technology, IWAIT 2022
編集者Masayuki Nakajima, Shogo Muramatsu, Jae-Gon Kim, Jing-Ming Guo, Qian Kemao
出版社SPIE
ISBN(電子版)9781510653313
DOI
出版ステータスPublished - 2022
イベント2022 International Workshop on Advanced Imaging Technology, IWAIT 2022 - Hong Kong, China
継続期間: 2022 1月 42022 1月 6

出版物シリーズ

名前Proceedings of SPIE - The International Society for Optical Engineering
12177
ISSN(印刷版)0277-786X
ISSN(電子版)1996-756X

Conference

Conference2022 International Workshop on Advanced Imaging Technology, IWAIT 2022
国/地域China
CityHong Kong
Period22/1/422/1/6

ASJC Scopus subject areas

  • 電子材料、光学材料、および磁性材料
  • 凝縮系物理学
  • コンピュータ サイエンスの応用
  • 応用数学
  • 電子工学および電気工学

フィンガープリント

「Performance Analysis of Generated Predictive Frames Using PredNet Bi-directionally」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル