An integrated Hole-filling algorithm for view synthesis

Wenxin Yu, Weichen Wang, Zhengyan Guo, Satoshi Goto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Multi-view video can provide users a 3-D and virtual reality perception by its multiple viewing angles. In recent years, the depth image-based rendering (DIBR) is generally used to synthesize virtual view images in free viewpoint television (FTV) and three-dimensional (3-D) video. In order to conceal the zero-region more accurately and improve the quality of virtual view synthesized frame, an integrated Hole-filling Algorithm for View Synthesis is proposed in this paper. It contains five parts: the different regions distinguishing algorithm, foreground and background boundary detection, the texture image isophotes detection, the textural and structural isophotes prediction algorithm, the in-painting algorithm with gradient priority order. Based on the texture isophotes prediction with geometrical principle and the in-painting algorithm with gradient priority order, the boundary information of the foreground is much clearer and the texture information in the zero-region can be concealed much more accurately than the previous work. The vision quality mainly depends on the distortion of the structural information. Through the experimental results, the proposed algorithm not only improves the objective quality of the virtual image, but also improves the subjective quality of the virtual image a lot, and the human vision quality is also improved obviously based on the subjective results. Especially, it ensures the boundary contours of the foreground objects and the textural and the structural information.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages80-92
Number of pages13
Volume7674 LNCS
DOIs
Publication statusPublished - 2012
Event13th Pacific-Rim Conference on Multimedia, PCM 2012 - Singapore
Duration: 2012 Dec 42012 Dec 6

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7674 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other13th Pacific-Rim Conference on Multimedia, PCM 2012
CitySingapore
Period12/12/412/12/6

Fingerprint

Synthesis
Texture
Inpainting
Textures
Painting
Image-based Rendering
Gradient
3D Video
Boundary Detection
Human Vision
Prediction
Zero
Virtual Reality
Television
Virtual reality
3D
Angle
Three-dimensional
Experimental Results

Keywords

  • DIBR
  • Hole-filling
  • In-painting
  • Virtual view

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Yu, W., Wang, W., Guo, Z., & Goto, S. (2012). An integrated Hole-filling algorithm for view synthesis. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 7674 LNCS, pp. 80-92). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7674 LNCS). https://doi.org/10.1007/978-3-642-34778-8_8

An integrated Hole-filling algorithm for view synthesis. / Yu, Wenxin; Wang, Weichen; Guo, Zhengyan; Goto, Satoshi.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7674 LNCS 2012. p. 80-92 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7674 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yu, W, Wang, W, Guo, Z & Goto, S 2012, An integrated Hole-filling algorithm for view synthesis. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 7674 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7674 LNCS, pp. 80-92, 13th Pacific-Rim Conference on Multimedia, PCM 2012, Singapore, 12/12/4. https://doi.org/10.1007/978-3-642-34778-8_8
Yu W, Wang W, Guo Z, Goto S. An integrated Hole-filling algorithm for view synthesis. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7674 LNCS. 2012. p. 80-92. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-34778-8_8
Yu, Wenxin ; Wang, Weichen ; Guo, Zhengyan ; Goto, Satoshi. / An integrated Hole-filling algorithm for view synthesis. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7674 LNCS 2012. pp. 80-92 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{10104320224b4982b0981936411e6765,
title = "An integrated Hole-filling algorithm for view synthesis",
abstract = "Multi-view video can provide users a 3-D and virtual reality perception by its multiple viewing angles. In recent years, the depth image-based rendering (DIBR) is generally used to synthesize virtual view images in free viewpoint television (FTV) and three-dimensional (3-D) video. In order to conceal the zero-region more accurately and improve the quality of virtual view synthesized frame, an integrated Hole-filling Algorithm for View Synthesis is proposed in this paper. It contains five parts: the different regions distinguishing algorithm, foreground and background boundary detection, the texture image isophotes detection, the textural and structural isophotes prediction algorithm, the in-painting algorithm with gradient priority order. Based on the texture isophotes prediction with geometrical principle and the in-painting algorithm with gradient priority order, the boundary information of the foreground is much clearer and the texture information in the zero-region can be concealed much more accurately than the previous work. The vision quality mainly depends on the distortion of the structural information. Through the experimental results, the proposed algorithm not only improves the objective quality of the virtual image, but also improves the subjective quality of the virtual image a lot, and the human vision quality is also improved obviously based on the subjective results. Especially, it ensures the boundary contours of the foreground objects and the textural and the structural information.",
keywords = "DIBR, Hole-filling, In-painting, Virtual view",
author = "Wenxin Yu and Weichen Wang and Zhengyan Guo and Satoshi Goto",
year = "2012",
doi = "10.1007/978-3-642-34778-8_8",
language = "English",
isbn = "9783642347771",
volume = "7674 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "80--92",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - An integrated Hole-filling algorithm for view synthesis

AU - Yu, Wenxin

AU - Wang, Weichen

AU - Guo, Zhengyan

AU - Goto, Satoshi

PY - 2012

Y1 - 2012

N2 - Multi-view video can provide users a 3-D and virtual reality perception by its multiple viewing angles. In recent years, the depth image-based rendering (DIBR) is generally used to synthesize virtual view images in free viewpoint television (FTV) and three-dimensional (3-D) video. In order to conceal the zero-region more accurately and improve the quality of virtual view synthesized frame, an integrated Hole-filling Algorithm for View Synthesis is proposed in this paper. It contains five parts: the different regions distinguishing algorithm, foreground and background boundary detection, the texture image isophotes detection, the textural and structural isophotes prediction algorithm, the in-painting algorithm with gradient priority order. Based on the texture isophotes prediction with geometrical principle and the in-painting algorithm with gradient priority order, the boundary information of the foreground is much clearer and the texture information in the zero-region can be concealed much more accurately than the previous work. The vision quality mainly depends on the distortion of the structural information. Through the experimental results, the proposed algorithm not only improves the objective quality of the virtual image, but also improves the subjective quality of the virtual image a lot, and the human vision quality is also improved obviously based on the subjective results. Especially, it ensures the boundary contours of the foreground objects and the textural and the structural information.

AB - Multi-view video can provide users a 3-D and virtual reality perception by its multiple viewing angles. In recent years, the depth image-based rendering (DIBR) is generally used to synthesize virtual view images in free viewpoint television (FTV) and three-dimensional (3-D) video. In order to conceal the zero-region more accurately and improve the quality of virtual view synthesized frame, an integrated Hole-filling Algorithm for View Synthesis is proposed in this paper. It contains five parts: the different regions distinguishing algorithm, foreground and background boundary detection, the texture image isophotes detection, the textural and structural isophotes prediction algorithm, the in-painting algorithm with gradient priority order. Based on the texture isophotes prediction with geometrical principle and the in-painting algorithm with gradient priority order, the boundary information of the foreground is much clearer and the texture information in the zero-region can be concealed much more accurately than the previous work. The vision quality mainly depends on the distortion of the structural information. Through the experimental results, the proposed algorithm not only improves the objective quality of the virtual image, but also improves the subjective quality of the virtual image a lot, and the human vision quality is also improved obviously based on the subjective results. Especially, it ensures the boundary contours of the foreground objects and the textural and the structural information.

KW - DIBR

KW - Hole-filling

KW - In-painting

KW - Virtual view

UR - http://www.scopus.com/inward/record.url?scp=84871429151&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84871429151&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-34778-8_8

DO - 10.1007/978-3-642-34778-8_8

M3 - Conference contribution

SN - 9783642347771

VL - 7674 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 80

EP - 92

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -