A novel depth-image based view synthesis scheme for multiview and 3DTV

Xun He, Xin Jin, Minghui Wang, Satoshi Goto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Depth-Image Based View Synthesis (DIVS) is considered as a good method to reduce the view numbers for multiview and 3DTV. However, it can't guarantee the quality of occlusion areas of the produced views. In order to reduce the view numbers for multiview and 3DTV, a novel depth-image based view synthesis scheme is proposed to produce four views by one view with depth. Artifact detection and repair functions are added to resolve occlusion areas problem. Artifact region is detected by comparing with original view, and repair function utilizes motion compensation technique to fix it from its previous virtual view. This repair function can correctly fix the artifact region at the cost of some additional bits for each virtual view. In our experiments, only one view is applied to produce four virtual views. About 4∼6 dB gain can be achieved at the costs of some additional bit stream. The total bit rate of the four views is only 56% of one color image at the same QP.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages161-170
Number of pages10
Volume6523 LNCS
EditionPART 1
DOIs
Publication statusPublished - 2011
Event17th Multimedia Modeling Conference, MMM 2011 - Taipei
Duration: 2011 Jan 52011 Jan 7

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 1
Volume6523 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other17th Multimedia Modeling Conference, MMM 2011
CityTaipei
Period11/1/511/1/7

Fingerprint

Repair
Synthesis
Occlusion
Motion Compensation
Motion compensation
Color Image
Resolve
Color
Costs
Experiment
Experiments

Keywords

  • 3DTV
  • depth image
  • multiview
  • view synthesis

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

He, X., Jin, X., Wang, M., & Goto, S. (2011). A novel depth-image based view synthesis scheme for multiview and 3DTV. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (PART 1 ed., Vol. 6523 LNCS, pp. 161-170). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6523 LNCS, No. PART 1). https://doi.org/10.1007/978-3-642-17832-0_16

A novel depth-image based view synthesis scheme for multiview and 3DTV. / He, Xun; Jin, Xin; Wang, Minghui; Goto, Satoshi.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6523 LNCS PART 1. ed. 2011. p. 161-170 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6523 LNCS, No. PART 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

He, X, Jin, X, Wang, M & Goto, S 2011, A novel depth-image based view synthesis scheme for multiview and 3DTV. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 1 edn, vol. 6523 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 1, vol. 6523 LNCS, pp. 161-170, 17th Multimedia Modeling Conference, MMM 2011, Taipei, 11/1/5. https://doi.org/10.1007/978-3-642-17832-0_16
He X, Jin X, Wang M, Goto S. A novel depth-image based view synthesis scheme for multiview and 3DTV. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 1 ed. Vol. 6523 LNCS. 2011. p. 161-170. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1). https://doi.org/10.1007/978-3-642-17832-0_16
He, Xun ; Jin, Xin ; Wang, Minghui ; Goto, Satoshi. / A novel depth-image based view synthesis scheme for multiview and 3DTV. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6523 LNCS PART 1. ed. 2011. pp. 161-170 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1).
@inproceedings{dac8f9b114af4df1b4e5c138e74aa865,
title = "A novel depth-image based view synthesis scheme for multiview and 3DTV",
abstract = "Depth-Image Based View Synthesis (DIVS) is considered as a good method to reduce the view numbers for multiview and 3DTV. However, it can't guarantee the quality of occlusion areas of the produced views. In order to reduce the view numbers for multiview and 3DTV, a novel depth-image based view synthesis scheme is proposed to produce four views by one view with depth. Artifact detection and repair functions are added to resolve occlusion areas problem. Artifact region is detected by comparing with original view, and repair function utilizes motion compensation technique to fix it from its previous virtual view. This repair function can correctly fix the artifact region at the cost of some additional bits for each virtual view. In our experiments, only one view is applied to produce four virtual views. About 4∼6 dB gain can be achieved at the costs of some additional bit stream. The total bit rate of the four views is only 56{\%} of one color image at the same QP.",
keywords = "3DTV, depth image, multiview, view synthesis",
author = "Xun He and Xin Jin and Minghui Wang and Satoshi Goto",
year = "2011",
doi = "10.1007/978-3-642-17832-0_16",
language = "English",
isbn = "3642178316",
volume = "6523 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
number = "PART 1",
pages = "161--170",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
edition = "PART 1",

}

TY - GEN

T1 - A novel depth-image based view synthesis scheme for multiview and 3DTV

AU - He, Xun

AU - Jin, Xin

AU - Wang, Minghui

AU - Goto, Satoshi

PY - 2011

Y1 - 2011

N2 - Depth-Image Based View Synthesis (DIVS) is considered as a good method to reduce the view numbers for multiview and 3DTV. However, it can't guarantee the quality of occlusion areas of the produced views. In order to reduce the view numbers for multiview and 3DTV, a novel depth-image based view synthesis scheme is proposed to produce four views by one view with depth. Artifact detection and repair functions are added to resolve occlusion areas problem. Artifact region is detected by comparing with original view, and repair function utilizes motion compensation technique to fix it from its previous virtual view. This repair function can correctly fix the artifact region at the cost of some additional bits for each virtual view. In our experiments, only one view is applied to produce four virtual views. About 4∼6 dB gain can be achieved at the costs of some additional bit stream. The total bit rate of the four views is only 56% of one color image at the same QP.

AB - Depth-Image Based View Synthesis (DIVS) is considered as a good method to reduce the view numbers for multiview and 3DTV. However, it can't guarantee the quality of occlusion areas of the produced views. In order to reduce the view numbers for multiview and 3DTV, a novel depth-image based view synthesis scheme is proposed to produce four views by one view with depth. Artifact detection and repair functions are added to resolve occlusion areas problem. Artifact region is detected by comparing with original view, and repair function utilizes motion compensation technique to fix it from its previous virtual view. This repair function can correctly fix the artifact region at the cost of some additional bits for each virtual view. In our experiments, only one view is applied to produce four virtual views. About 4∼6 dB gain can be achieved at the costs of some additional bit stream. The total bit rate of the four views is only 56% of one color image at the same QP.

KW - 3DTV

KW - depth image

KW - multiview

KW - view synthesis

UR - http://www.scopus.com/inward/record.url?scp=78751678524&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78751678524&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-17832-0_16

DO - 10.1007/978-3-642-17832-0_16

M3 - Conference contribution

AN - SCOPUS:78751678524

SN - 3642178316

SN - 9783642178313

VL - 6523 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 161

EP - 170

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -