Room reconstruction from a single spherical image by higher-order energy minimization

Kosuke Fukano, Yoshihiko Mochizuki, Satoshi Iizuka, Edgar Simo Serra, Akihiro Sugimoto, Hiroshi Ishikawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

We propose a method for understanding a room from a single spherical image, i.e., reconstructing and identifying structural planes forming the ceiling, the floor, and the walls in a room. A spherical image records the light that falls onto a single viewpoint from all directions and does not require correlating geometrical information from multiple images, which facilitates robust and precise reconstruction of the room structure. In our method, we detect line segments from a given image, and classify them into two groups: segments that form the boundaries of the structural planes and those that do not. We formulate this problem as a higher-order energy minimization problem that combines the various measures of likelihood that one, two, or three line segments are part of the boundary. We minimize the energy with graph cuts to identify segments forming boundaries, from which we estimate structural the planes in 3D. Experimental results on synthetic and real images confirm the effectiveness of the proposed method.

Original languageEnglish
Title of host publication2016 23rd International Conference on Pattern Recognition, ICPR 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1768-1773
Number of pages6
ISBN (Electronic)9781509048472
DOIs
Publication statusPublished - 2017 Apr 13
Event23rd International Conference on Pattern Recognition, ICPR 2016 - Cancun, Mexico
Duration: 2016 Dec 42016 Dec 8

Other

Other23rd International Conference on Pattern Recognition, ICPR 2016
CountryMexico
CityCancun
Period16/12/416/12/8

Fingerprint

Ceilings

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Cite this

Fukano, K., Mochizuki, Y., Iizuka, S., Simo Serra, E., Sugimoto, A., & Ishikawa, H. (2017). Room reconstruction from a single spherical image by higher-order energy minimization. In 2016 23rd International Conference on Pattern Recognition, ICPR 2016 (pp. 1768-1773). [7899892] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICPR.2016.7899892

Room reconstruction from a single spherical image by higher-order energy minimization. / Fukano, Kosuke; Mochizuki, Yoshihiko; Iizuka, Satoshi; Simo Serra, Edgar; Sugimoto, Akihiro; Ishikawa, Hiroshi.

2016 23rd International Conference on Pattern Recognition, ICPR 2016. Institute of Electrical and Electronics Engineers Inc., 2017. p. 1768-1773 7899892.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Fukano, K, Mochizuki, Y, Iizuka, S, Simo Serra, E, Sugimoto, A & Ishikawa, H 2017, Room reconstruction from a single spherical image by higher-order energy minimization. in 2016 23rd International Conference on Pattern Recognition, ICPR 2016., 7899892, Institute of Electrical and Electronics Engineers Inc., pp. 1768-1773, 23rd International Conference on Pattern Recognition, ICPR 2016, Cancun, Mexico, 16/12/4. https://doi.org/10.1109/ICPR.2016.7899892
Fukano K, Mochizuki Y, Iizuka S, Simo Serra E, Sugimoto A, Ishikawa H. Room reconstruction from a single spherical image by higher-order energy minimization. In 2016 23rd International Conference on Pattern Recognition, ICPR 2016. Institute of Electrical and Electronics Engineers Inc. 2017. p. 1768-1773. 7899892 https://doi.org/10.1109/ICPR.2016.7899892
Fukano, Kosuke ; Mochizuki, Yoshihiko ; Iizuka, Satoshi ; Simo Serra, Edgar ; Sugimoto, Akihiro ; Ishikawa, Hiroshi. / Room reconstruction from a single spherical image by higher-order energy minimization. 2016 23rd International Conference on Pattern Recognition, ICPR 2016. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 1768-1773
@inproceedings{5060e040961e45a2953e7feb44a03a70,
title = "Room reconstruction from a single spherical image by higher-order energy minimization",
abstract = "We propose a method for understanding a room from a single spherical image, i.e., reconstructing and identifying structural planes forming the ceiling, the floor, and the walls in a room. A spherical image records the light that falls onto a single viewpoint from all directions and does not require correlating geometrical information from multiple images, which facilitates robust and precise reconstruction of the room structure. In our method, we detect line segments from a given image, and classify them into two groups: segments that form the boundaries of the structural planes and those that do not. We formulate this problem as a higher-order energy minimization problem that combines the various measures of likelihood that one, two, or three line segments are part of the boundary. We minimize the energy with graph cuts to identify segments forming boundaries, from which we estimate structural the planes in 3D. Experimental results on synthetic and real images confirm the effectiveness of the proposed method.",
author = "Kosuke Fukano and Yoshihiko Mochizuki and Satoshi Iizuka and {Simo Serra}, Edgar and Akihiro Sugimoto and Hiroshi Ishikawa",
year = "2017",
month = "4",
day = "13",
doi = "10.1109/ICPR.2016.7899892",
language = "English",
pages = "1768--1773",
booktitle = "2016 23rd International Conference on Pattern Recognition, ICPR 2016",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

TY - GEN

T1 - Room reconstruction from a single spherical image by higher-order energy minimization

AU - Fukano, Kosuke

AU - Mochizuki, Yoshihiko

AU - Iizuka, Satoshi

AU - Simo Serra, Edgar

AU - Sugimoto, Akihiro

AU - Ishikawa, Hiroshi

PY - 2017/4/13

Y1 - 2017/4/13

N2 - We propose a method for understanding a room from a single spherical image, i.e., reconstructing and identifying structural planes forming the ceiling, the floor, and the walls in a room. A spherical image records the light that falls onto a single viewpoint from all directions and does not require correlating geometrical information from multiple images, which facilitates robust and precise reconstruction of the room structure. In our method, we detect line segments from a given image, and classify them into two groups: segments that form the boundaries of the structural planes and those that do not. We formulate this problem as a higher-order energy minimization problem that combines the various measures of likelihood that one, two, or three line segments are part of the boundary. We minimize the energy with graph cuts to identify segments forming boundaries, from which we estimate structural the planes in 3D. Experimental results on synthetic and real images confirm the effectiveness of the proposed method.

AB - We propose a method for understanding a room from a single spherical image, i.e., reconstructing and identifying structural planes forming the ceiling, the floor, and the walls in a room. A spherical image records the light that falls onto a single viewpoint from all directions and does not require correlating geometrical information from multiple images, which facilitates robust and precise reconstruction of the room structure. In our method, we detect line segments from a given image, and classify them into two groups: segments that form the boundaries of the structural planes and those that do not. We formulate this problem as a higher-order energy minimization problem that combines the various measures of likelihood that one, two, or three line segments are part of the boundary. We minimize the energy with graph cuts to identify segments forming boundaries, from which we estimate structural the planes in 3D. Experimental results on synthetic and real images confirm the effectiveness of the proposed method.

UR - http://www.scopus.com/inward/record.url?scp=85019166074&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85019166074&partnerID=8YFLogxK

U2 - 10.1109/ICPR.2016.7899892

DO - 10.1109/ICPR.2016.7899892

M3 - Conference contribution

AN - SCOPUS:85019166074

SP - 1768

EP - 1773

BT - 2016 23rd International Conference on Pattern Recognition, ICPR 2016

PB - Institute of Electrical and Electronics Engineers Inc.

ER -