Litcius/Paper detail

Learning to Reconstruct 3D Non-Cuboid Room Layout from a Single RGB Image

Cheng Yang, Jia Zheng, Xili Dai, Rui Tang, Yi Ma, Xiaojun Yuan

20222022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)19 citationsDOI

Abstract

Single-image room layout reconstruction aims to reconstruct the enclosed 3D structure of a room from a single image. Most previous work relies on the cuboid shape prior. This paper considers a more general indoor assumption, i.e., the room layout consists of a single ceiling, a single floor, and several vertical walls. To this end, we first employ Convolutional Neural Networks to detect planes and vertical lines between adjacent walls. Meanwhile, estimating the 3D parameters for each plane. Then, a simple yet effective geometric reasoning method is adopted to achieve room layout reconstruction. Furthermore, we optimize the 3D plane parameters to reconstruct a geometrically consistent room layout between planes and lines. The experimental results on public datasets validate the effectiveness and efficiency of our method.

Topics & Concepts

CuboidComputer scienceArtificial intelligenceConvolutional neural networkCeiling (cloud)Computer visionRGB color modelPlane (geometry)Computer graphics (images)GeometryEngineeringMathematicsStructural engineeringAdvanced Vision and ImagingRemote Sensing and LiDAR Applications3D Surveying and Cultural Heritage