| layout |
|---|
default |
Emerging applications, such as indoor navigation or facility management, present new requirements of automatic and robust partitioning of indoor 3D point clouds into rooms. Previous research is either based on the Manhattan-world assumption or relies on the availability of the scanner pose information. We address these limitations by following the architectural definition of a room, where the room is an inner free space separated from other spaces through openings or partitions. For this we formulate an anisotropic potential field for 3D environments and illustrate how it can be used for room segmentation in the proposed segmentation pipeline. The experimental results confirm that our method outperforms state-of-the-art methods on a number of datasets including those that violate the Manhattan-world assumption.
- Framework to compute interior free space without assuming knowledge of scanner poses or the Manhattan-world structure of indoor environments.
- 3D formulation of anisotropic PF computation for free space that is robust to the impact of clutter and occlusion and makes no assumptions on the room layout.
For full-text of the paper, see Preprint or IEEE version. For short overview, you can also see A3 poster.
Illustration of rooms as inner free spaces separated by smaller openings. Top: side view of an indoor environment with two rooms separated by a smaller room (corridor). Furniture is shown in brown, several free voxels with potential field (PF) values are also shown. Bottom: top-down view with proposed anisotropic PF maximum values along the vertical voxel stack. For voxels, red corresponds to high PF values and dark blue to low.
Overview of the proposed method
Raw pointcloud of the entire buildings (3 used buildings with XYZ information for each point) can be accessed here.
Results for the dataset violating the Manhattan-world assumption [1]. Top row: Modern, middle row: Cottage, bottom row: Penthouse. Left: reconstruction result of [1], middle: PF map, right: our result.
Fig. 4: Results for the large-scale dataset of [2]. From left to right: ground truth, results of [2], our PF map, our labeling result. Top row: Area 1, middle row: Area 2, bottom row: Area 3. Here with red ellipses we denote erroneously labeled rooms.
Results for the dataset of [3]. From left to right: Office 1, Office 2, Apartment 1, Apartment 2, Apartment 3. Top row: results of [3], middle row: our PF map, bottom row: our labeling result. Red ellipses denote erroneously labeled rooms.
- C. Mura, O. Mattausch, and R. Pajarola, “Piecewise-planar reconstruction of multi-room interiors with arbitrary wall arrangements,” Computer Graphics Forum, vol. 35, no. 7, pp. 179–188, October 2016.
- I. Armeni, O. Sener, A. R. Zamir, H. Jiang, I. Brilakis, M. Fischer, and S. Savarese, “3d semantic parsing of large-scale indoor spaces,” in IEEE Conference on Computer Vision and Pattern Recognition, June 2016, pp. 1534–1543.
- S. Ikehata, H. Yang, and Y. Furukawa, “Structured indoor modeling,” in IEEE International Conference on Computer Vision, December 2015, pp. 1323–1331.
For any questions or inquiries, please contact Dmytro Bobkov at email address below with a subject "Segmentation ICME".
