Structure Recovery by Part Assembly


Chao-Hui Shen1   Hongbo Fu2   Kang Chen1   Shi-Min Hu1


1TNList, Tsinghua University, Beijing      2City University of Hong Kong




Figure: Given single-view scans by the Kinect system, containing highly noisy and incomplete 3D scans (upper left) and corresponding RGB images (lower left), our approach is able to faithfully recover their underlying structures (yellow) by assembling suitable parts (red) in the repository models (blue).






This paper presents a technique that allows quick conversion of acquired low-quality data from consumer-level scanning devices to high-quality 3D models with labeled semantic parts and meanwhile their assembly reasonably close to the underlying geometry. This is achieved by a novel structure recovery approach that is essentially local to global and bottom up, enabling the creation of new structures by assembling existing labeled parts with respect to the acquired data. We demonstrate that using only a small-scale shape repository, our part assembly approach is able to faithfully recover a variety of high-level structures from only a single-view scan of man-made objects acquired by the Kinect system, containing a highly noisy, incomplete 3D point cloud and a corresponding RGB image.






Structure Recovery by Part Assembly [18M (high resolution)] [2M (low resolution)]

Chao-Hui Shen, Hongbo Fu, Kang Chen, and Shi-Min Hu.

ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2012), 31(6), Article 180.






@article {Shen:2012,
  author = {Shen, Chao-Hui and Fu, Hongbo and Chen, Kang and Hu, Shi-Min},
  title = {Structure Recovery by Part Assembly},
  journal = {ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH Asia 2012},
  year = {2012},
  volume = {31},
  number = {6},
  pages = {180:1-180:11}






The input objects were all captured using the standard Kinect system of Microsoft. Parts borrowed from different repository models are shown in different colors.





Additional Materials


Video [22M]

Supplementary material [6M]   (snapshot of repository models)

Repository models with segmentation [30M]

Kinect raw scans [52M]

Presentation slides [13M]

Another project page maintained by Prof. Hongbo Fu







Last updated on December, 2012. Page maintained by Chao-Hui Shen.