Sketch2Scene: Sketch-based Co-retrieval and Co-placement of 3D Models

Kun Xu1, Kang Chen1, Hongbo Fu2, Wei-Lun Sun1, Shi-Min Hu1
1Tsinghua University
2City University of Hong Kong

Abstract: This work presents Sketch2Scene, a framework that automatically turns a freehand sketch drawing inferring multiple scene objects to semantically valid, well arranged scenes of 3D models. Unlike the existing works on sketch-based search and composition of 3D models, which typically process individual sketched objects one by one, our technique performs co-retrieval and co-placement of 3D relevant models by jointly processing the sketched objects. This is enabled by summarizing functional and spatial relationships among models in a large collection of 3D scenes as structural groups. Our technique greatly reduces the amount of user intervention needed for sketch-based modeling of 3D scenes and fits well into the traditional production pipeline involving concept design followed by 3D modeling. A pilot study indicates that it is promising to use our technique as an alternative but more efficient tool of standard 3D modeling for 3D scene construction.

Paper: [PDF 6.1M].
Presentation: [PPTX 33.0M]
Supplemental Document: [PDF 4.4M].
Supplemental Video: [AVI 12.5M].

Bibtex: @article{Xu13sig,
author = {Kun Xu and Kang Chen and Hongbo Fu and Wei-Lun Sun and Shi-Min Hu},
title = {Sketch2Scene: Sketch-based Co-retrieval and Co-placement of 3D Models},
journal = {ACM Transactions on Graphics},
volume = {32},
number = {4},
year = {2013},
pages = {123:1--123:12},