The following steps will guide you through a simple modeling process of a traditional Chinese Vase:
Double click on
3sweep.exe to start the application. The executable is tested on a pure installation of Microsoft Windows 10 with a modern NVIDIA graphics card. The program will automatically choose software OpenGL rendering if hardware acceleration is not possible.
Click to bring up
Select an image file window, please choose
demo/bendVase.png. The system will prompt whether to use existing border file, please click
By default, we are in
Modeling Mode and you can perform 3-Sweep operations directly on the canvas:
Your canvas now looks like this:
Click to bring up constraint window. Now select the two cylinders you have drawn previously by left clicking on them (shift click to add selection), and press to add a
Click to start optimization.
Click to assign texture to select models. The system will ask you whether to remove foreground (this usually takes 8-10 seconds depending on your image size). Choose
Yes to continue. Now you have successfully modeled a textured Chinese Vase. Congratulations! Click to switch to
Viewing Mode and use your right mouse button to rotate the camera around your model:
obj file by first selecting two meshes and going to
Export selected meshes.
In order to use 3-Sweep like a charm, you should learn and use the 4 modes in this software. They are:
Modeling Mode : This is where the 3-Sweep magic happens, select a mesh type from toolbar: and draw on the canvas.
Manipulating Mode: You can translate, scale or rotate your model here.
Viewing Mode: This mode is for moving the camera so that you can view the model in different angles. Click on to restore camera to its original location.
Border Edit Mode: Normally the edge of the image is detected automatically using existing algorithms. You can, however, edit the edge/border of image yourself with the four tools provided.
Besides, you can switch between the 4 display modes of your image:
Normal Picture: In this display mode the input image is displayed on the canvas.
Background Picture: When you run our texturing algorithm with Patch-Match, automatic foreground removal is performed. This mode shows the image without foreground.
(-/Labeled) Border Picture: Edge map of input image, used for boundary snapping during modeling. The latter one (Labeled) assembles similar edges into groups (visualized by different colors) for better modeling performance.
You may want to switch between the appearance of your model (Shaded-Mode / Edge-Only Mode, Smooth / Flat Shading) by clicking on .
Grid switch will display a grid in the origin of the world for visual assistance.
All of our demonstrations are stored in
demo/ folder. We pre-extracted some of the edges for you and the extracted edges are stored in
.tsborder file within the same folder.
When you want to import an image, simply go to
Open Image (or click ) and select your target image file. For better experience please rescale your image so that it is roughly half the size of your monitor screen.
You can change the background picture using
Open background image so that the picture displayed in Background Picture Display Mode can be replaced.
Please refer to the picture below for the 3-Sweep modeling process
You can perform basic translating, scaling and rotating operations in Manipulating Mode. Basic mouse operations include:
Altclick on an existing mesh to set up constraint on the rotating axis. A mesh can rotate around its own main axis by first
Altclick on it and then right click + drag.
Selection is enabled in Modeling Mode, Manipulating Mode and Viewing Mode. However we can not do box selection in Modeling Mode.
When single or multiple meshes are selected, you can go to
Copy/Paste or simply pressing
Ctrl+V to duplicate selected models.
The duplicated model, when translating to a new location, will not automatically re-snap to image boundary. Instead, you should invoke re-snapping by clicking button or pressing
R. Note this action will restore current camera location.
Delete a model by first select the model and then hit the
You can control your camera in Viewing Mode. Basic mouse operations include:
Textures can be applied to selected meshes by pressing button or pressing
If you select
Yes for Patch Match, the foreground in the original picture will be removed and you are brought to Background Picture Display Mode automatically.
You can take snapshots of the current scene by pressing button. This will prompts you a dialog allowing you to choose the saving directory of your snapshot.
If you want to export the meshes for further manipulation in professional software like blender or 3D Max, first select the models and then go to
Export selected meshes to save
mtl file and corresponding texture images will be saved within the same folder.
There are 6 types of geometric constraints provided by this software:
Parallelism: The main axes are parallel to each other.
Orthogonality: The main axes are orthogonal to each other.
Colinear Axis Endpoints: The connection of nearest endpoints and one of the axes are colinear.
Overlapping Axis Endpoints: The nearest endpoints in image space overlap.
Coplanar Axis Endpoints: the endpoints of axes are coplanar and the plane is orthogonal to both axes.
Coplanar Axes: Two axes are coplanar. Note this is the only constraint that will take effects on bended meshes.
You can open the constraint window by clicking to view all the constraints currently added. To add a new constraint, simply select the meshes and clicking on the corresponding button in constraint window. When you want to delete a constraint, simply select that constraint item and hit
When doing optimization, you may want to play with the sliding bar below controlling the balance between changing endpoints positions and changing z coordinates. See our accompanying video for demonstrations of the effects of this parameter.
Press to perform final optimization. Only relevant meshes will be transformed. If the model is assigned a texture before, the texture will be recomputed.
Border Edit Mode allows you to edit current detected edge. When you import an image, a dialog will automatically prompts up asking you what method should be used to extract the edge of image. The quality of edge map will largely influence the modeling performance so please take care of this step.
We provide two basic tools for edge extraction and one extra tool utilizing COB (Convolutional Oriented Boundaries. K.K. Maninis, J. Pont-Tuset, P. Arbeláez, and L. Van Gool. ECCV 2016) edge extraction method:
configurebutton in the GUI, an Grabcut interactive session starts. Press
Hduring the session for detailed introduction.
After importing, you can revoke the edge detection by clicking on the toolbar of Border Edit Mode.
Snapping Pen Tool can be used to draw edge map. Left click to add line segment, right click to end line segment. When right-clicked directly, the pen acts like a 'snapping pen': it will choose the nearest detected boundary from current position of the cursor. Eraser Tool can be used to erase edges; please use
] to control the size of the eraser.
If you want to save the border file for future demonstration, go to
Save border file. A
.tsborder file will be automatically generated by our program.
Settings for advanced preferences. The settings file will be stored within the same folder as the main executable file. 3-Sweep will not check the validation of the defined parameters while loading the settings file so please do not edit it directly.
The meaning of the values in settings are as follows:
COBdetection method requires an external configured server for complicated computation. In order to correctly upload your picture, you need the
Licenseprovided by an administrator. We will soon release the public address and license for demonstration.
gl.txtin the same folder with the program to specify the rendering technique you would like to use. If you are using outdated hardware which does not support OpenGL or are experiencing compatibility issues, please enter
gl.txtto use Mesa as your software-based OpenGL simulator. Otherwise the program will automatically detect suitable hardware as the rendering backend. If you have dual graphics card, please consult your admin on how to switch to the hardware you want.
If you find any problems (bug report, feature requirements, doc requirement, etc.) which is not mentioned above, please send an email to
email@example.com. We will get back to you as soon as possible.