I have been taking part in projects mainly about image/video processing and rendering since 2010. And I also have experience in researches about machine learning, big data and point cloud, etc. Below is an introduction of these projects. Feel free to contact me if you are interested in some of them:-)
Projects in Tsinghua-Tencent Union Lab
I have been working in the Tsinghua-Tencent Union Lab as Technique Support since May 2013. I have taken part in some coorperating projects with Tencent Streetscape research team(National 863 project "Perception Applications of City Streetscape") and WeChat research team.
![]() |
2011.03 -- 2011.09
ShenBiXiaoQ
main developer, researcher C++, JAVA, AS, jsp, Network Prog. Image Retrieval & Systhesis, Big Data ShenBiXiaoQ is an online real-time image retrieval and systhesis system. This system turns user sketches into real images efficiently based on retrieval and synthesis algorithms. This system is available online since Sep.2011 on QQLab and get more than 100,000 PV after two weeks. Here is the video demo and some introductions and news. It has Nginx + Apache(linux server) + C++(win server) + Flash(client) structure and more than 300,000 images' database. I am responsible for the development of front-end Flash client and the backstage C++/JAVA server. Online demo can be found in here. |
![]() |
2013.05 -- 2013.11 E-business Image Retrieval System based on WeChat researcher C++, OpenCV Image retrieval, Big Data In this project we develop a system to retrieve user-captured image of E-busniss goods and return the best matching links. It involves indexing design, image feature design, pre-process of over 300,000 E-busness images. It gains quite high precision and recall rate, and will be integrated into WeChat in the near furture. |
![]() |
2013.05 -- 2014.05
Auto detection and recognition of traffic signs
developer, researcher C++, OpenCV Computer Vision, Machine Learning In this project we develop a system to auto detect and recognize traffic signs from streetscape panorama. We use machine learning method to do the detection. I am responsible for the algorithm and code of the detection part of road names. And the algorithm is used in the pre-process step of tencent streetscape images. |
![]() |
2013.09 -- 2014.03
Real-time image matting system
sole developer, researcher C++, OpenGL, glsl, OpenCV Image Matting, Parallel Computing In this project we develop a system to do image matting interactively in real-time. It involves the parallel implementation of the most advanced matting techniques and the user interface. I am responsible for all the codes. Executable demo can be found here. |
![]() |
2013.11 -- 2014.05 3D reconstruction system researcher C++, PCL, OpenGL, OpenCV 3D/Depth Reconstruction, Rendering In this project we develop a system to do 3D reconstruction from images of the same object from different angles. After obtaining the point cloud, we map the images onto it to get textures, and we can render the object, see it from different views continuously. I am responsible for the used algorithm. |
Paper Projects
![]() |
2009.10 -- 2011.09 [TVCG13] PoseShop: Human Image Database Cons. and Pers. Content Syn. developer C++, OpenCV, OpenGL Image Retrieval & Synthesis, Big Data This project is to build a pose-based hierarchical struture from 300,000 images downloaded from search engines(using clustering methods), and synthesize high-reality images from user specified poses. I am responsible for the development of the hierarchical structure building and UI. [Details] |
![]() |
2010.09 -- 2011.05
[SIGA11] Interactive Hair Rendering and App. Editing under Envi. Lighting
main developer, researcher C++, OpenGL, glsl, OpenCV Rendering This project is to setup an interactive hair rendering framework under environment lighting. It involves setup of rendering context, complex shaders, precomputing tables for itegrals and user interaction. It involves the implementation of deep opacity map and several best hair rendering papers. I am responsible for most of the codes. [Details] |
![]() |
2011.03 -- 2011.06 [C&G12] Efficient Antialiased Edit Propagation for Images and Videos sole developer, main researcher C++, OpenCV Image/Video Editing This project is an implementaion of high-reality, real-time edit propagation methods. It involves the whole editing algorithm and UI. I am responsible for all the codes. |
![]() |
2011.09 -- 2013.02
[TVCG13 Splotlight Paper] Change Blindness Images
main developer, main researcher C++, OpenCV Data analysis, Image Editing This project is to setup experiments to collect the data of change blindness degree from a lot of people, analysis these data using regression and propose the first quantitative metric on this phenomenon. Guided by that, we do image editing. I am responsible for most of the codes. [Details] |
![]() |
2011.10 -- 2012.05 [TOG13] A Prac. Algo. for Rendering Interrefl. with All-frequency BRDFs developer, researcher C++, OpenGL, glsl, Cuda, OpenCV Rendering, Parallel Computing This project is to setup a rendering framework to render interreflection effects supporting dynamic lighting and materials. It involves complex shaders, hierachical scene presentation, and Cuda parallel computing. I am responsible for most the shader codes. [Details] |
![]() |
2012.09 -- 2013.05 [SIGA13] Inverse Image Editing main developer, researcher C++, OpenCV Image Editing This project is to recover editing history from before-and-after image pair using patch-based image editing methods. It involves the implementation of Patch-match, NRDC, alpha matting, image completion and some other best image editing papers. I am responsible for most of the codes and the results. [Details] |
![]() |
2013.03 -- 2013.05 [C&G13] Effcient Manifold Pres. Edit Prop. with Adaptive Neighborhood Size sole developer, main researcher C++, OpenCV Image/Video Editing This project is an implementaion of high-reality, real-time edit propagation methods. It involves the whole editing algorithm and UI. I am responsible for all the codes. |
Other Projects
Apart from the above, I have been envolving in other cooperated projects, some commecial softwares, and furthermore self-interested games and tools since 2010.
![]() |
2010.01 -- 2013.12
JOYHUNTER's Game Collection
sole developer JAVA/C++, Network, Multimedia & Thread Programming In my spare time I have implemented several popular games on my own, including AVGGame, Supperzzle, Diamonds, Bombman, GreedySnack. I do all the work of design, coding and test. They involve coding with various kinds of media, and some of them involve network programming, multithread programming, and animation & rendering techniques. |
![]() |
2012.01 -- 2012.07 Rendering framework on mobiles developer, researcher Android, OpenGLES, glsl Rendering In this project we use glsl to implement some rendering techniques on Android platform, including real-time global illumination, hair rendering, etc. It is a cooporated project, and while the GPU on mobiles become more powerful, the rendering technique of mobile games must be enhanced. I am in charge of the code of rendering framework and complex shaders. |
![]() |
2013.03 -- 2014.03 Image color calibration Apps sole developer & researcher IOS, Objective-C Image Processing, Color Calibration I have developped several commercial IOS Apps to do image color calibration. We place a color disk in the scene and capture them into a single photo, the color of the whole scene is calibrated via the color disk. I am responsible for all the codes and core algorithms. They will be available in the Apple Store in the near future and the development of corresponding Android Apps is ongoing. |
![]() |
2013.04 -- 2014.05
Stereoimage rendering framework
sole developer & researcher C++, OpenGL, glsl, OpenCV Rendering This project is a simple framework to render stereoimage of 3D models. It involves phong shading, multiple render passes, and shaders to do the mixing stuff. Executed demo can be found here(or simple release) and you must wear red-blue glasses to experience the 3D effect. |
![]() |
2013.09 -- 2014.03 Fish-eye video correction researcher C++, OpenCV Image/Video Correction This project is to correct fish-eye panorama videos into videos with normal perspective view in real-time, using currently state-of-the-art correction algorithm. This is a coorperated project, and our code would be integrated into embedded camera systems in the near future. |