Tai-Jiang Mu  (穆太江)
Research Associate Professor
 
Graphics and Geometric Computing Group
Department of Computer Science and Technology, BNRist
Tsinghua University

Email: taijiang@tsinghua.edu.cn

Addr.: Rm. 1-1008, Ziqiang Science and Technology Bldg., Tsinghua University, Beijing 100084, China

 

Short Biography


I am a Research Associate Professor in the Department of Computer Science and Technology (DCST), Tsinghua University. I currently work in the Graphics and Geometric Computing Group, which is led by Prof. Prof. Shi-Min Hu, since 2016. I received my bachelor's degree and Ph.D. (advised by Prof. Shi-Min Hu) in Computer Science and Technology from Tsinghua University in 2011 and 2016, respectively. My research interests are in Computer Graphics and Computer Vision, currenlty interested in visual media learning, visual content reconstruction & generation, SLAM & positioning.


Professional Experience


  • 2024.12 - present   DCST, Tsinghua University  Research Associate Professor
  • 2019.01 - 2024.12  DCST, Tsinghua University  Research Assistant Professor
  • 2016.07 - 2019.01  DCST, Tsinghua University  PostDoctor
  • 2011.09 - 2016.07  DCST, Tsinghua University  Ph.D.

  • SERVICES


    Program Committee:

  • CVM 2022-2024
  • CGI 2023
  • CADCG 2023, 2024
  • CAD/Graphics 2023
  • GDC 2022-2024
  • ChinaGraph 2022, 2024
  • Editorial Board:

  • The Visual Computer
  • Visual Computing for Industry, Biomedicine and Art (VCIBA)
  • Journal/Conference Reviewer:

  • IEEE TVCG, IEEE TIP, IEEE TMM, IEEE TRO, Computational Visual Media, The Visual Computer, Graphical Models
  • NeurIPS 2024; CVPR 2024; ISMAR 2023,2024; SIGGRAPH Asia 2023; Pacific Graphics 2023

  • SELECTED PUBLICATIONS


    Full publication list can be found at my Google Scholar or DBLP (#: equal contributions, *: corresponding author).


    [Reseach papers]  [Surveys and Datasets]

     

    Research papers

    Early Access

    Recovering Complete Actions for Cross-dataset Skeleton Action Recognition

    Hanchao Liu, Yujiang Li, Tai-Jiang Mu*, Shi-Min Hu

    The Thirty-eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024), accepted

     

    SN2eRF: A Framework for Neural Radiance Fields given Sparse and Noisy Poses

    Hao-Xiang Chen, Jiayi Li, Tai-Jiang Mu*, Shi-Min Hu

    IEEE Transactions on Visualization and Computer Graphics (TVCG), DOI: 10.1109/TVCG.2024.3439583, 2024

    [doi]   

     

    SLS4D: Sparse Latent Space for 4D Novel View Synthesis

    Qi-Yuan Feng, Hao-Xiang Chen, Qun-Ce Xu, Tai-Jiang Mu

    IEEE Transactions on Visualization and Computer Graphics (TVCG), DOI: 10.1109/TVCG.2024.3429421, 2024

    [arXiv]   

     

    GP-Recon: Online Monocular Neural 3D Reconstruction with Geometric Prior

    Zi-Xin Zou, Shi-Sheng Huang, Yan-Pei Cao, Tai-Jiang Mu, Ying Shan, Hongbo Fu, Song-Hai Zhang

    IEEE Transactions on Visualization and Computer Graphics (TVCG), DOI: 10.1109/TVCG.2024.3413860, 2024

    [arXiv]   

     

    Regular

    2024  2023  2022  2021  2020  befor 2020


    2024

    DIScene: Object Decoupling and Interaction Modeling for Complex Scene Generation

    Xiao-Lei Li, Haodong Li, Hao-Xiang Chen, Tai-Jiang Mu*, Shi-Min Hu

    Proceedings of the 17th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2024), 101:1-101:12

     

    FragmentDiff: A Diffusion Model for Fractured Object Assembly

    Qun-Ce Xu, Hao-Xiang Chen, Jiacheng Hua, Xiaohua Zhan, Yong-Liang Yang, Tai-Jiang Mu*

    Proceedings of the 17th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2024), 58:1-58:12

     

    EVSplitting: An Efficient and Visually Consistent Splitting Algorithm for 3D Gaussian Splatting

    Qi-Yuan Feng, Geng-Chen Cao, Hao-Xiang Chen, Qun-Ce Xu, Tai-Jiang Mu, Ralph Martin, Shi-Min Hu

    Proceedings of the 17th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2024), 35:1-35:11

    [arXiv]   

     

    Tuning Vision-Language Models with Multiple Prototypes Clustering

    Meng-Hao Guo, Yi Zhang, Tai-Jiang Mu*, Sharon X. Huang, Shi-Min Hu

    IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI) 46(12): 11186-11199, 2024

    [doi]   

     

    Sketch-2-4D: Sketch driven dynamic 3D scene generation

    Guo-Wei Yang, Dong-Yu Chen, Tai-Jiang Mu*

    Graphical Models 136: 101231, 2024

    [doi]    [video]  

     

    Multi3D: 3D-aware Multimodal Image Synthesis

    Wenyang Zhou, Lu Yuan, Taijiang Mu*

    Computational Visual Media 10(6): 1205-1217, 2024

    [doi]   

     

    Learning Virtual View Selection for 3D Scene Semantic Segmentation

    Tai-Jiang Mu, Ming-Yuan Shen, Yu-Kun Lai, Shi-Min Hu

    IEEE Transactions on Image Processing (TIP) 33: 4159-4172, 2024

    [doi]    [code]

     

    Mesh Neural Networks Based on Dual Graph Pyramids

    Xiang-Li Li, Zheng-Ning Liu, Tuo Chen, Tai-Jiang Mu, Ralph R. Martin, Shi-Min Hu

    IEEE Transactions on Visualization and Computer Graphics (TVCG) 30(7): 4211-4224, 2024

    [doi]   [code]

     

    Programmable Motion Generation for Open-set Motion Control Tasks

    Hanchao Liu, Xiaohang Zhan*, Shaolin Huang, Tai-Jiang Mu*, Ying Shan

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2024): 1399-1408, Highlight (11.9% of the accepted papers)

    [arXiv]   [project]

     

    Theoretically Achieving Continuous Representation of Oriented Bounding Boxes

    Zi-Kai Xiao, Guo-Ye Yang, Xue Yang, Tai-Jiang Mu*, Junchi Yan, Shi-Min Hu

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2024): 16912-16922

    [arXiv]   [code]

     

    Semantic-Aware Transformation-Invariant RoI Align

    Guo-Ye Yang, Kiyohiro Nakayama, Zi-Kai Xiao, Tai-Jiang Mu*, Xiaolei Huang, Shi-Min Hu

    Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2024) 38(6): 6486-6493

    [arXiv]   [code]

     


    2023

    Sampling Equivariant Self-attention Networks for Object Detection in Aerial Images

    Guo-Ye Yang, Xiang-Li Li, Zi-Kai Xiao, Tai-Jiang Mu*, Ralph R. Martin, Shi-Min Hu

    IEEE Transactions on Image Processing (TIP) 32: 6413-6425, 2023

    [arXiv]   [doi]

     

    SPS: Accurate and Real-time Semantic Positioning System Based on Low-cost DEM maps

    Jun-Xiong Cai, Wensen Feng, Hao-Xiang Chen, Tai-Jiang Mu*

    IEEE Transactions on Image Processing (TIP) 32: 6401-6412, 2023

    [doi]

     

    Skeleton-CutMix: Mixing Up Skeleton with Probabilistic Bone Exchange for Supervised Domain Adaptation

    Hanchao Liu, Yuhe Liu, Tai-Jiang Mu*, Xiaolei Huang, Shi-Min Hu

    IEEE Transactions on Image Processing (TIP) 32: 4046-4058, 2023

    [doi]

     

    Long Range Pooling for 3D Large-Scale Scene Understanding

    Xiang-Li Li, Meng-Hao Guo, Tai-Jiang Mu, Ralph R. Martin, Shi-Min Hu

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2023): 10300-10311

    [arXiv]   [CvF openaccess]   [code]

     

    Neural 3D Reconstruction from Sparse Views Using Geometric Priors

    Tai-Jiang Mu, Hao-Xiang Chen, Jun-Xiong Cai, Ning Guo

    Computational Visual Media 9(4): 687-697, 2023

    [pdf]

     

    Beyond Self-attention: External Attention Using Two Linear Layers for Visual Tasks

    Meng-Hao Guo, Zheng-Ning Liu, Tai-Jiang Mu, Shi-Min Hu

    IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI) 45(5): 5436-5447, 2023 (ESI Highly Cited Paper and Hot Paper)

    [arXiv]   [doi]   [code]

     

    SceneViewer: Automating Residential Photography in Virtual Environments

    Shao-Kui Zhang, Hou Tam, Yi-Xiao Li, Tai-Jiang Mu, Song-Hai Zhang

    IEEE Transactions on Visualization and Computer Graphics (TVCG) 29(12): 5523-5537, 2023

    [doi]

     

    Recursive-NeRF: An Efficient and Dynamically Growing NeRF

    Guo-Wei Yang, Wen-Yang Zhou, Hao-Yang Peng, Dun Liang, Tai-Jiang Mu, Shi-Min Hu

    IEEE Transactions on Visualization and Computer Graphics (TVCG) 29(12): 5124-5136, 2023

    [arXiv]   [doi]   [code]

     


    2022

    CIRCLE: Convolutional Implicit Reconstruction and Completion for Large-scale Indoor Scene

    Hao-Xiang Chen, Jiahui Huang, Tai-Jiang Mu*, Shi-Min Hu

    Proceedings of the European Conference on Computer Vision (ECCV 2022), volume 13692: 506-522

    [pdf]   [arXiv]   [code]

     

    Joint Hand and Object Pose Estimation from a Single RGB Image Using High-level 2D Constraints

    Hao-Xuan Song, Tai-Jiang Mu*, Ralph R. Martin

    Computer Graphics Forum 41(7): 383-394, 2022

    [pdf]

     

    ObjectFusion: Accurate Object-level SLAM with Neural Object Priors

    Zi-Xin Zou, Shi-Sheng Huang, Tai-Jiang Mu*, Yu-Ping Wang

    Graphical Models, Volume 123, 101165, 2022

    [pdf]

     

    ClusterGNN: Cluster-Based Coarse-to-Fine Graph Neural Network for Efficient Feature Matching

    Yan Shi#, Jun-Xiong Cai#, Yoli Shavit, Tai-Jiang Mu, Wensen Feng, Kai Zhang

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022): 12517-12526

    [arXiv]   [CvF openaccess]

     

    Subdivision-Based Mesh Convolution Networks

    Shi-Min Hu, Zheng-Ning Liu, Meng-Hao Guo, Jun-Xiong Cai, Jiahui Huang, Tai-Jiang Tai, Ralph R. Martin

    ACM Transactions on Graphics (TOG) 41(3): 25:1-25:16, 2022

    [pdf]   [code]

     

    Accurate Dynamic SLAM Using CRF-Based Long-Term Consistency

    Zheng-Jun Du, Shi-Sheng Huang, Tai-Jiang Mu*, Qunhe Zhao, Ralph R. Martin and Kun Xu

    IEEE Transactions on Visualization and Computer Graphics (TVCG) 28(4): 1745-1757, 2022

    [pdf]   [conference (CVM 2020) version]   [code]   [video]   [supp]

     


    2021

    Supervoxel Convolution for Online 3D Semantic Segmentation

    Shi-Sheng Huang, Ze-Yu Ma, Tai-Jiang Mu, Hongbo Fu, Shi-Min Hu

    ACM Transactions on Graphics (TOG) 40(3): 34:1-34:15, 2021

    [pdf]   [code]   [video]   [supp]

     

    PCT: Point Cloud Transformer

    Meng-Hao Guo, Jun-Xiong Cai, Zheng-Ning Liu, Tai-Jiang Mu, Ralph R. Martin, Shi-Min Hu

    Computational Visual Media 7(2): 187-199, 2021 (ESI Highly Cited Paper and Hot Paper)

    [pdf]   [code]

     


    2020

    ClusterVO: Clustering Moving Instances and Estimating Visual Odometry for Self and Surroundings

    Jia-Hui Huang, Sheng Yang, Tai-Jiang Mu and Shi-Min Hu

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020): 2168-2177

    [pdf]   [code]   [video]

     

    Lidar-Monocular Visual Odometry Using Point and Line Features

    Shi-Sheng Huang, Ze-Yu Ma, Tai-Jiang Mu, Hongbo Fu and Shi-Min Hu

    Proceedings of the International Conference on Robotics and Automation (ICRA 2020): 1091-1097

    [pdf]   [video]

     


    before 2020

    S4Net: Single Stage Salient-Instance Segmentation

    Ruochen Fan, Ming-Ming Cheng, Qibin Hou, Tai-Jiang Mu, Jingdong Wang and Shi-Min Hu

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019): 6103-6112

    [pdf]   [project]

     

    A Response Time Model for Abrupt Changes in Binocular Disparity

    Tai-Jiang Mu, Jia-Jia Sun, Ralph R. Martin, and Shi-Min Hu

    The Visual Computer 31(5): 675-687, 2015

    [pdf]

     

    Stereoscopic Image Completion and Depth Recovery

    Tai-Jiang Mu, Ju-Hong Wang, Song-Pei Du, and Shi-Min Hu

    The Visual Computer 30(6-8): 833-843, 2014

    [pdf]


    Surveys & Datasets

      [Reseach papers]

    A survey of dynamic 3D scene reconstruction

    HUANG Jiahui, MU Tai-Jiang*

    JOURNAL OF GRAPHICS, 2023 (Chinese)

    [cnki]

     

    A survey of deep learning-based 3D shape generation

    Qun-Ce Xu, Tai-Jiang Mu*, Yong-Liang Yang

    Computational Visual Media 9(3): 407-442, 2023

    [doi]

     

    Attention mechanisms in computer vision: A survey

    Meng-Hao Guo, Tian-Xing Xu, Jiang-Jiang Liu, Zheng-Ning Liu, Peng-Tao Jiang, Tai-Jiang Mu, Song-Hai Zhang, Ralph R. Martin, Ming-Ming Cheng, Shi-Min Hu

    Computational Visual Media 8(3): 331-368, 2022 (ESI Highly Cited Paper and Hot Paper)

    [doi]   [code]

     

    Lane Detection: A Survey with New Results

    Dun Liang, Yuan-Chen Guo, Shaokui Zhang, Tai-Jiang Mu*, Xiaolei Huang

    J. Comput. Sci. Technol. 35(3): 493-505, 2020

    [doi]

     

    A new dataset of dog breed images and a benchmark for finegrained classification

    Ding-Nan Zou, Song-Hai Zhang, Tai-Jiang Mu, Min Zhang

    Computational Visual Media 6(4): 477-487, 2020

    [project]   [doi]

     

    A Large Chinese Text Dataset in the Wild

    Tai-Ling Yuan, Zhe Zhu, Kun Xu, Cheng-Jun Li, Tai-Jiang Mu*, Shi-Min Hu

    J. Comput. Sci. Technol. 34(3): 509-521, 2019

    [project]   [doi]

     

    A survey on multiview video synthesis and editing

    Shaoping Lu, Taijiang Mu, Songhai Zhang

    Tsinghua Science and Technology 21(6): 678-695, 2016

    [doi]


    Locations of visitors to this page