Tsinghua University BNRist

Email:

taijiang@tsinghua.edu.cn

Addr.:

Rm. 1-1008, Ziqiang Science and Technology Bldg., Tsinghua University, Beijing 100084, China

 

ABOUT ME


I am an assistant researcher of the Graphics and Geometric Computing Group in the Department of Computer Science and Technology at Tsinghua University, Beijing, P. R. China. I received my bachelor's degree and Ph.D. (advised by Prof. Shi-Min Hu) in Computer Science and Technology from Tsinghua University in 2011 and 2016, respectively.

 

My research interests are in Computer Graphics and Computer Vision. Currently I'm working on:

  • Visual media learning
  • Visual content reconstruction & generation
  • SLAM & positioning

  • SERVICES


    Program Committee:

  • CVM 2022-2024
  • CGI 2023
  • CADCG 2023, 2024
  • CAD/Graphics 2023
  • GDC 2022-2024
  • ChinaGraph 2022, 2024
  • Editorial Board:

  • Visual Computing for Industry, Biomedicine and Art (VCIBA)
  • Journal/Conference Reviewer:

  • IEEE TVCG, IEEE TIP, IEEE TMM, IEEE TRO, Computational Visual Media, The Visual Computer, Graphical Models
  • NeurIPS 2024; CVPR 2024; ISMAR 2023,2024; SIGGRAPH Asia 2023; Pacific Graphics 2023

  • SELECTED PUBLICATIONS


    Full publication list can be found at my Google Scholar or DBLP (#: equal contributions, *: corresponding author).


    [Reseach papers]  [Surveys and Datasets]

     

    Research papers

    Early Access

    Recovering Complete Actions for Cross-dataset Skeleton Action Recognition

    Hanchao Liu, Yujiang Li, Tai-Jiang Mu*, Shi-Min Hu

    The Thirty-eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024), accepted

     

    Tuning Vision-Language Models with Multiple Prototypes Clustering

    Meng-Hao Guo, Yi Zhang, Tai-Jiang Mu*, Sharon X. Huang, Shi-Min Hu

    IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), DOI: 10.1109/TPAMI.2024.3460180, 2024

    [doi]   

     

    DIScene: Object Decoupling and Interaction Modeling for Complex Scene Generation

    Xiao-Lei Li, Haodong Li, Hao-Xiang Chen, Tai-Jiang Mu*, Shi-Min Hu

    Proceedings of the 17th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2024), Accepted

     

    FragmentDiff: A Diffusion Model for Fractured Object Assembly

    Qun-Ce Xu, Hao-Xiang Chen, Jiacheng Hua, Xiaohua Zhan, Yong-Liang Yang, Tai-Jiang Mu*

    Proceedings of the 17th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2024), Accepted

     

    EVSplitting: An Efficient and Visually Consistent Splitting Algorithm for 3D Gaussian Splatting

    Qi-Yuan Feng, Geng-Chen Cao, Hao-Xiang Chen, Qun-Ce Xu, Tai-Jiang Mu, Ralph Martin, Shi-Min Hu

    Proceedings of the 17th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2024), Accepted

    [arXiv]   

     

    SN2eRF: A Framework for Neural Radiance Fields given Sparse and Noisy Poses

    Hao-Xiang Chen, Jiayi Li, Tai-Jiang Mu*, Shi-Min Hu

    IEEE Transactions on Visualization and Computer Graphics (TVCG), DOI: 10.1109/TVCG.2024.3439583, 2024

    [doi]   

     

    SLS4D: Sparse Latent Space for 4D Novel View Synthesis

    Qi-Yuan Feng, Hao-Xiang Chen, Qun-Ce Xu, Tai-Jiang Mu

    IEEE Transactions on Visualization and Computer Graphics (TVCG), DOI: 10.1109/TVCG.2024.3429421, 2024

    [arXiv]   

     

    GP-Recon: Online Monocular Neural 3D Reconstruction with Geometric Prior

    Zi-Xin Zou, Shi-Sheng Huang, Yan-Pei Cao, Tai-Jiang Mu, Ying Shan, Hongbo Fu, Song-Hai Zhang

    IEEE Transactions on Visualization and Computer Graphics (TVCG), DOI: 10.1109/TVCG.2024.3413860, 2024

    [arXiv]   

     

    Multi3D: 3D-aware Multimodal Image Synthesis

    Wenyang Zhou, Lu Yuan, Taijiang Mu*

    Computational Visual Media, DOI: 10.1007/s41095-024-0422-4, 2024

    [doi]   

     

    Regular

    2024  2023  2022  2021  2020  befor 2020


    2024

    Learning Virtual View Selection for 3D Scene Semantic Segmentation

    Tai-Jiang Mu, Ming-Yuan Shen, Yu-Kun Lai, Shi-Min Hu

    IEEE Transactions on Image Processing (TIP) 33: 4159-4172, 2024

    [doi]    [code]

     

    Mesh Neural Networks Based on Dual Graph Pyramids

    Xiang-Li Li, Zheng-Ning Liu, Tuo Chen, Tai-Jiang Mu, Ralph R. Martin, Shi-Min Hu

    IEEE Transactions on Visualization and Computer Graphics (TVCG) 30(7): 4211-4224, 2024

    [doi]   [code]

     

    Programmable Motion Generation for Open-set Motion Control Tasks

    Hanchao Liu, Xiaohang Zhan*, Shaolin Huang, Tai-Jiang Mu*, Ying Shan

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2024): 1399-1408, Highlight (11.9% of the accepted papers)

    [arXiv]   [project]

     

    Theoretically Achieving Continuous Representation of Oriented Bounding Boxes

    Zi-Kai Xiao, Guo-Ye Yang, Xue Yang, Tai-Jiang Mu*, Junchi Yan, Shi-Min Hu

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2024): 16912-16922

    [arXiv]   [code]

     

    Semantic-Aware Transformation-Invariant RoI Align

    Guo-Ye Yang, Kiyohiro Nakayama, Zi-Kai Xiao, Tai-Jiang Mu*, Xiaolei Huang, Shi-Min Hu

    Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2024) 38(6): 6486-6493

    [arXiv]   [code]

     


    2023

    Sampling Equivariant Self-attention Networks for Object Detection in Aerial Images

    Guo-Ye Yang, Xiang-Li Li, Zi-Kai Xiao, Tai-Jiang Mu*, Ralph R. Martin, Shi-Min Hu

    IEEE Transactions on Image Processing (TIP) 32: 6413-6425, 2023

    [arXiv]   [doi]

     

    SPS: Accurate and Real-time Semantic Positioning System Based on Low-cost DEM maps

    Jun-Xiong Cai, Wensen Feng, Hao-Xiang Chen, Tai-Jiang Mu*

    IEEE Transactions on Image Processing (TIP) 32: 6401-6412, 2023

    [doi]

     

    Skeleton-CutMix: Mixing Up Skeleton with Probabilistic Bone Exchange for Supervised Domain Adaptation

    Hanchao Liu, Yuhe Liu, Tai-Jiang Mu*, Xiaolei Huang, Shi-Min Hu

    IEEE Transactions on Image Processing (TIP) 32: 4046-4058, 2023

    [doi]

     

    Long Range Pooling for 3D Large-Scale Scene Understanding

    Xiang-Li Li, Meng-Hao Guo, Tai-Jiang Mu, Ralph R. Martin, Shi-Min Hu

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2023): 10300-10311

    [arXiv]   [CvF openaccess]   [code]

     

    Neural 3D Reconstruction from Sparse Views Using Geometric Priors

    Tai-Jiang Mu, Hao-Xiang Chen, Jun-Xiong Cai, Ning Guo

    Computational Visual Media 9(4): 687-697, 2023

    [pdf]

     

    Beyond Self-attention: External Attention Using Two Linear Layers for Visual Tasks

    Meng-Hao Guo, Zheng-Ning Liu, Tai-Jiang Mu, Shi-Min Hu

    IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI) 45(5): 5436-5447, 2023 (ESI Highly Cited Paper and Hot Paper)

    [arXiv]   [doi]   [code]

     

    SceneViewer: Automating Residential Photography in Virtual Environments

    Shao-Kui Zhang, Hou Tam, Yi-Xiao Li, Tai-Jiang Mu, Song-Hai Zhang

    IEEE Transactions on Visualization and Computer Graphics (TVCG) 29(12): 5523-5537, 2023

    [doi]

     

    Recursive-NeRF: An Efficient and Dynamically Growing NeRF

    Guo-Wei Yang, Wen-Yang Zhou, Hao-Yang Peng, Dun Liang, Tai-Jiang Mu, Shi-Min Hu

    IEEE Transactions on Visualization and Computer Graphics (TVCG) 29(12): 5124-5136, 2023

    [arXiv]   [doi]   [code]

     


    2022

    CIRCLE: Convolutional Implicit Reconstruction and Completion for Large-scale Indoor Scene

    Hao-Xiang Chen, Jiahui Huang, Tai-Jiang Mu*, Shi-Min Hu

    Proceedings of the European Conference on Computer Vision (ECCV 2022), volume 13692: 506-522

    [pdf]   [arXiv]   [code]

     

    Joint Hand and Object Pose Estimation from a Single RGB Image Using High-level 2D Constraints

    Hao-Xuan Song, Tai-Jiang Mu*, Ralph R. Martin

    Computer Graphics Forum 41(7): 383-394, 2022

    [pdf]

     

    ObjectFusion: Accurate Object-level SLAM with Neural Object Priors

    Zi-Xin Zou, Shi-Sheng Huang, Tai-Jiang Mu*, Yu-Ping Wang

    Graphical Models, Volume 123, 101165, 2022

    [pdf]

     

    ClusterGNN: Cluster-Based Coarse-to-Fine Graph Neural Network for Efficient Feature Matching

    Yan Shi#, Jun-Xiong Cai#, Yoli Shavit, Tai-Jiang Mu, Wensen Feng, Kai Zhang

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022): 12517-12526

    [arXiv]   [CvF openaccess]

     

    Subdivision-Based Mesh Convolution Networks

    Shi-Min Hu, Zheng-Ning Liu, Meng-Hao Guo, Jun-Xiong Cai, Jiahui Huang, Tai-Jiang Tai, Ralph R. Martin

    ACM Transactions on Graphics (TOG) 41(3): 25:1-25:16, 2022

    [pdf]   [code]

     

    Accurate Dynamic SLAM Using CRF-Based Long-Term Consistency

    Zheng-Jun Du, Shi-Sheng Huang, Tai-Jiang Mu*, Qunhe Zhao, Ralph R. Martin and Kun Xu

    IEEE Transactions on Visualization and Computer Graphics (TVCG) 28(4): 1745-1757, 2022

    [pdf]   [conference (CVM 2020) version]   [code]   [video]   [supp]

     


    2021

    Supervoxel Convolution for Online 3D Semantic Segmentation

    Shi-Sheng Huang, Ze-Yu Ma, Tai-Jiang Mu, Hongbo Fu, Shi-Min Hu

    ACM Transactions on Graphics (TOG) 40(3): 34:1-34:15, 2021

    [pdf]   [code]   [video]   [supp]

     

    PCT: Point Cloud Transformer

    Meng-Hao Guo, Jun-Xiong Cai, Zheng-Ning Liu, Tai-Jiang Mu, Ralph R. Martin, Shi-Min Hu

    Computational Visual Media 7(2): 187-199, 2021 (ESI Highly Cited Paper and Hot Paper)

    [pdf]   [code]

     


    2020

    ClusterVO: Clustering Moving Instances and Estimating Visual Odometry for Self and Surroundings

    Jia-Hui Huang, Sheng Yang, Tai-Jiang Mu and Shi-Min Hu

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020): 2168-2177

    [pdf]   [code]   [video]

     

    Lidar-Monocular Visual Odometry Using Point and Line Features

    Shi-Sheng Huang, Ze-Yu Ma, Tai-Jiang Mu, Hongbo Fu and Shi-Min Hu

    Proceedings of the International Conference on Robotics and Automation (ICRA 2020): 1091-1097

    [pdf]   [video]

     


    before 2020

    S4Net: Single Stage Salient-Instance Segmentation

    Ruochen Fan, Ming-Ming Cheng, Qibin Hou, Tai-Jiang Mu, Jingdong Wang and Shi-Min Hu

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019): 6103-6112

    [pdf]   [project]

     

    A Response Time Model for Abrupt Changes in Binocular Disparity

    Tai-Jiang Mu, Jia-Jia Sun, Ralph R. Martin, and Shi-Min Hu

    The Visual Computer 31(5): 675-687, 2015

    [pdf]

     

    Stereoscopic Image Completion and Depth Recovery

    Tai-Jiang Mu, Ju-Hong Wang, Song-Pei Du, and Shi-Min Hu

    The Visual Computer 30(6-8): 833-843, 2014

    [pdf]


    Surveys & Datasets

      [Reseach papers]

    A survey of dynamic 3D scene reconstruction

    HUANG Jiahui, MU Tai-Jiang*

    JOURNAL OF GRAPHICS, 2023 (Chinese)

    [cnki]

     

    A survey of deep learning-based 3D shape generation

    Qun-Ce Xu, Tai-Jiang Mu*, Yong-Liang Yang

    Computational Visual Media 9(3): 407-442, 2023

    [doi]

     

    Attention mechanisms in computer vision: A survey

    Meng-Hao Guo, Tian-Xing Xu, Jiang-Jiang Liu, Zheng-Ning Liu, Peng-Tao Jiang, Tai-Jiang Mu, Song-Hai Zhang, Ralph R. Martin, Ming-Ming Cheng, Shi-Min Hu

    Computational Visual Media 8(3): 331-368, 2022 (ESI Highly Cited Paper and Hot Paper)

    [doi]   [code]

     

    Lane Detection: A Survey with New Results

    Dun Liang, Yuan-Chen Guo, Shaokui Zhang, Tai-Jiang Mu*, Xiaolei Huang

    J. Comput. Sci. Technol. 35(3): 493-505, 2020

    [doi]

     

    A new dataset of dog breed images and a benchmark for finegrained classification

    Ding-Nan Zou, Song-Hai Zhang, Tai-Jiang Mu, Min Zhang

    Computational Visual Media 6(4): 477-487, 2020

    [project]   [doi]

     

    A Large Chinese Text Dataset in the Wild

    Tai-Ling Yuan, Zhe Zhu, Kun Xu, Cheng-Jun Li, Tai-Jiang Mu*, Shi-Min Hu

    J. Comput. Sci. Technol. 34(3): 509-521, 2019

    [project]   [doi]

     

    A survey on multiview video synthesis and editing

    Shaoping Lu, Taijiang Mu, Songhai Zhang

    Tsinghua Science and Technology 21(6): 678-695, 2016

    [doi]


    Locations of visitors to this page