SN²eRF: A Framework for Neural Radiance Fields given Sparse and Noisy Poses

Hao-Xiang Chen, Jiayi Li, Tai-Jiang Mu*, Shi-Min Hu

IEEE Transactions on Visualization and Computer Graphics (TVCG), DOI: 10.1109/TVCG.2024.3439583, 2024

[doi]   

SLS4D: Sparse Latent Space for 4D Novel View Synthesis

Qi-Yuan Feng, Hao-Xiang Chen, Qun-Ce Xu, Tai-Jiang Mu

IEEE Transactions on Visualization and Computer Graphics (TVCG), DOI: 10.1109/TVCG.2024.3429421, 2024

[arXiv]   

GP-Recon: Online Monocular Neural 3D Reconstruction with Geometric Prior

Zi-Xin Zou, Shi-Sheng Huang, Yan-Pei Cao, Tai-Jiang Mu, Ying Shan, Hongbo Fu, Song-Hai Zhang

IEEE Transactions on Visualization and Computer Graphics (TVCG), DOI: 10.1109/TVCG.2024.3413860, 2024

[arXiv]   

Recovering Complete Actions for Cross-dataset Skeleton Action Recognition

Hanchao Liu, Yujiang Li, Tai-Jiang Mu*, Shi-Min Hu

The Thirty-eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024), vol. 37: 92055-92081

[pdf]   [code]

DIScene: Object Decoupling and Interaction Modeling for Complex Scene Generation

Xiao-Lei Li, Haodong Li, Hao-Xiang Chen, Tai-Jiang Mu*, Shi-Min Hu

Proceedings of the 17th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2024), 101:1-101:12

FragmentDiff: A Diffusion Model for Fractured Object Assembly

Qun-Ce Xu, Hao-Xiang Chen, Jiacheng Hua, Xiaohua Zhan, Yong-Liang Yang, Tai-Jiang Mu*

Proceedings of the 17th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2024), 58:1-58:12

EVSplitting: An Efficient and Visually Consistent Splitting Algorithm for 3D Gaussian Splatting

Qi-Yuan Feng, Geng-Chen Cao, Hao-Xiang Chen, Qun-Ce Xu, Tai-Jiang Mu, Ralph Martin, Shi-Min Hu

Proceedings of the 17th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2024), 35:1-35:11

[arXiv]   

Tuning Vision-Language Models with Multiple Prototypes Clustering

Meng-Hao Guo, Yi Zhang, Tai-Jiang Mu*, Sharon X. Huang, Shi-Min Hu

IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI) 46(12): 11186-11199, 2024

[doi]   

Sketch-2-4D: Sketch driven dynamic 3D scene generation

Guo-Wei Yang, Dong-Yu Chen, Tai-Jiang Mu*

Graphical Models 136: 101231, 2024

[doi]    [video]  

Multi3D: 3D-aware Multimodal Image Synthesis

Wenyang Zhou, Lu Yuan, Taijiang Mu*

Computational Visual Media 10(6): 1205-1217, 2024

[doi]   

Learning Virtual View Selection for 3D Scene Semantic Segmentation

Tai-Jiang Mu, Ming-Yuan Shen, Yu-Kun Lai, Shi-Min Hu

IEEE Transactions on Image Processing (TIP) 33: 4159-4172, 2024

[doi]    [code]

Mesh Neural Networks Based on Dual Graph Pyramids

Xiang-Li Li, Zheng-Ning Liu, Tuo Chen, Tai-Jiang Mu, Ralph R. Martin, Shi-Min Hu

IEEE Transactions on Visualization and Computer Graphics (TVCG) 30(7): 4211-4224, 2024

[doi]   [code]

Programmable Motion Generation for Open-set Motion Control Tasks

Hanchao Liu, Xiaohang Zhan^*, Shaolin Huang, Tai-Jiang Mu^*, Ying Shan

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2024): 1399-1408, Highlight (11.9% of the accepted papers)

[arXiv]   [project]

Theoretically Achieving Continuous Representation of Oriented Bounding Boxes

Zi-Kai Xiao, Guo-Ye Yang, Xue Yang, Tai-Jiang Mu^*, Junchi Yan, Shi-Min Hu

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2024): 16912-16922

[arXiv]   [code]

Semantic-Aware Transformation-Invariant RoI Align

Guo-Ye Yang, Kiyohiro Nakayama, Zi-Kai Xiao, Tai-Jiang Mu^*, Xiaolei Huang, Shi-Min Hu

Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2024) 38(6): 6486-6493

[arXiv]   [code]

Sampling Equivariant Self-attention Networks for Object Detection in Aerial Images

Guo-Ye Yang, Xiang-Li Li, Zi-Kai Xiao, Tai-Jiang Mu^*, Ralph R. Martin, Shi-Min Hu

IEEE Transactions on Image Processing (TIP) 32: 6413-6425, 2023

[arXiv]   [doi]

SPS: Accurate and Real-time Semantic Positioning System Based on Low-cost DEM maps

Jun-Xiong Cai, Wensen Feng, Hao-Xiang Chen, Tai-Jiang Mu^*

IEEE Transactions on Image Processing (TIP) 32: 6401-6412, 2023

[doi]

Skeleton-CutMix: Mixing Up Skeleton with Probabilistic Bone Exchange for Supervised Domain Adaptation

Hanchao Liu, Yuhe Liu, Tai-Jiang Mu^*, Xiaolei Huang, Shi-Min Hu

IEEE Transactions on Image Processing (TIP) 32: 4046-4058, 2023

[doi]

Long Range Pooling for 3D Large-Scale Scene Understanding

Xiang-Li Li, Meng-Hao Guo, Tai-Jiang Mu, Ralph R. Martin, Shi-Min Hu

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2023): 10300-10311

[arXiv]   [CvF openaccess]   [code]

Neural 3D Reconstruction from Sparse Views Using Geometric Priors

Tai-Jiang Mu, Hao-Xiang Chen, Jun-Xiong Cai, Ning Guo

Computational Visual Media 9(4): 687-697, 2023

[pdf]

Beyond Self-attention: External Attention Using Two Linear Layers for Visual Tasks

Meng-Hao Guo, Zheng-Ning Liu, Tai-Jiang Mu, Shi-Min Hu

IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI) 45(5): 5436-5447, 2023 (ESI Highly Cited Paper and Hot Paper)

[arXiv]   [doi]   [code]

SceneViewer: Automating Residential Photography in Virtual Environments

Shao-Kui Zhang, Hou Tam, Yi-Xiao Li, Tai-Jiang Mu, Song-Hai Zhang

IEEE Transactions on Visualization and Computer Graphics (TVCG) 29(12): 5523-5537, 2023

[doi]

Recursive-NeRF: An Efficient and Dynamically Growing NeRF

Guo-Wei Yang, Wen-Yang Zhou, Hao-Yang Peng, Dun Liang, Tai-Jiang Mu, Shi-Min Hu

IEEE Transactions on Visualization and Computer Graphics (TVCG) 29(12): 5124-5136, 2023

[arXiv]   [doi]   [code]

CIRCLE: Convolutional Implicit Reconstruction and Completion for Large-scale Indoor Scene

Hao-Xiang Chen, Jiahui Huang, Tai-Jiang Mu^*, Shi-Min Hu

Proceedings of the European Conference on Computer Vision (ECCV 2022), volume 13692: 506-522

[pdf]   [arXiv]   [code]

Joint Hand and Object Pose Estimation from a Single RGB Image Using High-level 2D Constraints

Hao-Xuan Song, Tai-Jiang Mu^*, Ralph R. Martin

Computer Graphics Forum 41(7): 383-394, 2022

[pdf]

ObjectFusion: Accurate Object-level SLAM with Neural Object Priors

Zi-Xin Zou, Shi-Sheng Huang, Tai-Jiang Mu^*, Yu-Ping Wang

Graphical Models, Volume 123, 101165, 2022

[pdf]

ClusterGNN: Cluster-Based Coarse-to-Fine Graph Neural Network for Efficient Feature Matching

Yan Shi^#, Jun-Xiong Cai^#, Yoli Shavit, Tai-Jiang Mu, Wensen Feng, Kai Zhang

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022): 12517-12526

[arXiv]   [CvF openaccess]

Subdivision-Based Mesh Convolution Networks

Shi-Min Hu, Zheng-Ning Liu, Meng-Hao Guo, Jun-Xiong Cai, Jiahui Huang, Tai-Jiang Tai, Ralph R. Martin

ACM Transactions on Graphics (TOG) 41(3): 25:1-25:16, 2022

[pdf]   [code]

Accurate Dynamic SLAM Using CRF-Based Long-Term Consistency

Zheng-Jun Du, Shi-Sheng Huang, Tai-Jiang Mu^*, Qunhe Zhao, Ralph R. Martin and Kun Xu

IEEE Transactions on Visualization and Computer Graphics (TVCG) 28(4): 1745-1757, 2022

[pdf]   [conference (CVM 2020) version]   [code]   [video]   [supp]

Supervoxel Convolution for Online 3D Semantic Segmentation

Shi-Sheng Huang, Ze-Yu Ma, Tai-Jiang Mu, Hongbo Fu, Shi-Min Hu

ACM Transactions on Graphics (TOG) 40(3): 34:1-34:15, 2021

[pdf]   [code]   [video]   [supp]

PCT: Point Cloud Transformer

Meng-Hao Guo, Jun-Xiong Cai, Zheng-Ning Liu, Tai-Jiang Mu, Ralph R. Martin, Shi-Min Hu

Computational Visual Media 7(2): 187-199, 2021 (ESI Highly Cited Paper and Hot Paper)

[pdf]   [code]

ClusterVO: Clustering Moving Instances and Estimating Visual Odometry for Self and Surroundings

Jia-Hui Huang, Sheng Yang, Tai-Jiang Mu and Shi-Min Hu

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020): 2168-2177

[pdf]   [code]   [video]

Lidar-Monocular Visual Odometry Using Point and Line Features

Shi-Sheng Huang, Ze-Yu Ma, Tai-Jiang Mu, Hongbo Fu and Shi-Min Hu

Proceedings of the International Conference on Robotics and Automation (ICRA 2020): 1091-1097

[pdf]   [video]

S4Net: Single Stage Salient-Instance Segmentation

Ruochen Fan, Ming-Ming Cheng, Qibin Hou, Tai-Jiang Mu, Jingdong Wang and Shi-Min Hu

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019): 6103-6112

[pdf]   [project]

A Response Time Model for Abrupt Changes in Binocular Disparity

Tai-Jiang Mu, Jia-Jia Sun, Ralph R. Martin, and Shi-Min Hu

The Visual Computer 31(5): 675-687, 2015

[pdf]

Stereoscopic Image Completion and Depth Recovery

Tai-Jiang Mu, Ju-Hong Wang, Song-Pei Du, and Shi-Min Hu

The Visual Computer 30(6-8): 833-843, 2014

[pdf]

Surveys & Datasets

A survey of dynamic 3D scene reconstruction

HUANG Jiahui, MU Tai-Jiang^*

JOURNAL OF GRAPHICS, 2023 (Chinese)

[cnki]

A survey of deep learning-based 3D shape generation

Qun-Ce Xu, Tai-Jiang Mu^*, Yong-Liang Yang

Computational Visual Media 9(3): 407-442, 2023

[doi]

Attention mechanisms in computer vision: A survey

Meng-Hao Guo, Tian-Xing Xu, Jiang-Jiang Liu, Zheng-Ning Liu, Peng-Tao Jiang, Tai-Jiang Mu, Song-Hai Zhang, Ralph R. Martin, Ming-Ming Cheng, Shi-Min Hu

Computational Visual Media 8(3): 331-368, 2022 (ESI Highly Cited Paper and Hot Paper)

[doi]   [code]

Lane Detection: A Survey with New Results

Dun Liang, Yuan-Chen Guo, Shaokui Zhang, Tai-Jiang Mu^*, Xiaolei Huang

J. Comput. Sci. Technol. 35(3): 493-505, 2020

[doi]

A new dataset of dog breed images and a benchmark for finegrained classification

Ding-Nan Zou, Song-Hai Zhang, Tai-Jiang Mu, Min Zhang

Computational Visual Media 6(4): 477-487, 2020

[project]   [doi]

A Large Chinese Text Dataset in the Wild

Tai-Ling Yuan, Zhe Zhu, Kun Xu, Cheng-Jun Li, Tai-Jiang Mu^*, Shi-Min Hu

J. Comput. Sci. Technol. 34(3): 509-521, 2019

[project]   [doi]

A survey on multiview video synthesis and editing

Shaoping Lu, Taijiang Mu, Songhai Zhang

Tsinghua Science and Technology 21(6): 678-695, 2016

[doi]