I am a PhD candidate in AI at HKUST, advised by Prof. Qifeng CHEN. I previously obtained my Bachelor’s degree with highest honor from Computer Science program at Hongyi Honor College, Wuhan University (WHU) in China.

In 2023 Fall, I visited Prof. Xiaolong Wang’s group at UCSD. Previously, I was a research intern at the International Digital Economy Academy (IDEA) mentored by Dr. Yu LI, working on digital human and motion generation. Before joining HKUST, I was fortunate to work with Prof. Qi DOU, Prof. Junsong YUAN, and Prof. Tomizuka.

🔥 I am looking for global opportunities of Research Scientist internship in Spring 2025 and full-time Research Scientist position in Fall 2025. Please do not hesitate to drop me an email if you are interested!

👨‍🎓 Research Interests

My recent interests include,

• Multimodal Gen AI & Foundation Models (Video/Music/3D/Motion)
• Digital Human / 3D-Vision / NeRF / Gaussian Splatting
• Embodied AI / Artificial General Intelligence (AGI)
• Domain Adaptation & Generalization

📝 Publications

In Submission

Expressive Whole-Body Control for Humanoid Robots
Xuxin Cheng^*, Yandong Ji^*, Junming Chen, Ruihan Yang, Ge Yang, Xiaolong Wang (^* Equal contribution)
In Submission
Arxiv | Project | Video

CVPR 2024

DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation
Junming Chen, Yunfei Liu, Jianan Wang, Ailing Zeng, Yu Li, Qifeng Chen
CVPR 2024
Arxiv | Project | Video | Code

WACV 2023

Federated Domain Generalization for Image Recognition via Cross-Client Style Transfer
Junming Chen^*, Meirui Jiang^*, Qi Dou, Qifeng Chen (^* Joint First)
WACV 2023 (First round acceptance rate: 22.23%)
Paper | Supp | Arxiv | Code | Project

ACM MM 2022

Real-time Streaming Video Denoising with Bidirectional Buffers
Chenyang Qi^*, Junming Chen^*, Xin Yang, Qifeng Chen (^* Equal contribution)
ACM Multimedia 2022 (Acceptance rate: 27.9%)
Paper | Arxiv | Code | Project

MIA 2021

Anchor-Guided Online Meta Adaptation for Fast One-Shot Instrument Segmentation from Robotic Surgical Videos
Zixu Zhao, Yueming Jin, Junming Chen, Bo Lu, Chi-Fai Ng, Yun-Hui Liu, Qi Dou, Peng-Ann Heng
Medical Image Analysis 2021
Paper

ISCAS 2020

Dynamic Graph CNN for Event-based Gesture Recognition
Junming Chen, Jingjing Meng, Xinchao Wang, Junsong Yuan
ISCAS 2020
Paper

🧑‍🏫 Teaching

TA for COMP4471 & ELEC4240 Deep Learning in Computer Vision in Fall 2022 at HKUST.
TA for COMP5214 & ELEC5680 Advanced Deep Learning Architectures in Spring 2022 at HKUST.

📖 Services

Reviewer for CVPR, ACM Multimedia, and WACV.

🥰 Misc

I have been playing the violin since 8, and I love singing also.
I love table tennis and served on the table tennis team of the CS department at WHU.