I am a PhD candidate in AI at HKUST, advised by Prof. Qifeng CHEN. I previously obtained my Bachelor’s degree with highest honor from Computer Science program at Hongyi Honor College, Wuhan University (WHU) in China.

I am currently a Research Scientist Intern in Meta working on Large Multimodal Models (LMMs). In 2023 Fall, I visited Prof. Xiaolong Wang’s group at UCSD. Previously, I was a research intern at the International Digital Economy Academy (IDEA) mentored by Dr. Yu LI, working on digital human and motion generation. Before joining HKUST, I was fortunate to work with Prof. Qi DOU, Prof. Junsong YUAN, and Prof. Tomizuka.

🔥 I am looking for global opportunities of Research Scientist internship in Spring 2025 and full-time Research Scientist position in Fall 2025. Please do not hesitate to drop me an email if you are interested!

👨‍🎓 Research Interests

My recent interests include,

  • Multimodal Gen AI & Multimodal Foundation Models
  • Digital Human & Embodied AI

📝 Publications

RSS 2024
sym

Expressive Whole-Body Control for Humanoid Robots
Xuxin Cheng*, Yandong Ji*, Junming Chen, Ruihan Yang, Ge Yang, Xiaolong Wang (* Equal contribution)
RSS 2024 (Acceptance rate: 29%)
Arxiv | Project | Video | Code

CVPR 2024
sym

DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation
Junming Chen, Yunfei Liu, Jianan Wang, Ailing Zeng, Yu Li, Qifeng Chen
CVPR 2024 (Acceptance rate: 23.6%)
Arxiv | Project | Video | Code

WACV 2023
sym

Federated Domain Generalization for Image Recognition via Cross-Client Style Transfer
Junming Chen*, Meirui Jiang*, Qi Dou, Qifeng Chen (* Joint First)
WACV 2023 (First round acceptance rate: 22.23%)
Paper | Supp | Arxiv | Code | Project

ACM MM 2022
sym

Real-time Streaming Video Denoising with Bidirectional Buffers
Chenyang Qi*, Junming Chen*, Xin Yang, Qifeng Chen (* Equal contribution)
ACM Multimedia 2022 (Acceptance rate: 27.9%)
Paper | Arxiv | Code | Project

MIA 2021
sym

Anchor-Guided Online Meta Adaptation for Fast One-Shot Instrument Segmentation from Robotic Surgical Videos
Zixu Zhao, Yueming Jin, Junming Chen, Bo Lu, Chi-Fai Ng, Yun-Hui Liu, Qi Dou, Peng-Ann Heng
Medical Image Analysis 2021
Paper

ISCAS 2020
sym

Dynamic Graph CNN for Event-based Gesture Recognition
Junming Chen, Jingjing Meng, Xinchao Wang, Junsong Yuan
ISCAS 2020
Paper

🧑‍🏫 Teaching

TA for COMP4471 & ELEC4240 Deep Learning in Computer Vision in Fall 2022 at HKUST.
TA for COMP5214 & ELEC5680 Advanced Deep Learning Architectures in Spring 2022 at HKUST.

📖 Services

Reviewer for CVPR, AAAI, ACM Multimedia, and WACV.

🥰 Misc

I have been playing the violin since 8, and I love singing also.
I love table tennis and served on the table tennis team of the CS department at WHU.