I am a PhD candidate in AI at HKUST, advised by Prof. Qifeng CHEN. I previously obtained my Bachelor’s degree with highest honor from Computer Science program at Hongyi Honor College, Wuhan University (WHU) in China.

I am currently a Research Scientist Intern at Meta, working on AI Agents. Previously, in Fall 2024, I was a Research Scientist Intern at Meta, focusing on Multimodal Large Language Models (MLLMs). In Fall 2023, I visited Prof. Xiaolong Wang’s group at UCSD. Before that, I was a Research Intern at the International Digital Economy Academy (IDEA), mentored by Dr. Yu LI, where I worked on digital humans and motion generation. Before joining HKUST, I was fortunate to work with Prof. Qi DOU, Prof. Junsong YUAN, and Prof. Tomizuka.

🔥 I am looking for global opportunities of Research Scientist internship in Spring 2025 and full-time Research Scientist position in Fall 2025. Please do not hesitate to drop me an email if you are interested!

👨‍🎓 Research Interests

My recent interests include,

• Multimodal Gen AI & Multimodal Large Language Model
• Social AI Agents & Digital Human & Embodied AI

📝 Publications

RSS 2024

Expressive Whole-Body Control for Humanoid Robots
Xuxin Cheng^*, Yandong Ji^*, Junming Chen, Ruihan Yang, Ge Yang, Xiaolong Wang (^* Equal contribution)
RSS 2024 (Acceptance rate: 29%)
Arxiv | Project | Video | Code

CVPR 2024

DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation
Junming Chen, Yunfei Liu, Jianan Wang, Ailing Zeng, Yu Li, Qifeng Chen
CVPR 2024 (Acceptance rate: 23.6%)
Arxiv | Project | Video | Code

WACV 2023

Federated Domain Generalization for Image Recognition via Cross-Client Style Transfer
Junming Chen^*, Meirui Jiang^*, Qi Dou, Qifeng Chen (^* Joint First)
WACV 2023 (First round acceptance rate: 22.23%)
Paper | Supp | Arxiv | Code | Project

ACM MM 2022

Real-time Streaming Video Denoising with Bidirectional Buffers
Chenyang Qi^*, Junming Chen^*, Xin Yang, Qifeng Chen (^* Equal contribution)
ACM Multimedia 2022 (Acceptance rate: 27.9%)
Paper | Arxiv | Code | Project

MIA 2021

Anchor-Guided Online Meta Adaptation for Fast One-Shot Instrument Segmentation from Robotic Surgical Videos
Zixu Zhao, Yueming Jin, Junming Chen, Bo Lu, Chi-Fai Ng, Yun-Hui Liu, Qi Dou, Peng-Ann Heng
Medical Image Analysis 2021
Paper

ISCAS 2020

Dynamic Graph CNN for Event-based Gesture Recognition
Junming Chen, Jingjing Meng, Xinchao Wang, Junsong Yuan
ISCAS 2020
Paper

🧑‍🏫 Teaching

TA for COMP4471 & ELEC4240 Deep Learning in Computer Vision in Fall 2022 at HKUST.
TA for COMP5214 & ELEC5680 Advanced Deep Learning Architectures in Spring 2022 at HKUST.

📖 Services

Reviewer for CVPR, AAAI, ACM Multimedia, and WACV.

🥰 Misc

I have been playing the violin since 8, and I love singing also.
I love table tennis and served on the table tennis team of the CS department at WHU.