Kaifeng Zhao

Kaifeng Zhao - 赵铠枫

I am a fourth-year PhD student in the Computer Vision and Learning Group (VLG) at ETH Zürich, under the supervision of Prof. Siyu Tang. Currently, I am doing an internship at the NVIDIA Spatial Intelligence Lab. Additionally, I have had the pleasure of collaborating with Thabo Beeler. I obtained my Master's degree in Computer Science with distinction from ETH Zürich in 2022, and my Bachelor's degree in Computer Science from Beihang University in 2019.

My research focuses on the intersection of computer vision and computer graphics, particularly in human motion modeling and the synthesis of human-scene interaction behaviors. My doctoral research is supported by the Swiss Data Science Center (SDSC) PhD fellowship.

Email / Google Scholar / Twitter / LinkedIn / Github

Publications

DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Control
Kaifeng Zhao, Gen Li, Siyu Tang
ICLR 2025, Spotlight

Project page

Code

arXiv

@inproceedings{Zhao:DartControl:2025,
  title = {{DartControl}: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Control},
  author = {Zhao, Kaifeng and Li, Gen and Tang, Siyu},
  booktitle = {The Thirteenth International Conference on Learning Representations (ICLR)},
  year = {2025}
}

DartControl achieves high-quality and efficient ( > 300 frames per second ) motion generation conditioned on online streams of text prompts. Furthermore, by integrating latent space optimization and reinforcement learning-based controls, DartControl enables various motion generation applications with spatial constraints and goals, including motion in-between, waypoint goal reaching, and human-scene interaction generation.

VolumetricSMPL: A Neural Volumetric Body Model for Efficient Interactions, Contacts, and Collisions
Marko Mihajlovic, Siwei Zhang, Gen Li, Kaifeng Zhao, Lea Müller, Siyu Tang
ICCV 2025, Highlight

Project page

Code

arXiv

@inproceedings{ICCV25:VolumetricSMPL,
  title={{VolumetricSMPL}: A Neural Volumetric Body Model for Efficient Interactions, Contacts, and Collisions},
  author={Mihajlovic, Marko and Zhang, Siwei and Li, Gen and Zhao, Kaifeng and M{\"u}ller, Lea and Tang, Siyu},
  booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
  year={2025}
}

VolumetricSMPL is a lightweight extension that adds volumetric capabilities to SMPL(-X) models for efficient 3D interactions and collision detection.

EgoM2P: Egocentric Multimodal Multitask Pretraining
Gen Li, Yutong Chen^*, Yiqian Wu^*, Kaifeng Zhao^*, Marc Pollefeys, Siyu Tang
ICCV 2025

Project page

Code

arXiv

@article{li2025egom2p,
  title={EgoM2P: Egocentric Multimodal Multitask Pretraining},
  author={Li, Gen and Chen, Yutong and Wu, Yiqian and Zhao, Kaifeng and Pollefeys, Marc and Tang, Siyu},
  journal={arXiv preprint arXiv:2506.07886},
  year={2025}
}

EgoM2P: A large-scale egocentric multimodal and multitask model, pretrained on eight extensive egocentric datasets.

EgoGen: An Egocentric Synthetic Data Generator
Gen Li, Kaifeng Zhao, Siwei Zhang, Xiaozhong Lyu, Mihai Dusmanu, Yan Zhang, Marc Pollefeys, Siyu Tang
CVPR 2024, Oral Presentation

Project page

Code

arXiv

@inproceedings{li2024egogen,
  title={{EgoGen}: An Egocentric Synthetic Data Generator},
  author={Li, Gen and Zhao, Kaifeng and Zhang, Siwei and Lyu, Xiaozhong and Dusmanu, Mihai and Zhang, Yan and Pollefeys, Marc and Tang, Siyu},
  booktitle={CVPR},
  year={2024}
}

EgoGen is new synthetic data generator that can produce accurate and rich ground-truth training data for egocentric perception tasks.

DIMOS: Synthesizing Diverse Human Motions in 3D Indoor Scenes
Kaifeng Zhao, Yan Zhang, Shaofei Wang, Thabo Beeler, Siyu Tang
ICCV 2023

Project page

Code

arXiv

@inproceedings{Zhao:ICCV:2023,
  title = {{DIMOS}: Synthesizing Diverse Human Motions in 3D Indoor Scenes},
  author = {Zhao, Kaifeng and Zhang, Yan and Wang, Shaofei and Beeler, Thabo and Tang, Siyu},
  booktitle = {International conference on computer vision (ICCV)},
  year = {2023}
}

In this work, we propose a method to generate a sequence of natural human-scene interaction events in real-world complex scenes as illustrated in this figure. The human first walks to sit on a stool (yellow to red), then walk to another chair to sit down (red to magenta), and finally walk to and lie on the sofa (magenta to blue).

COINS: Compositional Human-Scene Interaction Synthesis with Semantic Control
Kaifeng Zhao, Shaofei Wang, Yan Zhang, Thabo Beeler, Siyu Tang
ECCV 2022

Project page

Code

arXiv

@inproceedings{Zhao:ECCV:2022,
  title = {{COINS}: Compositional Human-Scene Interaction Synthesis with Semantic Control},
  author = {Zhao, Kaifeng and Wang, Shaofei and Zhang, Yan and Beeler, Thabo and Tang, Siyu},
  booktitle = {European conference on computer vision (ECCV)},
  year = {2022}
}

We propose COINS, for COmpositional INteraction Synthesis with Semantic Control. Given a pair of action and object instance as the semantic specification, our method generates virtual humans naturally interacting with the scene objects.

Academic Service

Reviewer for ICCV, CVPR, ECCV, 3DV, NeurIPS, SIGGRAPH Asia, ICLR, TPAMI.

Teaching

Head Teaching Assistant, 263-5806-00L Digital Humans, ETH Zürich Spring 2024
Head Teaching Assistant, 263-5902-00L Computer Vision, ETH Zürich Fall 2023, Fall 2024
Teaching Assistant, 263-5806-00L Digital Humans, ETH Zürich Spring 2023
Teaching Assistant, 401-0131-00L Linear Algebra, ETH Zürich Fall 2022

Template adapted from Siwei Zhang's website.