Heyuan Yao 姚贺源

I am currently a fourth-year Ph.D. student in the School of Computer Science at Peking University, under the supervision of Assistant Professor Libin Liu. I received my bachelor's degree from Peking University in 2021.

My research interests focus on developing human-like agents for both simulated and real-world environments. My previous work has centered on physics-based character animation, and currently I am exploring vision-language-action (VLA) models.

heyuanyao@pku.edu.cn

Publications

MoConVQ: Unified Physics-Based Motion Control via Scalable Discrete Representations

MoConVQ: Unified Physics-Based Motion Control via Scalable Discrete Representations

Heyuan Yao , Zhenhua Song , Yuyang Zhou , Tenglong Ao , Baoquan Chen , Libin Liu

August 2024 In SIGGRAPH (Journal Track)

ControlVAE: Model-Based Learning of Generative Controllers for Physics-Based Characters

ControlVAE: Model-Based Learning of Generative Controllers for Physics-Based Characters

Heyuan Yao , Zhenhua Song , Baoquan Chen , Libin Liu

December 2022 In SIGGRAPH Asia (Journal Track), selected to Trailer

Gallery

A simple Motion Matching I implemented from scratch.

A simple Motion Matching I implemented from scratch.

IsaacGym version of ControlVAE, finetuned on uneven terrian.

Nevigate ControlVAE in the room.

Visualization of World Model

Visualization of World Model

Let's dance in the simulator!

Let's dance in the simulator!