Haiyang Liu

liuhaiyangkmj.iis.u-tokyo.ac.jp

I am a Ph.D. candidate in Information Science and Technology, The University of Tokyo, supervised by Prof. Shunsuke Kamijo, since 2020. I am working on generative model for cross-modal alignment, e.g., motion and audio. I received my M.E. from Waseda University, in 2020, and B.E. from Southeast University, in 2019.

I prefer and respect simple yet effective ideas, e.g., Associative Embedding, Motion Manifolds. I'm open for collaboration in content generation of the digital twins, virtual Youtuber and game NPC, etc.

Research interests

  • Computer Graphic: Character Animation
  • Human Motion Generation
  • Cross-Modal Alignment between Motion and Audio
  • Co-Speech Video Generation

Selected Publications

EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Mask Audio Gesture Modeling

Haiyang Liu* Zihao Zhu* Giorgio Becherini Yichen Peng Mingyang Su You Zhou Xuefei Zhe Naoya Iwamoto Bo Zheng Michael J. Black

Computer Vision and Pattern Recognition (CVPR) 2024

BEAT: A Large Scale Semantic and Emotional Multi Modal Dataset for Conversational Gesture Synthesis

Haiyang Liu Zihao Zhu Naoya Iwamoto Yichen Peng Zhengqing Li You Zhou Elif Bozkurt Bo Zheng

European Conference on Computer Vision (ECCV) 2022

DisCo: Disentangled Implicit Content and Rhythm Learning for Diverse Co-Speech Gesture Synthesis

Haiyang Liu Naoya Iwamoto Zihao Zhu Zhengqing Li You Zhou Elif Bozkurt Bo Zheng

ACM Multimedia (ACMMM) 2022

Intern Experience

Academic Services

  • Reviewer: CVPR, ECCV, SIGGRAPH Asia, ACMMM
  • Talk: TechBeat (Beijing, 2022); Virtual Computing (Kyoto, 2022)