|
(Paul) Xin Zhou I have 10 years of experience developing AI algorithms and applying generative AI in products. I have both worked hands-on and led technical teams at Google and Baidu USA. My current interest are agents for video creation (data and methods), improving video generation quality and efficiency. I did my PhD in Mathematics at University of Michigan, where I was advised by Robert Lazarsfeld.Email / CV / Google Scholar / Cover Letter / LinkedIn |
|
Research |
|
Kubrick: Multimodal Agent Collaborations for Video Generation
He Liu, Xin Zhou project page / paper (coming soon) We develop multimodal collaborative agents to generate physically realistic videos, given a few prompt words and possibly assets. |
|
Retrieving Conditions from Reference Images for Diffusion Models
Haoran Tang, Xin Zhou, Jieren Deng, Zhihong Pan, Hao Tian, Pratik Chaudhari project page / paper Instantaneous generation of same identity faces with better style controls and diversity. |
|
Video understanding and Soccernet
project page Handling and understanding large amounts of video data |
|
GBSD: Generative Bokeh with Stage Diffusion
Jieren Deng, Xin Zhou, Hao Tian, Zhihong Pan, Derek Aguiar project page / paper Discovering the ability to generate bokeh with time varying prompts |
Ongoing |
|
Automatic generation defects assesment through VLM
project page / paper (coming soon) Automatic generation pipelines need better control. Existing score models are vague and cannot find detailed defects. |
|
Enhancing image generation quality through semantic VAE losses
project page / paper (coming soon) VAE become major bottlenecks of generation quality for structures such as faces and hands especially when the resolution is small. |
|
Accelerating structure controlled image generation through shape texture separation
project page / paper (coming soon) In many applications, structures of generated images can be given (avatars, videos). Leveraging this condition, can one accelerate the generation process |
Advised Team Members (Partial list) |
|||
| Liu He | Haoran Tang | Jieren Deng | |
| Yuanming Li | Yansong Gao | Zhiyuan Ren | |
| Bo He | |||