Hi, I am a 2nd year undergrad at the University of Washington, Seattle, advised by Prof. Ranjay Krishna, PhD student Jieyu Zhang, and PhD student Zixian Ma at UW CSE RAIVN Lab.

Research Interests: I am interested in applying data-centric and learning-based methods to create generalized and robust foundation models for 2D/3D detection and segmentation, LLM/VLM, embodied AI, image/video editing and generation.

📝 Selected Publications

(* denotes equal contribution)

Preprints

• Generate Any Scene: Evaluating and Improving Text-to-Vision Generation with Scene Graph Programming
  Ziqi Gao*, Weikai Huang*, Jieyu Zhang, Aniruddha Kembhavi, Ranjay Krishna

Peer-reviewed

• ProVision: Programmatically Scaling Vision-centric Instruction Data for Multimodal Language Models
  Jieyu Zhang, Le Xue, Linxin Song, Jun Wang, Weikai Huang, Manli Shu, An Yan, Zixian Ma, Juan Carlos Niebles, Silvio Savarese, Caiming Xiong, Zeyuan Chen, Ranjay Krishna, Ran Xu.
  Blog at Salesforce Research | VentureBeat | MarkTechPost
  SynthData @ ICLR 2025
• Task Me Anything
  Jieyu Zhang, Weikai Huang*, Zixian Ma*, Oscar Michel, Dong He, Tanmay Gupta, Wei-Chiu Ma, Ali Farhadi, Aniruddha Kembhavi, Ranjay Krishna.
  NeurIPS 2024 (Main Conference) | Video-Language Models @ NeurIPS 2024 Oral Presentation
  Blog at Snorkel AI | Talk at Snorkel AI
• m&m’s: A Benchmark to Evaluate Tool-Use for multi-step multi-modal Tasks
  Zixian Ma, Weikai Huang, Jieyu Zhang, Tanmay Gupta, Ranjay Krishna
  ECCV 2024

🎓 Education

• University of Washington
  B.S. in Computer Science, Minor in Applied Mathematics and Statistics
  2023 – 2027 (Expected)

📰 News

• [2024-9] Our work Task Me Anything is accepted to NeurIPS 2024.
• [2024-7] Our work m&m’s: A Benchmark to Evaluate Tool-Use for multi-step multi-modal Tasks is accepted to ECCV 2024.

🏅 Awards

• UW CSE John and JoAnne Wisniewski Endowed Scholarship 2024

📍 Professional Services

• Organizer of Synthetic Data for Computer Vision Workshop @ CVPR 2025. [website]
• Undergrad Organizer of Synthetic Data for Computer Vision Workshop @ CVPR 2024. [website]

📫 Contact

Email: weikaih@cs.washington.edu
Twitter (X): @weikaih04
Instagram: @weikaih04
Linkedin: Weikai Huang
Wechat: hwk18105962347