Hao Zheng

Hao Zheng is currently a postdoctoral researcher at the Sky Lab, UC Berkeley, working with Professor Ion Stoica. He is currently working on the Alpa project and the Sky project, aiming at democratizing large models like GPT-3.
Hao Zheng

Posts by Hao Zheng

LLM graphic
Conversational AI May 15, 2023

Efficiently Scale LLM Training Across a Large GPU Cluster with Alpa and Ray

Recent years have seen a proliferation of large language models (LLMs) that extend beyond traditional language tasks to generative AI. This includes models like... 16 MIN READ