Jiao Dong

Jiao Dong is a software engineer at Anyscale working on open-source distributed machine learning on Ray. Prior to Anyscale, Jiao spent several years in Facebook AI Infra, working on various MLSys problems in production, from distributed feature selection/offline/online training to distributed inference.
Jiao Dong

Posts by Jiao Dong

LLM graphic
Conversational AI May 15, 2023

Efficiently Scale LLM Training Across a Large GPU Cluster with Alpa and Ray

Recent years have seen a proliferation of large language models (LLMs) that extend beyond traditional language tasks to generative AI. This includes models like... 16 MIN READ