Kazuki Fujii

Kazuki Fujii graduated with a bachelor's degree in Computer Science from Tokyo Institute of Technology in 2024 and is currently a master's student there (2024 to 2026). Kazuki is responsible for the pretraining and fine-tuning of the Swallow model series, a state-of-the-art multilingual large language model (LLM) specializing in Japanese and English as of December 2023. Kazuki focuses on distributed training and building scalable training systems to enhance the model's performance and infrastructure efficiency.
Avatar photo

Posts by Kazuki Fujii

Generative AI

Developing a 172B LLM with Strong Japanese Capabilities Using NVIDIA Megatron-LM

Generative AI has the ability to create entirely new content that traditional machine learning (ML) methods struggle to produce. In the field of natural... 6 MIN READ