Xin Dong

Xin Dong is a research scientist at NVIDIA Research and is interested in designing accurate, efficient and trustworthy systems for LLM and foundation models. Xin received PhD in Computer Science from Harvard University in 2023, advised by Professor H.T. Kung.
Avatar photo

Posts by Xin Dong

Generative AI Nov 22, 2024

Hymba Hybrid-Head Architecture Boosts Small Language Model Performance

Transformers, with their attention-based architecture, have become the dominant choice for language models (LMs) due to their strong performance,... 12 MIN READ