Posts by Faradawn Yang
Simulation / Modeling / Design
Sep 24, 2026
Efficient MoE Training for Biological Foundation Models
As language models grow, scaling dense architectures becomes increasingly expensive. In a dense transformer, every token passes through every layer, so adding...
7 MIN READ