Posts by Peter St John
Simulation / Modeling / Design
Sep 24, 2026
Efficient MoE Training for Biological Foundation Models
As language models grow, scaling dense architectures becomes increasingly expensive. In a dense transformer, every token passes through every layer, so adding...
7 MIN READ
Data Science
Nov 05, 2025
Scale Biology Transformer Models with PyTorch and NVIDIA BioNeMo Recipes
Training models with billions or trillions of parameters demands advanced parallel computing. Researchers must decide how to combine parallelism strategies,...
7 MIN READ