Anna Shors

Anna Shors is a senior deep learning algorithm engineer at NVIDIA currently focusing on model alignment. She received her M.S. in data science from the Statistics department at Stanford University.
Avatar photo

Posts by Anna Shors

Models / Libraries / Frameworks

Reinforcement Learning with NVIDIA NeMo-RL: Megatron-Core Support for Optimized Training Throughput

The initial release of NVIDIA NeMo-RL included training support through PyTorch DTensor (otherwise known as FSDP2). This backend enables native integration with... 7 MIN READ
Icon image of a chart and search symbol, on a purple background.
Generative AI

Data-Efficient Knowledge Distillation for Supervised Fine-Tuning with NVIDIA NeMo-Aligner

Knowledge distillation is an approach for transferring the knowledge of a much larger teacher model to a smaller student model, ideally yielding a compact,... 5 MIN READ