Posts by Boris Ginsburg
Technical Walkthrough
Dec 10, 2019
Develop Smaller Speech Recognition Models with the NVIDIA NeMo Framework
As computers and other personal devices have become increasingly prevalent, interest in conversational AI has grown due to its multitude of potential...
7 MIN READ
Technical Walkthrough
Dec 05, 2019
Pretraining BERT with Layer-wise Adaptive Learning Rates
Training with larger batches is a straightforward way to scale training of deep neural networks to larger numbers of accelerators and reduce the training time....
10 MIN READ
Technical Walkthrough
Oct 09, 2018
Mixed Precision Training for NLP and Speech Recognition with OpenSeq2Seq
The success of neural networks thus far has been built on bigger datasets, better theoretical models, and reduced training time. Sequential models, in...
11 MIN READ
