Microsoft Trains Turing-NLG, World’s Largest Transformer Language Model

Microsoft recently announced a breakthrough in conversational AI, training the largest transformer-based language generation model, based on over 17 billion parameters, using an NVIDIA DGX-2 system.