AR / VR

Learn How to Build Transformer-Based Natural Language Processing Applications

AI-Generated Summary

  • The NVIDIA Deep Learning Institute (DLI) offers instructor-led, hands-on training on using Transformer-based natural language processing models for text classification tasks such as categorizing documents.
  • The workshop covers named-entity recognition (NER) tasks and analysis of model features, constraints, and characteristics to help developers determine the best model for a particular use case based on metrics, domain specificity, and available resources.
  • Participants learn how word embeddings have evolved from Word2Vec and recurrent neural network (RNN)-based embeddings to Transformer-based contextualized embeddings, and how Transformer architecture features such as self-attention create language models without RNNs.
  • Training includes using self-supervision to improve the Transformer architecture in BERT, Megatron, and other variants for superior NLP results, leveraging pre-trained models for tasks such as text classification, NER, and question answering, and managing inference challenges to deploy refined models for live applications.

Next Steps

Powered by NVIDIA Nemotron. AI-generated content may summarize information incompletely. Verify important information. Learn more

Deep learning models have gained widespread popularity for natural language processing (NLP) because of their ability to accurately generalize over a range of contexts and languages.

Transformer-based models, such as Bidirectional Encoder Representations from Transformers (BERT), have revolutionized NLP by offering accuracy comparable to human baselines on benchmarks like SQuAD for question-answer, entity recognition, intent recognition, sentiment analysis, and more.

The NVIDIA Deep Learning Institute (DLI) is offering instructor-led, hands-on training on how to use Transformer-based natural language processing models for text classification tasks, such as categorizing documents.

In the course, you’ll also learn how to use Transformer-based models for named-entity recognition (NER) tasks and how to analyze various model features, constraints, and  characteristics. The training will help developers  determine  which  model  is  best  suited  for  a  particular  use  case  based  on  metrics, domain specificity, and available resources.

By participating in this is workshop, you’ll be able to:

  • Understand how word embeddings have rapidly evolved in NLP tasks, from Word2Vec and recurrent neural network (RNN)-based embeddings to Transformer-based contextualized embeddings
  • See how Transformer architecture features, especially self-attention, are used to create language models without RNNs
  • Use self-supervision to improve the Transformer architecture in BERT, Megatron, and other variants for superior NLP results
  • Leverage pre-trained, modern NLP models to solve multiple tasks such as t ext classification, NER, and question answering
  • Manage inference challenges and deploy refined models for live applications

This workshop will be available to the public at the GPU Technology Conference, October 5-9. Spots are limited. Early Bird Rate ends Sept. 25. Register Now.

Learn more about this DLI workshop. See the NVIDIA DLI Remote Instructor-Led training experience in this short video. Visit the NVIDIA DLI homepage for a full list of online and instructor-led training.

Discuss (0)

Tags