Technical Blog

Learn how you can use NVIDIA Riva to develop a QA system. 5 MIN READ

Today, NVIDIA is releasing TensorRT 8.0, which introduces many transformer optimizations. With this post update, we present the latest TensorRT optimized BERT sample and its inference latency benchmark on A30 GPUs. Using the optimized sample, you can execute different batch sizes for BERT-base or BERT-large within the 10 ms latency budget for conversational AI applications. 18 MIN READ

The RAPIDS CLX team collaborated with the NVIDIA Enterprise Experience (NVEX) team to test and run a proof-of-concept (POC) to evaluate this NLP-based solution. 6 MIN READ

Speech and natural language processing (NLP) have become the foundation for most of the AI development in the enterprise today, as textual data represents a… 12 MIN READ

Conversational AI solutions such as chatbots are now deployed in the data center, on the cloud, and at the edge to deliver lower latency and high quality of… 12 MIN READ

Large language models such as Megatron and GPT-3 are transforming AI. We are excited about applications that can take advantage of these models to create better… 8 MIN READ