Deep dive

Sep 17, 2024

Accelerating Oracle Database Generative AI Workloads with NVIDIA NIM and NVIDIA cuVS

The vast majority of the world's data remains untapped, and enterprises are looking to generate value from this data by creating the next wave of generative AI...
6 MIN READ
Decorative image of a robot next to several NVIDIA icons.
Sep 17, 2024

Optimizing Data Center Performance with AI Agents and the OODA Loop Strategy

For any data center, operating large, complex GPU clusters is not for the faint of heart! There is a tremendous amount of complexity. Cooling, power,...
12 MIN READ
Decorative image
Sep 13, 2024

Improved Data Loading with Threads

Data loading is a critical aspect of deep learning workflows, whether you're focused on training or inference. However, it often presents a paradox: the need...
8 MIN READ
Sep 11, 2024

Processing One Billion Rows of Data with RAPIDS cuDF pandas Accelerator Mode

The One Billion Row Challenge is a fun benchmark to showcase basic data processing operations. It was originally launched as a pure-Java competition, and has...
11 MIN READ
Decorative image of light fields in green, purple, and blue.
Sep 11, 2024

Constant Time Launch for Straight-Line CUDA Graphs and Other Performance Enhancements

CUDA Graphs are a way to define and batch GPU operations as a graph rather than a sequence of stream launches. A CUDA Graph groups a set of CUDA kernels and...
8 MIN READ
Decorative image of light fields in green, purple, and blue.
Sep 10, 2024

Accelerating the HPCG Benchmark with NVIDIA Math Sparse Libraries

In the realm of high-performance computing (HPC), NVIDIA has continually advanced HPC by offering its highly optimized NVIDIA High-Performance Conjugate...
9 MIN READ
Illustration showing models and NeMo.
Sep 10, 2024

Post-Training Quantization of LLMs with NVIDIA NeMo and NVIDIA TensorRT Model Optimizer

As large language models (LLMs) are becoming even bigger, it is increasingly important to provide easy-to-use and efficient deployment paths because the cost of...
10 MIN READ
Sep 06, 2024

Enhancing Application Portability and Compatibility across New Platforms Using NVIDIA Magnum IO NVSHMEM 3.0

NVSHMEM is a parallel programming interface that provides efficient and scalable communication for NVIDIA GPU clusters. Part of NVIDIA Magnum IO and based on...
7 MIN READ
Sep 05, 2024

Achieving State-of-the-Art Zero-Shot Waveform Audio Generation across Audio Types

Stunning audio content is an essential component of virtual worlds. Audio generative AI plays a key role in creating this content, and NVIDIA is continuously...
6 MIN READ
Image of an HGX H200
Sep 05, 2024

Low Latency Inference Chapter 1: Up to 1.9x Higher Llama 3.1 Performance with Medusa on NVIDIA HGX H200 with NVLink Switch

As large language models (LLMs) continue to grow in size and complexity, multi-GPU compute is a must-have to deliver the low latency and high throughput that...
5 MIN READ
Sep 03, 2024

Real-Time Neural Receivers Drive AI-RAN Innovation

Today’s 5G New Radio (5G NR) wireless communication systems rely on highly optimized signal processing algorithms to reconstruct transmitted messages from...
11 MIN READ
GIF shows multiple photos and images selected within the photos according to a prompt, such as "person with glasses" or "tallest cat."
Aug 28, 2024

New Foundational Models and Training Capabilities with NVIDIA TAO 5.5

NVIDIA TAO is a framework designed to simplify and accelerate the development and deployment of AI models. It enables you to use pretrained models, fine-tune...
13 MIN READ
Decorative image of a person looking at a laptop with an overlay of the NVIDIA NIM logo.
Aug 28, 2024

Build an Enterprise-Scale Multimodal PDF Data Extraction Pipeline with an NVIDIA NIM Agent Blueprint

Trillions of PDF files are generated every year, each file likely consisting of multiple pages filled with various content types, including text, images,...
8 MIN READ
An illustration depicting AI model deployment steps.
Aug 28, 2024

Deploy Diverse AI Apps with Multi-LoRA Support on RTX AI PCs and Workstations

Today’s large language models (LLMs) achieve unprecedented results across many use cases. Yet, application developers often need to customize and tune these...
10 MIN READ
Workflow diagram on a black backgound.
Aug 27, 2024

Enhancing RAG Applications with NVIDIA NIM

The advent of large language models (LLMs) has significantly benefited the AI industry, offering versatile tools capable of generating human-like text and...
10 MIN READ
10 coreset representation of a 1K dataset with coresets as smaller and larger stars according to weight.
Aug 26, 2024

CUDA-Q Enabled Resource Reduction for Quantum Clustering Algorithms

Quantum computers can use the quantum properties of superposition, entanglement, and interference to generalize learnings and insights from data. Such quantum...
7 MIN READ