Tutorial

Jun 17, 2025

R²D²: Building AI-based 3D Robot Perception and Mapping with NVIDIA Research

Robots must perceive and interpret their 3D environments to act safely and effectively. This is especially critical for tasks such as autonomous navigation,...
14 MIN READ
Decorative image.
Jun 13, 2025

Run High-Performance LLM Inference Kernels from NVIDIA Using FlashInfer​​

Best-in-class LLM Inference requires two key elements: speed and developer velocity. Speed refers to maximizing the efficiency of the underlying hardware by...
6 MIN READ
Jun 11, 2025

Accelerate Decision Optimization Using Open Source NVIDIA cuOpt

Businesses make thousands of decisions every day—what to produce, where to ship, how to allocate resources. At scale, optimizing these decisions becomes a...
5 MIN READ
Decorative image.
Jun 11, 2025

Simplify LLM Deployment and AI Inference with a Unified NVIDIA NIM Workflow

Integrating large language models (LLMs) into a production environment, where real users interact with them at scale, is the most important part of any AI...
10 MIN READ
Jun 04, 2025

Maximizing OpenMM Molecular Dynamics Throughput with NVIDIA Multi-Process Service

Molecular dynamics (MD) simulations model atomic interactions over time and require significant computational power. However, many simulations have small...
7 MIN READ
Jun 02, 2025

Supercharging Fraud Detection in Financial Services with Graph Neural Networks (Updated)

Note: This blog post was originally published on Oct. 28, 2024, but has been edited to reflect new updates. Fraud in financial services is a massive problem....
10 MIN READ
Illustration of text-to-SQL Inference.
May 30, 2025

Accelerating Text-to-SQL Inference on Vanna with NVIDIA NIM for Faster Analytics

Slow and inefficient query generation from natural language inputs bottlenecks decision-making. This forces analysts and business users to rely heavily on data...
8 MIN READ
May 27, 2025

Advanced Optimization Strategies for LLM Training on NVIDIA Grace Hopper

In the previous post, Profiling LLM Training Workflows on NVIDIA Grace Hopper, we explored the importance of profiling large language model (LLM) training...
10 MIN READ
May 27, 2025

Profiling LLM Training Workflows on NVIDIA Grace Hopper

The rapid advancements in AI have resulted in an era of exponential growth in model sizes, particularly in the domain of large language models (LLMs). These...
12 MIN READ
A decorative image.
May 23, 2025

Unlock Efficient Data Processing with the Latest from NVIDIA DALI

NVIDIA DALI, a portable, open source software library for decoding and augmenting images, videos, and speech, recently introduced several features that improve...
8 MIN READ
An illustration representing NeMo Guardrails.
May 23, 2025

Stream Smarter and Safer: Learn how NVIDIA NeMo Guardrails Enhance LLM Output Streaming

​​LLM Streaming sends a model's response incrementally in real time, token by token, as it's being generated. The output streaming capability has evolved...
8 MIN READ
An image of NYC taxis.
May 15, 2025

Simplify Setup and Boost Data Science in the Cloud using NVIDIA CUDA-X and Coiled

Imagine analyzing millions of NYC ride-share journeys—tracking patterns across boroughs, comparing service pricing, or identifying profitable pickup...
10 MIN READ
A still from the game, Indiana Jones and the Great Circle.
May 15, 2025

Path Tracing Optimizations in Indiana Jones™: Opacity MicroMaps and Compaction of Dynamic BLASs

The first post in this series, Path Tracing Optimization in Indiana Jones™: Shader Execution Reordering and Live State Reductions, covered ray-gen shader...
13 MIN READ
A drawing of a person holding a phone, with a callout of the phone screen and chat bubbles.
May 15, 2025

Accelerating Embedding Lookups with cuEmbed

NVIDIA recently released cuEmbed, a high-performance, header-only CUDA library that accelerates embedding lookups on NVIDIA GPUs. If you're building...
8 MIN READ
Four tiles of city scenes.
May 14, 2025

NVIDIA TensorRT Unlocks FP4 Image Generation  for NVIDIA Blackwell GeForce RTX 50 Series GPUs

The launch of the NVIDIA Blackwell platform ushered in a new era of improvements in generative AI technology. At its forefront is the newly launched GeForce RTX...
11 MIN READ
May 12, 2025

Accelerated AI Inference with NVIDIA NIM on Azure AI Foundry

The integration of NVIDIA NIM microservices into Azure AI Foundry marks a major leap forward in enterprise AI development. By combining NIM microservices with...
8 MIN READ