NVIDIA Technical Blog

Recent

See all
Jun 12, 2025

Accelerated Sequence Alignment for Protein Science with MMseqs2-GPU and NVIDIA NIM

Protein sequence alignment—comparing protein sequences for similarities—is fundamental to modern biology and medicine. It illuminates gene functions by...
9 MIN READ
Decorative image.
Jun 12, 2025

Streamlining GPU Porting for EDF's Fluid Dynamics Simulations with NVIDIA Nsight Profilers

Porting existing CPU applications to NVIDIA GPUs can unlock performance gains, enabling users to solve problems at a much greater scale and speed. While the...
6 MIN READ
A decorative image.
Jun 12, 2025

Run High-Performance AI Applications with NVIDIA TensorRT for RTX

NVIDIA TensorRT for RTX is now available for download as an SDK that can be integrated into C++ and Python applications for both Windows and Linux. At...
7 MIN READ
Decorative image.
Jun 12, 2025

NVIDIA Holoscan Sensor Bridge Empowers Developers with Real-Time Data Processing

In the rapidly evolving robotics and edge AI landscape, the ability to efficiently process and transfer sensor data is crucial. Many edge applications are...
9 MIN READ
cuEquivariance expands to accelerate next-gen protein structure models
Jun 11, 2025

Accelerated Molecular Modeling with NVIDIA cuEquivariance and NVIDIA NIM microservices

The emergence of models like AlphaFold2 has skyrocketed the demand for faster inference and training of molecular AI models. The need for speed comes with...
8 MIN READ
Jun 11, 2025

Advancing Literature Review & Target Discovery With NVIDIA Biomedical AI-Q Research Agent Blueprint

Biomedical research and drug discovery have long been constrained by labor-intensive processes. In order to kick-off a drug discovery campaign, researchers...
4 MIN READ
Jun 11, 2025

Develop Custom Physical AI Foundation Models with NVIDIA Cosmos Predict-2

Building smarter robots and autonomous vehicles (AVs) starts with physical AI models that understand real-world dynamics. These models serve two critical roles:...
7 MIN READ
Jun 11, 2025

Introducing NVIDIA DGX Cloud Lepton: A Unified AI Platform Built for Developers

The age of AI-native applications has arrived. Developers are building advanced agentic and physical AI systems—but scaling across geographies and GPU...
6 MIN READ

Inference Performance

See all
Jun 06, 2025

How NVIDIA GB200 NVL72 and NVIDIA Dynamo Boost Inference Performance for MoE Models

The latest wave of open source large language models (LLMs), like DeepSeek R1, Llama 4, and Qwen3, have embraced Mixture of Experts (MoE) architectures. Unlike...
12 MIN READ
May 22, 2025

Blackwell Breaks the 1,000 TPS/User Barrier With Meta’s Llama 4 Maverick

NVIDIA has achieved a world-record large language model (LLM) inference speed. A single NVIDIA DGX B200 node with eight NVIDIA Blackwell GPUs can achieve over...
9 MIN READ
May 21, 2025

NVIDIA Dynamo Accelerates llm-d Community Initiatives for Advancing Large-Scale Distributed Inference

The introduction of the llm-d community at Red Hat Summit 2025 marks a significant step forward in accelerating generative AI inference innovation for the open...
5 MIN READ
Decorative image of a datacenter with floating icons overlaid.
May 06, 2025

LLM Inference Benchmarking Guide: NVIDIA GenAI-Perf and NIM

This is the second post in the LLM Benchmarking series, which shows how to use GenAI-Perf to benchmark the Meta Llama 3 model when deployed with NVIDIA NIM. ...
11 MIN READ
Apr 21, 2025

Optimizing Transformer-Based Diffusion Models for Video Generation with NVIDIA TensorRT

State-of-the-art image diffusion models take tens of seconds to process a single image. This makes video diffusion even more challenging, requiring significant...
8 MIN READ
Apr 02, 2025

NVIDIA Blackwell Delivers Massive Performance Leaps in MLPerf Inference v5.0

The compute demands for large language model (LLM) inference are growing rapidly, fueled by the combination of growing model sizes, real-time latency...
10 MIN READ
Apr 02, 2025

LLM Inference Benchmarking: Fundamental Concepts

This is the first post in the large language model latency-throughput benchmarking series, which aims to instruct developers on common metrics used for LLM...
15 MIN READ
Mar 20, 2025

Boost Llama Model Performance on Microsoft Azure AI Foundry with NVIDIA TensorRT-LLM

Microsoft, in collaboration with NVIDIA, announced transformative performance improvements for the Meta Llama family of models on its Azure AI Foundry platform....
4 MIN READ

Generative AI

See all
Decorative image.
Jun 11, 2025

Simplify LLM Deployment and AI Inference with a Unified NVIDIA NIM Workflow

Integrating large language models (LLMs) into a production environment, where real users interact with them at scale, is the most important part of any AI...
10 MIN READ
Jun 11, 2025

Build Efficient AI Agents Through Model Distillation With the NVIDIA Data Flywheel Blueprint

As enterprise adoption of agentic AI accelerates, teams face a growing challenge of scaling intelligent applications while managing inference costs. Large...
11 MIN READ
Decorative image.
Jun 11, 2025

Scale Realistic Robot Simulation Using the NVIDIA NeMo Agent Toolkit for Physical AI

Physical AI enables autonomous systems—think robots, self-driving cars, and smart spaces—to perceive, understand, and act intelligently in the real world....
10 MIN READ
Jun 11, 2025

Securely Deploy AI Models with NVIDIA NIM

Imagine you’re leading security for a large enterprise and your teams are eager to leverage AI for more and more projects. There’s a problem, though. As...
7 MIN READ
Jun 11, 2025

Advancing Agentic AI with NVIDIA Nemotron Open Reasoning Models

As AI progresses toward greater autonomy, the emergence of AI agents capable of independent decision-making marks a significant milestone. To function...
6 MIN READ
Jun 11, 2025

Accelerating AV Simulation with Neural Reconstruction and World Foundation Models

Autonomous vehicle (AV) stacks are evolving from a hierarchy of discrete building blocks to end-to-end architectures built on foundation models. This transition...
7 MIN READ
Jun 11, 2025

Chat With Your Enterprise Data Through Open-Source AI-Q NVIDIA Blueprint

Enterprise data is exploding—petabytes of emails, reports, Slack messages, and databases pile up faster than anyone can read. Employees are left searching for...
8 MIN READ
Jun 11, 2025

Building Photorealistic Digital Twins With Siemens Teamcenter Digital Reality Viewer

Modern products often consist of millions of parts and require intricate design and collaboration. The industrial world is facing significant challenges in...
4 MIN READ

Data Science

See all
Jun 11, 2025

Accelerate Decision Optimization Using Open Source NVIDIA cuOpt

Businesses make thousands of decisions every day—what to produce, where to ship, how to allocate resources. At scale, optimizing these decisions becomes a...
5 MIN READ
Jun 08, 2025

AI Helps Locate Dangerous Fishing Nets Lost at Sea

Conservationists have launched a new AI tool that can sift through petabytes of underwater imaging from anywhere in the world to identify signs of abandoned or...
4 MIN READ
Picture of moss-covered trees in a forest.
Jun 05, 2025

Supercharge Tree-Based Model Inference with Forest Inference Library in NVIDIA cuML

Tree-ensemble models remain a go-to for tabular data because they're accurate, comparatively inexpensive to train, and fast. But deploying Python inference on...
11 MIN READ
A decorative image.
Jun 04, 2025

Floating-Point 8: An Introduction to Efficient, Lower-Precision AI Training

With the growth of large language models (LLMs), deep learning is advancing both model architecture design and computational efficiency. Mixed precision...
11 MIN READ
Jun 02, 2025

Supercharging Fraud Detection in Financial Services with Graph Neural Networks (Updated)

Note: This blog post was originally published on Oct. 28, 2024, but has been edited to reflect new updates. Fraud in financial services is a massive problem....
10 MIN READ
Illustration of text-to-SQL Inference.
May 30, 2025

Accelerating Text-to-SQL Inference on Vanna with NVIDIA NIM for Faster Analytics

Slow and inefficient query generation from natural language inputs bottlenecks decision-making. This forces analysts and business users to rely heavily on data...
8 MIN READ
An illustration for RAPIDS.
May 29, 2025

RAPIDS Brings Zero-Code-Change Acceleration, IO Performance Gains, and Out-of-Core XGBoost

Over the past two releases, RAPIDS introduced zero-code-change acceleration for Python machine learning, huge IO performance improvements, larger-than-memory...
10 MIN READ
May 22, 2025

Grandmaster Pro Tip: Winning First Place in a Kaggle Competition with Stacking Using cuML

What does it take to win a Kaggle competition in 2025? In the April Playground challenge, the goal was to predict how long users would listen to a podcast—and...
7 MIN READ

Robotics

See all
May 30, 2025

How Robot Brains Dream and Explore Unseen Worlds

NVIDIA Isaac GR00T-Dreams enables developers to generate large-scale synthetic trajectory data from minimal human demonstrations, enabling robots to quickly...
1 MIN READ
May 20, 2025

Bridging the Sim-to-Real Gap for Industrial Robotic Assembly Applications Using NVIDIA Isaac Lab

Assembly of multiple parts plays a critical role across nearly every major industry such as manufacturing, automotive, aerospace, electronics, and medical...
10 MIN READ
May 18, 2025

Designing AI Factories Using OpenUSD and SimReady Assets

Announced at COMPUTEX 2025, the NVIDIA Omniverse Blueprint for AI factory digital twins has expanded to support OpenUSD schemas. The blueprint features new...
4 MIN READ
SIM 5.0 lab graphic.
May 18, 2025

Advanced Sensor Physics, Customization, and Model Benchmarking Coming to NVIDIA Isaac Sim and NVIDIA Isaac Lab

At COMPUTEX 2025, NVIDIA announced new updates to its robotics simulation reference application NVIDIA Isaac Sim, and robot learning framework, NVIDIA Isaac...
10 MIN READ
Comos Reason GIF.
May 18, 2025

Curating Synthetic Datasets to Train Physical AI Models with NVIDIA Cosmos Reason

How can an AI system understand the difference between a plausible accident and a physically impossible event? Or plan a multi-step interaction across humans,...
5 MIN READ
Decorative image.
May 16, 2025

R²D²: Unlocking Robotic Assembly and Contact Rich Manipulation with NVIDIA Research

This edition of NVIDIA Robotics Research and Development Digest (R2D2) explores several contact-rich manipulation workflows for robotic assembly tasks from...
9 MIN READ
image of the paris skyline
May 14, 2025

Get Trained and Certified at GTC Paris at VivaTech 2025

Join us at GTC Paris on June 10th and choose from six full-day, instructor-led workshops.
1 MIN READ
May 12, 2025

Just Released: NVIDIA Warp is Now Open-Source Under Apache 2.0

NVIDIA Warp, a simulation computing framework, is now accessible to all developers.
1 MIN READ

Simulation / Modeling / Design

See all
A GIF showing autonomous vehicles.
Jun 11, 2025

Simplify End-to-End Autonomous Vehicle Development with New NVIDIA Cosmos World Foundation Models

The shift to end-to-end planning models for powering autonomous vehicles (AVs) is increasing the demand for high-quality, physically-based sensor data. These...
7 MIN READ
Jun 10, 2025

Transforming Quantum Education with AI Supercomputing and NVIDIA CUDA-Q Academic

As quantum computers scale, they will integrate with AI supercomputers to tackle some of the world’s most challenging problems. These accelerated quantum...
8 MIN READ
Jun 10, 2025

How Modern Supercomputers Powered by NVIDIA Are Pushing the Limits of Speed — and Science

Modern high-performance computing (HPC) is enabling more than just quick calculations — it’s powering AI systems that are unlocking scientific...
6 MIN READ
Jun 04, 2025

Maximizing OpenMM Molecular Dynamics Throughput with NVIDIA Multi-Process Service

Molecular dynamics (MD) simulations model atomic interactions over time and require significant computational power. However, many simulations have small...
7 MIN READ
May 30, 2025

AI Brings Coral Reefs Into Focus

Researchers have unveiled a new AI model that can transform hard-to-see underwater images into clear, highly accurate 3D scenes. It can help ecologists more...
4 MIN READ
May 23, 2025

AI Transforms Brain MRIs Into Potential Stroke Predictors

Researchers, using AI to analyze routine brain scans, have discovered a promising new method to reliably identify a common but hard-to-detect precursor of many...
3 MIN READ
May 21, 2025

Just Released: NVIDIA HPC SDK v25.5

The new release includes support for CUDA 12.9, updated library components, and performance improvements.
1 MIN READ
May 09, 2025

CUDA C++ Compiler Updates Impacting ELF Visibility and Linkage

In the next CUDA major release, CUDA 13.0, NVIDIA is introducing two significant changes to the NVIDIA CUDA Compiler Driver (NVCC) that will impact ELF...
11 MIN READ

Computer Vision / Video Analytics

See all
A decorative image.
May 23, 2025

Unlock Efficient Data Processing with the Latest from NVIDIA DALI

NVIDIA DALI, a portable, open source software library for decoding and augmenting images, videos, and speech, recently introduced several features that improve...
8 MIN READ
May 18, 2025

Advance Video Analytics AI Agents Using the NVIDIA AI Blueprint for Video Search and Summarization

Vision language models (VLMs) have transformed video analytics by enabling broader perception and richer contextual understanding compared to traditional...
15 MIN READ
May 08, 2025

Revolutionizing Neural Reconstruction and Rendering in gsplat with 3DGUT

Realistic 3D simulation is becoming a cornerstone of modern AI and graphics, from training autonomous vehicles (AV) to powering robotics and digital twins....
5 MIN READ
Apr 24, 2025

Benchmarking Agentic LLM and VLM Reasoning for Gaming with NVIDIA NIM

This is the first post in the LLM Benchmarking series, which shows how to use GenAI-Perf to benchmark the Meta Llama 3 model when deployed with NVIDIA NIM. ...
7 MIN READ
A heatmap animated GIF.
Apr 16, 2025

AI-Generated Heat Maps Keep Seniors and their Privacy Safe

By 2030, more than one in five Americans will be 65 or older, becoming the United States’ largest group of seniors ever. Silicon Valley-based startup Butlr...
4 MIN READ
Apr 11, 2025

AI Advances Parkinson’s Detection Using Standard MRI Scans

A simple brain scan may soon be all that's needed to accurately diagnose Parkinson’s disease, thanks to a new AI-powered tool. The advancement could help...
3 MIN READ
Decorative image of a llama in sunglasses standing on two feet, with a shadow that is flexing it's muscles.
Apr 05, 2025

NVIDIA Accelerates Inference on Meta Llama 4 Scout and Maverick

The newest generation of the popular Llama AI models is here with Llama 4 Scout and Llama 4 Maverick. Accelerated by NVIDIA open-source software, they can...
4 MIN READ
Mar 31, 2025

Simulating Robots in Industrial Facility Digital Twins

Industrial enterprises are embracing physical AI and autonomous systems to transform their operations. This involves deploying heterogeneous robot fleets that...
6 MIN READ

Content Creation / Rendering

See all
Jun 05, 2025

Vortex Delivers CT-Like Ultrasound to Doctors Offices With NVIDIA Jetson

Despite advances in medical imaging, many medical professionals still lack access to diagnostic imaging in their own offices. Vortex Imaging—a medical imaging...
7 MIN READ
Jun 02, 2025

NVIDIA Releases RTX Neural Rendering Tech for Unreal Engine Developers

Artificial intelligence is bridging the gap between game visuals and state-of-the-art CGI in films. It is evolving traditional graphics programming and giving...
5 MIN READ
May 15, 2025

Path Tracing Optimization in Indiana Jones™: Shader Execution Reordering and Live State Reductions

This post is part of the Path Tracing Optimizations in Indiana Jones™ series.   While adding a path-tracing mode to Indiana Jones and the Great Circle™...
13 MIN READ
A still from the game, Indiana Jones and the Great Circle.
May 15, 2025

Path Tracing Optimizations in Indiana Jones™: Opacity MicroMaps and Compaction of Dynamic BLASs

The first post in this series, Path Tracing Optimization in Indiana Jones™: Shader Execution Reordering and Live State Reductions, covered ray-gen shader...
13 MIN READ
Four tiles of city scenes.
May 14, 2025

NVIDIA TensorRT Unlocks FP4 Image Generation  for NVIDIA Blackwell GeForce RTX 50 Series GPUs

The launch of the NVIDIA Blackwell platform ushered in a new era of improvements in generative AI technology. At its forefront is the newly launched GeForce RTX...
11 MIN READ
Apr 24, 2025

Fast Ray Tracing of Dynamic Scenes Using NVIDIA OptiX 9 and NVIDIA RTX Mega Geometry

Real-time ray tracing is a powerful rendering technique that can create incredibly realistic images. NVIDIA OptiX and RTX technology make this possible, even...
9 MIN READ
Apr 23, 2025

Real-Time GPU-Accelerated Gaussian Splatting with NVIDIA DesignWorks Sample vk_gaussian_splatting

Gaussian splatting is a novel approach to rendering complex 3D scenes by representing them as a collection of anisotropic Gaussians in 3D space. This technique...
3 MIN READ
A robot arm carving a sculpture.
Apr 21, 2025

AI Inspires Artists and Industrialists to Reimagine their Crafts

AI has become nearly synonymous with innovation. As it rushes onto the world stage, AI is seeding inspiration in creators and problem-solvers of all...
4 MIN READ

Conversational AI

See all
Jun 04, 2025

NVIDIA Speech AI Models Deliver Industry-Leading Accuracy and Performance

NVIDIA is driving state-of-the-art performance, efficiency, and accessibility in both speech AI and language models, setting the stage for innovations that are...
5 MIN READ
Jun 02, 2025

Scaling to Millions of Tokens with Efficient Long-Context LLM Training

The evolution of large language models (LLMs) has been marked by significant advancements in their ability to process and generate text. Among these...
7 MIN READ
data flywheel diagram
May 27, 2025

Upcoming Webinar: Supercharge Agentic AI with Scalable Data Flywheels

Join our live webinar on June 18 to see how NVIDIA NeMo microservices speed AI agent development.
1 MIN READ
image of jensen avatar
May 23, 2025

An Easy Introduction to LLM Reasoning, AI Agents, and Test Time Scaling

Agents have been the primary drivers of applying large language models (LLMs) to solve complex problems. Since AutoGPT in 2023, various techniques have been...
10 MIN READ
Students sitting around a computer.
May 07, 2025

Concept‑Driven AI Teaching Assistant Guides Students to Deeper Insights

In today's educational landscape, generative AI tools have become both a blessing and a challenge. While these tools offer unprecedented access to information,...
8 MIN READ
Apr 29, 2025

Spotlight: Personal AI Brings AI Receptionists to Small Business Owners with NVIDIA Riva

It's 10 p.m. on a Tuesday when the phone rings at the Sapochnick Law Firm, a specialized law practice in San Diego, California. The caller, a client of the...
6 MIN READ
Apr 22, 2025

NVIDIA GTC Training Labs Now Available On Demand

Missed GTC? This year’s training labs are now available on demand to watch anywhere, anytime.
1 MIN READ
Apr 18, 2025

Upcoming Event: NVIDIA Agent Toolkit Hackathon

Build a high-performance agentic AI system using the open-source NVIDIA Agent Intelligence toolkit — contest runs May 12 to May 23.
1 MIN READ

Edge Computing

See all
Jun 09, 2025

A Fine-tuning–Free Approach for Rapidly Recovering LLM Compression Errors with EoRA

Model compression techniques have been extensively explored to reduce the computational resource demands of serving large language models (LLMs) or other...
9 MIN READ
May 30, 2025

Telcos Across Five Continents Are Building NVIDIA-Powered Sovereign AI Infrastructure

AI is becoming the cornerstone of innovation across industries, driving new levels of creativity and productivity and fundamentally reshaping how we live and...
12 MIN READ
Decorative image.
May 19, 2025

NVIDIA TensorRT for RTX Introduces an Optimized Inference AI Library on Windows 11

AI experiences are rapidly expanding on Windows in creativity, gaming, and productivity apps. There are various frameworks available to accelerate AI inference...
9 MIN READ
ARC-Compact illustration.
May 18, 2025

Deploy AI-RAN at Cell Sites with NVIDIA ARC-Compact 

Wireless networks are the backbone of modern connectivity, serving billions of 5G users through millions of cell sites globally. The opportunities and benefits...
11 MIN READ
Decorative image.
Apr 16, 2025

Efficient Federated Learning in the Era of LLMs with Message Quantization and Streaming

Federated learning (FL) has emerged as a promising approach for training machine learning models across distributed data sources while preserving data privacy....
8 MIN READ
Apr 15, 2025

Event: Data Filtering Challenge for Training Edge Language Models

You’re invited to join the challenge. Develop and apply innovative data filtering techniques to curate datasets that enhance edge LM performance.
1 MIN READ
Decorative image.
Apr 11, 2025

Effortless Federated Learning on Mobile with NVIDIA FLARE and Meta ExecuTorch

NVIDIA and the PyTorch team at Meta announced a groundbreaking collaboration that brings federated learning (FL) capabilities to mobile devices through the...
12 MIN READ
An image of a robot underwater.
Apr 08, 2025

Using AI to Better Understand the Ocean

Humans know more about deep space than we know about Earth’s deepest oceans. But scientists have plans to change that—with the help of AI.  “We have...
3 MIN READ

Data Center / Cloud

See all
Jun 05, 2025

Analyzing Baseboard Management Controllers to Secure Data Center Infrastructure

Modern data centers depend on Baseboard Management Controllers (BMCs) for remote management. These embedded processors enable administrators to reconfigure...
9 MIN READ
Jun 04, 2025

Reproducing NVIDIA MLPerf v5.0 Training Scores for LLM Benchmarks

The previous post, NVIDIA Blackwell Delivers up to 2.6x Higher Performance in MLPerf Training v5.0, explains how the NVIDIA platform delivered the fastest time...
11 MIN READ
Jun 04, 2025

NVIDIA Blackwell Delivers up to 2.6x Higher Performance in MLPerf Training v5.0

The journey to create a state-of-the-art large language model (LLM) begins with a process called pretraining. Pretraining a state-of-the-art model is...
11 MIN READ
Jun 03, 2025

NVIDIA Base Command Manager Offers Free Kickstart for AI Cluster Management

As AI and high-performance computing (HPC) workloads continue to become more common and complex, system administrators and cluster managers are at the heart of...
3 MIN READ
Jun 02, 2025

Advantages of External File Uploads for Scalable, Custom Network Topologies in NVIDIA Air

NVIDIA Air offers the unique ability to simulate anything from a small network to an entire data center. Before you start configuration, routing, or management,...
4 MIN READ
image to announce the collaboration
May 20, 2025

Just Announced: Join the Google Cloud & NVIDIA Developer Community

Master AI with Google Cloud & NVIDIA. Access an exclusive community, resources, and rewards.
1 MIN READ
Three icons, with text LLMs, Optimize, Deploy.
May 20, 2025

NVIDIA Dynamo Adds GPU Autoscaling, Kubernetes Automation, and Networking Optimizations

At NVIDIA GTC 2025, we announced NVIDIA Dynamo, a high-throughput, low-latency open-source inference serving framework for deploying generative AI and reasoning...
7 MIN READ
May 20, 2025

NVIDIA 800 V HVDC Architecture Will Power the Next Generation of AI Factories

The exponential growth of AI workloads is increasing data center power demands. Traditional 54 V in-rack power distribution, designed for kilowatt (KW)-scale...
8 MIN READ