Developer Tools & Techniques

Sep 14, 2026

Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine

Mixture of experts (MoE) has become one of the defining architectural trends in large-scale AI model training. DeepSeek, Qwen, and Mixtral are examples of MoE...
12 MIN READ
Sep 10, 2026

How Full-Stack NIM Optimizations Deliver 2.5x More Users on Nemotron 3 Ultra

Deploying a large language model is only the first step toward production-ready serving. Production teams also need to serve as many concurrent users as...
6 MIN READ
Sep 09, 2026

When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving

Encode-prefill-decode (EPD) disaggregation is an inference optimization technique for multimodal models that separates the vision encoder stage from the...
14 MIN READ
Sep 09, 2026

CUDA Toolkit 13.4 Adds Windows on Arm Support and Greater Control over Shared GPUs

Every NVIDIA CUDA Toolkit release adds functionality and performance improvements that help developers get more from NVIDIA GPUs and the broader NVIDIA...
15 MIN READ
Sep 08, 2026

Introducing CUDA Rust: Two Tracks for Writing GPU Kernels

In September 2026, NVIDIA announced it is leaning into native GPU programming in Rust. CUDA C++ and CUDA Python are mature, enterprise-grade toolchains, and...
13 MIN READ
Sep 04, 2026

Building a Memory-Driven Agent with NVIDIA NemoClaw

Enterprise work spans messages, decisions, projects, and obligations that change over time. An AI agent that starts without this context must reconstruct it...
6 MIN READ
Sep 03, 2026

How to Carry User Identity Across Federated Kubernetes and AI Platforms

Modern AI platforms are no longer a single application behind one login screen. A user may start in a central portal, open a governed dataset, launch a...
13 MIN READ
Sep 02, 2026

The Modern CUDA Toolbox in Practice: A Step-by-Step Optimization Walkthrough

NVIDIA CUDA remains the foundation of GPU-accelerated computing, powering everything from scientific simulations to large-scale AI training. But writing...
18 MIN READ
Sep 02, 2026

Co-Designing AI Models Using Speculative Decoding for Faster LLM Inference

This post is the third in a series on AI model co-design. It explores how to accelerate LLM inference while maintaining accuracy using speculative decoding and...
15 MIN READ
A picture of a protein molecule.
Aug 31, 2026

Run NVIDIA BioNeMo NIM Microservices for Protein Structure Prediction in Claude Science

Agentic AI is changing how research is done. AI scientists can read papers, propose hypotheses, call models, and determine which experiments to prioritize...
12 MIN READ
Figure showing the original view and the new view after using NuRec to re-render a video.
Aug 31, 2026

Scale AV Perception Across Vehicle Platforms with NVIDIA Omniverse NuRec

A perception stack is shaped by the vehicle that carries it. Move the same software to a new carline—for example, from an SUV to a sedan or another vehicle...
15 MIN READ
Aug 28, 2026

Deploy an Open Model from Checkpoint to Inference in Two Commands with NVIDIA TensorRT Model Connect

Open AI models are evolving faster than ever, but bringing them into native applications can still require model-specific conversion, preprocessing,...
6 MIN READ
Decorative image.
Aug 26, 2026

Experiment with Qwen3.8-Flash-Next on NVIDIA GB300 NVL72 for Agentic Coding

Alibaba released the model weights for Qwen3.8-Flash-Next as a preview of the upcoming Qwen4 architecture for developers to experiment with and evaluate. It’s...
4 MIN READ
Decorative image.
Aug 25, 2026

Restore LLM Inference Capacity in Seconds with Shadow Engine Recovery in NVIDIA Dynamo

When an LLM engine process fails, the standard recovery path involves a cold restart. This requires loading weights into HBM from storage, compiling kernels,...
13 MIN READ
Aug 25, 2026

CUDA Python 1.0: Stable APIs, One Foundation, Full Platform Access

For years, a Python developer who needed a GPU had two realistic choices: Learn NVIDIA CUDA C++ well enough to write an extension, set up a build toolchain,...
12 MIN READ
Aug 24, 2026

How NVIDIA Groq 3 LPX Unlocks Ultrafast Interactivity at Long Context on NVIDIA Vera Rubin

NVIDIA Groq 3 LPX is the interactive AI inference accelerator for the NVIDIA Vera Rubin platform. At the core of the platform is NVIDIA Vera Rubin NVL72, the...
13 MIN READ