LLMs

Sep 30, 2026

Tracing Agent Harness Behavior with NVIDIA NeMo Relay

An agent can finish a task and still take an inefficient path. A failed search can trigger another search. A truncated file read can lead to a command fetching...

12 MIN READ

Sep 18, 2026

Benchmarking LLM Inference at Scale with AIPerf

You’re deploying a model on a system. It starts up, prompts are getting responses. Now the hard question: Is this fast? Your instincts might lead you to send...

11 MIN READ

Sep 15, 2026

Dense vs. MoE Models: Active Parameters, Throughput, and When to Choose Each

How can a 30B-parameter model activate only 3B parameters per token, and still use the capacity of the larger model? Nemotron 3.5 Lightning illustrates the...

9 MIN READ

Sep 10, 2026

From Wafer-Out to First Token: Codifying Supply Chain Expertise with Nemotron and Palantir Foundry

NVIDIA has one of the largest and most complex supply chains in the world, and its performance is measured from wafer-out to first token. The interval is in...

12 MIN READ

Sep 04, 2026

Building a Memory-Driven Agent with NVIDIA NemoClaw

Enterprise work spans messages, decisions, projects, and obligations that change over time. An AI agent that starts without this context must reconstruct it...

6 MIN READ

Sep 02, 2026

Co-Designing AI Models Using Speculative Decoding for Faster LLM Inference

This post is the third in a series on AI model co-design. It explores how to accelerate LLM inference while maintaining accuracy using speculative decoding and...

15 MIN READ

Aug 11, 2026

Route AI Agent Workloads Across Models with NVIDIA NeMo Switchyard

Building an AI agent does not end with choosing a single model. Each model has its own strengths, weaknesses, and cost profile, which can shift from one...

12 MIN READ

Jul 27, 2026

Six Agent Harness Capabilities for Higher Model Performance

Building a great AI agent isn’t just about choosing the right models. The harness is the architecture surrounding the model. How it renders context, executes...

10 MIN READ

Jul 26, 2026

NVIDIA Nemotron 3 Ultra Leads Open Models on Accuracy and Efficiency in Agentic RTL Coding

Modern chip design is increasingly limited by engineering time. Register transfer level (RTL) development and verification require specialized hardware...

9 MIN READ

Jul 24, 2026

ModelExpress: Distributing Model Artifacts at the Speed of Light

Every byte moved has a cost. As model checkpoints grow to hundreds of gigabytes or even a terabyte, that cost adds up quickly. To make things even worse,...

12 MIN READ

Jul 10, 2026

AI Model Co-Design: Hardware-Friendly LLM Design

AI performance comes down to three dimensions: Accuracy: How well the model reasons and produces outputs Throughput: How many tokens per second a...

17 MIN READ

Jul 07, 2026

Building an Analysis AI Agent for Industrial Alarm Management with NVIDIA Nemotron

Industrial machinery generates more alarms than technicians can triage. For each important alarm requiring follow-up, the technician pulls historical context,...

11 MIN READ

Jun 09, 2026

Delivering Lifecycle Control for AI Infrastructure at Scale with NVIDIA DGX Spark Enterprise Manageability

As AI infrastructure scales, enterprise expectations for operational maturity are increasing. Organizations expect these systems to be provisionable,...

8 MIN READ

Jun 04, 2026

NVIDIA Nemotron 3 Ultra Powers Faster, More Efficient Reasoning for Long-Running Agents

Single-turn chatbots are evolving into long-running agents that can reason, maintain context, use tools, and run efficiently across many turns to complete...

10 MIN READ

Jun 02, 2026

Build Personal AI Agents on Windows PCs with New Tools from Microsoft and NVIDIA

AI agents are changing how you interact with your PC. Creators, developers, and AI enthusiasts are already using these agents extensively to assist with...

9 MIN READ

Jun 01, 2026

Run Local AI Agents with Faster Models and Multi-Node Clustering on NVIDIA DGX Spark

The rise of autonomous, long-running AI agents has introduced a new class of compute demand, namely tasks that maintain large context windows, spawn concurrent...

8 MIN READ