Local AI

Abstract green computing cube with layered panels, performance icons, and streams of data on a black background
Oct 27, 2026

3 Ways to Boost MoE Inference on NVIDIA DGX Spark

Generating tokens faster starts with identifying what limits inference performance. In the batch-size-1 evaluation of Ling-3.0-flash from Inclusion AI on...
8 MIN READ
Oct 22, 2026

Running Frontier-Class AI Models Across 8 NVIDIA DGX Spark Nodes

AI developers aren’t just running a single model anymore—they’re orchestrating multiple models in parallel, chaining inference calls, and experimenting with...
9 MIN READ
Oct 16, 2026

Code, Test, and Deploy on One Machine with NVIDIA RTX Spark

AI agents are changing how software gets built. Developers have gone from writing every line of code by hand to directing agents that write most of the code....
7 MIN READ
Laptop surrounded by application icons and a compact computing device, illustrating local AI applications built with C++ and NVIDIA TensorRT RTX.
Oct 01, 2026

Build Local AI Apps with C++ and NVIDIA TensorRT RTX Samples

Adding AI models to local applications requires a portable model format, a reliable runtime, and acceleration that works across target systems. Do Inference...
3 MIN READ
Sep 03, 2026

NVIDIA PAIR Virtual Inference Router Expands Available Compute on Your Local Network

AI agents are learning to do more by working together. A lead agent can break a complex task into smaller jobs and assign those jobs to specialized subagents....
11 MIN READ
Decorative image.
Jun 12, 2026

Run DiffusionGemma on NVIDIA for Developer-Ready, High-Throughput Text Generation

Developers building real-time AI—such as chat assistants, copilots, and agentic workflows—are often constrained by token-by-token generation speed. This limits...
4 MIN READ
Jun 02, 2026

Build Personal AI Agents on Windows PCs with New Tools from Microsoft and NVIDIA

AI agents are changing how you interact with your PC. Creators, developers, and AI enthusiasts are already using these agents extensively to assist with...
9 MIN READ
May 28, 2026

Run Step 3.7 Flash on NVIDIA GPUs with Enterprise-Ready Multimodal AI

AI applications are moving beyond text generation to multimodal systems that can perceive, search, and reason across images, documents, video, and language in...
3 MIN READ
May 07, 2026

Model Quantization: Post-Training Quantization Using NVIDIA Model Optimizer

This post is the second of a three-part series. See also Model Quantization: Concepts, Methods, and Why It Matters and Model Quantization: Turn FP8 Checkpoints...
8 MIN READ
Apr 30, 2026

How to Build, Run, and Scale High-Quality Creator Workflows in ComfyUI

Creative and visualization teams today produce more assets, in more formats, with leaner teams. Generative AI can accelerate that work – compressing tasks that...
11 MIN READ
Decorative image.
Apr 17, 2026

Build a More Secure, Always-On Local AI Agent with OpenClaw and NVIDIA NemoClaw

Agents are evolving from question-and-answer systems into long-running autonomous assistants that read files, call APIs, and drive multi-step workflows....
11 MIN READ
Apr 02, 2026

Bringing AI Closer to the Edge and On-Device with Gemma 4 

The Gemmaverse expands with the launch of the latest Gemma 4 multimodal and multilingual models, designed to scale across the full spectrum of deployments,...
6 MIN READ
Mar 16, 2026

Run Autonomous, Self-Evolving Agents More Safely with NVIDIA OpenShell

AI has evolved from assistants following your directions to agents that act independently. Called claws, these agents can take a goal, figure out how to...
6 MIN READ
Jan 26, 2026

Adaptive Inference in NVIDIA TensorRT for RTX Enables Automatic Optimization

Deploying AI applications across diverse consumer hardware has traditionally forced a trade-off. You can optimize for specific GPU configurations and achieve...
9 MIN READ
Decorative image.
Jan 05, 2026

Open Source AI Tool Upgrades Speed Up LLM and Diffusion Models on NVIDIA RTX PCs

AI developer activity on PCs is exploding, driven by the rising quality of small language models (SLMs) and diffusion models, such as FLUX.2, GPT-OSS-20B, and...
7 MIN READ
Jan 05, 2026

How to Build a Voice Agent with RAG and Safety Guardrails

Building an agent is more than just “call an API”—it requires stitching together retrieval, speech, safety, and reasoning components so they behave like one...
9 MIN READ