Hardware / Semiconductor

Sep 15, 2026

How NVIDIA NVLink 6 Delivers Multi-Layer Resiliency for AI Factories

For operators of large-scale AI factories, maximizing continuous output is essential for productivity. In massive-scale AI training, every GPU in the cluster...
12 MIN READ
Sep 14, 2026

Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine

Mixture of experts (MoE) has become one of the defining architectural trends in large-scale AI model training. DeepSeek, Qwen, and Mixtral are examples of MoE...
12 MIN READ
Sep 02, 2026

Co-Designing AI Models Using Speculative Decoding for Faster LLM Inference

This post is the third in a series on AI model co-design. It explores how to accelerate LLM inference while maintaining accuracy using speculative decoding and...
15 MIN READ
Decorative image.
Aug 26, 2026

NVIDIA NVLink Fusion Brings NVHBM to Next-Generation AI Infrastructure

AI factories must support increasingly large models and more complex reasoning workloads. To keep up with the insatiable compute demands of AI workloads,...
7 MIN READ
Decorative image.
Aug 25, 2026

Restore LLM Inference Capacity in Seconds with Shadow Engine Recovery in NVIDIA Dynamo

When an LLM engine process fails, the standard recovery path involves a cold restart. This requires loading weights into HBM from storage, compiling kernels,...
13 MIN READ
Aug 24, 2026

NVIDIA Vera Rubin and Blackwell Set a New Standard for Agentic AI Performance per Watt 

AI agents have expanded inference from single-turn interactions into multi-step workflows that reason, invoke tools, coordinate subagents, and carry growing...
9 MIN READ
Aug 17, 2026

Developing Nemotron 3.5 Lightning NVFP4 with QAD Using NVIDIA Model Optimizer

Teams customize their models to hit their targets for latency, speed, memory, and compute. With the open NVIDIA Nemotron family of models, developers can find...
18 MIN READ
Aug 11, 2026

NVIDIA JetPack 7.2.1 Adds Agentic Video Skills and T3000 Emulation

Video is a core data path across NVIDIA Jetson applications, from robotics and intelligent video analytics to industrial automation, healthcare, media...
7 MIN READ
Jul 31, 2026

Co-Designing AI Model Attention for Fast, Interactive Long-Context Inference

As agentic and long-context workloads become common, the context lengths increase and attention consumes a larger share of inference time (Figure 1). Because...
14 MIN READ
Jul 26, 2026

NVIDIA Nemotron 3 Ultra Leads Open Models on Accuracy and Efficiency in Agentic RTL Coding

Modern chip design is increasingly limited by engineering time. Register transfer level (RTL) development and verification require specialized hardware...
9 MIN READ
Jul 26, 2026

Advancing Semiconductor Innovation Across Materials Engineering and Manufacturing

As AI workloads increase, explosive compute demand is pushing the semiconductor industry to meet unprecedented performance targets. Even small delays can have...
7 MIN READ
Decorative image.
Jun 26, 2026

Creating the NVIDIA Nemotron 3 Ultra NVFP4 Checkpoint with NVIDIA Model Optimizer

As context windows grow longer, moving large model weights efficiently becomes critical to performance. A common way to address this is quantization, an...
16 MIN READ
Jun 16, 2026

NVIDIA Blackwell Tops MLPerf Training 6.0 with Industry-Leading Scale and Performance

NVIDIA delivered a clean sweep in MLPerf Training v6.0, the latest edition of industry-standard AI training benchmarks developed by the MLCommons consortium....
11 MIN READ
Decorative image.
Apr 01, 2026

NVIDIA Platform Delivers Lowest Token Cost Enabled by Extreme Co-Design

Co-designed hardware, software, and models are key to delivering the highest AI factory throughput and lowest token cost. Measuring this goes far beyond peak...
10 MIN READ
Feb 06, 2026

3 Ways NVFP4 Accelerates AI Training and Inference

The latest AI models continue to grow in size and complexity, demanding increasing amounts of compute performance for training and inference—far beyond what...
6 MIN READ
Jan 08, 2026

Delivering Massive Performance Leaps for Mixture of Experts Inference on NVIDIA Blackwell

As AI models continue to get smarter, people can rely on them for an expanding set of tasks. This leads users—from consumers to enterprises—to interact with AI...
6 MIN READ