Benchmark

Sep 09, 2023

NVIDIA TensorRT-LLM Supercharges Large Language Model Inference on NVIDIA H100 GPUs

Large language models offer incredible new capabilities, expanding the frontier of what is possible with AI. But their large size and unique execution...
10 MIN READ
NVIDIA Jetson Orin modules.
Sep 09, 2023

Leading MLPerf Inference v3.1 Results with NVIDIA GH200 Grace Hopper Superchip Debut

AI is transforming computing, and inference is how the capabilities of AI are deployed in the world’s applications. Intelligent chatbots, image and video...
13 MIN READ
Image of Infiniband with decorative images in front.
Jul 06, 2023

New MLPerf Inference Network Division Showcases NVIDIA InfiniBand and GPUDirect RDMA Capabilities

In MLPerf Inference v3.0, NVIDIA made its first submissions to the newly introduced Network division, which is now part of the MLPerf Inference Datacenter...
9 MIN READ
Data center
Jun 27, 2023

Breaking MLPerf Training Records with NVIDIA H100 GPUs

At the heart of the rapidly expanding set of AI-powered applications are powerful AI models. Before these models can be deployed, they must be trained through a...
15 MIN READ
May 05, 2023

Accelerating Redis Performance Using VMware vSphere 8 and NVIDIA BlueField DPUs

A shift to modern distributed workloads, along with higher networking speeds, has increased the overhead of infrastructure services. There are fewer CPU cycles...
10 MIN READ
Decorative image of dark blue background with points of light connected with lines.
Apr 18, 2023

New GPU Library Lowers Compute Costs for Apache Spark ML

Spark MLlib is a key component of Apache Spark for large-scale machine learning and provides built-in implementations of many popular machine learning...
6 MIN READ
Apr 05, 2023

Setting New Records in MLPerf Inference v3.0 with Full-Stack Optimizations for AI

The most exciting computing applications currently rely on training and running inference on complex AI models, often in demanding, real-time deployment...
15 MIN READ
GPU
Feb 02, 2023

Benchmarking Deep Neural Networks for Low-Latency Trading and Rapid Backtesting on NVIDIA GPUs

Lowering response times to new market events is a driving force in algorithmic trading. Latency-sensitive trading firms keep up with the ever-increasing pace of...
8 MIN READ
Nov 09, 2022

Tuning AI Infrastructure Performance with MLPerf HPC v2.0 Benchmarks

As the fusion of AI and simulation accelerates scientific discovery, the need has arisen for a means to measure and rank the speed and throughput for building...
14 MIN READ
Nov 09, 2022

Leading MLPerf Training 2.1 with Full Stack Optimizations for AI

MLPerf benchmarks, developed by MLCommons, are critical evaluation tools for organizations to measure the performance of their machine learning models' training...
14 MIN READ
Sep 08, 2022

Full-Stack Innovation Fuels Highest MLPerf Inference 2.1 Results for NVIDIA

Today’s AI-powered applications are enabling richer experiences, fueled by both larger and more complex AI models as well as the application of many models in...
14 MIN READ
Jun 30, 2022

The Full Stack Optimization Powering NVIDIA MLPerf Training v2.0 Performance

MLPerf benchmarks are developed by a consortium of AI leaders across industry, academia, and research labs, with the aim of providing standardized, fair, and...
14 MIN READ
Jun 22, 2022

Novel Transformer Model Achieves State-of-the-Art Benchmarks in 3D Medical Image Analysis

At the Computer Vision and Pattern Recognition Conference (CVPR), NVIDIA researchers are presenting over 35 papers. This includes work on Shifted WINdows UNEt...
6 MIN READ
Jun 02, 2022

Fueling High-Performance Computing with Full-Stack Innovation

High-performance computing (HPC) has become the essential instrument of scientific discovery.  Whether it is discovering new, life-saving drugs, battling...
8 MIN READ
Apr 06, 2022

Getting the Best Performance on MLPerf Inference 2.0

Models like Megatron 530B are expanding the range of problems AI can address. However, as models continue to grow complexity, they pose a twofold challenge for...
11 MIN READ
Mar 01, 2022

Saving Time and Money in the Cloud with the Latest NVIDIA-Powered Instances

AI is transforming every industry, enabling powerful new applications and use cases that simply weren’t possible with traditional software. As AI continues to...
9 MIN READ