PyTorch

Jun 16, 2025

AI Aims to Bring Order to the Law

A team of Stanford University researchers has developed an LLM system to cut through bureaucratic red tape. The LLM—dubbed the System for Statutory Research,...
4 MIN READ
May 27, 2025

Advanced Optimization Strategies for LLM Training on NVIDIA Grace Hopper

In the previous post, Profiling LLM Training Workflows on NVIDIA Grace Hopper, we explored the importance of profiling large language model (LLM) training...
10 MIN READ
A decorative image.
May 23, 2025

Unlock Efficient Data Processing with the Latest from NVIDIA DALI

NVIDIA DALI, a portable, open source software library for decoding and augmenting images, videos, and speech, recently introduced several features that improve...
8 MIN READ
Feb 13, 2025

Simplify System Memory Management with the Latest NVIDIA GH200 NVL2 Enterprise RA

NVIDIA Enterprise Reference Architectures (Enterprise RAs) can reduce the time and cost of deploying AI infrastructure solutions. They provide a streamlined...
8 MIN READ
Jan 30, 2025

New AI SDKs and Tools Released for NVIDIA Blackwell GeForce RTX 50 Series GPUs

NVIDIA recently announced a new generation of PC GPUs—the GeForce RTX 50 Series—alongside new AI-powered SDKs and tools for developers. Powered by the...
6 MIN READ
Sep 19, 2024

Just Released: Torch-TensorRT v2.4.0

Includes C++ runtime support in Windows Support, Enhanced Dynamic Shape support in Converters, PyTorch 2.4, CUDA 12.4, TensorRT 10.1, Python 3.12.
1 MIN READ
Decorative image
Sep 13, 2024

Improved Data Loading with Threads

Data loading is a critical aspect of deep learning workflows, whether you're focused on training or inference. However, it often presents a paradox: the need...
8 MIN READ
Jun 20, 2024

AI Brain Implant Restores Bilingual Communication for Stroke Survivor

Scientists have enabled a stroke survivor, who is unable to speak, to communicate in both Spanish and English by training a neuroprosthesis implant to decode...
3 MIN READ
Apr 26, 2024

Perception Model Training for Autonomous Vehicles with Tensor Parallelism

Due to the adoption of multicamera inputs and deep convolutional backbone networks, the GPU memory footprint for training autonomous driving perception models...
10 MIN READ
PyG and Accelerated with NVIDIA logos on a white background.
Jan 17, 2024

Release: PyTorch Geometric Container for GNNs on NGC

The NVIDIA PyG container, now generally available, packages PyTorch Geometric with accelerations for GNN models, dataloading, and pre-processing using...
1 MIN READ
Image is the DGL and PyG logos with the words Accelerated by NVIDIA.
Dec 08, 2023

Available Now: NVIDIA AI Accelerated DGL and PyG Containers for GNNs

From credit card transactions, social networks, and recommendation systems to transportation networks and protein-protein interactions in biology, graphs are...
9 MIN READ
An image of bottles in a manufacturing processing plant.
Nov 20, 2023

Transforming Industrial Defect Detection with NVIDIA TAO and Vision AI Models

Efficiency is paramount in industrial manufacturing, where even minor gains can have significant financial implications. According to the American Society of...
11 MIN READ
Nov 08, 2023

New Workshop: Rapid Application Development Using Large Language Models

Interested in developing LLM-based applications? Get started with this exploration of the open-source ecosystem.
1 MIN READ
Oct 12, 2023

Workshop: Model Parallelism: Building and Deploying Large Neural Networks

Learn how to train the largest neural networks and deploy them to production.
1 MIN READ
Oct 04, 2023

Analyzing the Security of Machine Learning Research Code

The NVIDIA AI Red Team is focused on scaling secure development practices across the data, science, and AI ecosystems. We participate in open-source security...
12 MIN READ
An abstract image representing PhysicsNeMo.
Aug 09, 2023

Just Released: NVIDIA PhysicsNeMo 23.08

NVIDIA PhysicsNeMo is now part of the NVIDIA AI Enterprise suite, supporting PyTorch 2.0, CUDA 12, and new samples.
1 MIN READ