Jim Dinan

Jim Dinan is a director and distinguished engineer at NVIDIA and leads the GPU Communications Software Architecture team. Jim was a James Wallace Givens postdoctoral fellow at Argonne National Laboratory and earned a Ph.D. in Computer Science from the Ohio State University. Jim’s work focuses on hardware/software codesign, high-speed networking, and scalable communications software.
Avatar photo

Posts by Jim Dinan

Networking / Communications

How NVIDIA NVLink 6 Delivers Multi-Layer Resiliency for AI Factories

For operators of large-scale AI factories, maximizing continuous output is essential for productivity. In massive-scale AI training, every GPU in the cluster... 12 MIN READ
Networking / Communications

Building Scalable and Fault-Tolerant NCCL Applications

The NVIDIA Collective Communications Library (NCCL) provides communication APIs for low-latency and high-bandwidth collectives, enabling AI workloads to scale... 12 MIN READ
Simulation / Modeling / Design

Improving Network Performance of HPC Systems Using NVIDIA Magnum IO NVSHMEM and GPUDirect Async

Today’s leading-edge high performance computing (HPC) systems contain tens of thousands of GPUs. In NVIDIA systems, GPUs are connected on nodes through the... 14 MIN READ
Simulation / Modeling / Design

Accelerating NVSHMEM 2.0 Team-Based Collectives Using NCCL

NVSHMEM 2.0 is introducing a new API for performing collective operations based on the Team Management feature of the OpenSHMEM 1.5 specification. A team is a... 9 MIN READ
Simulation / Modeling / Design

Scaling Scientific Computing with NVSHMEM

Figure 1. In the NVSHMEM memory model, each process (PE) has private memory, as well as symmetric memory that forms a partition of the partitioned global... 10 MIN READ