GTC Silicon Valley-2019: Pushing the Limits of AI with NVIDIA GPUs and Mellanox Interconnect

GTC Silicon Valley-2019 ID:S9268:Pushing the Limits of AI with NVIDIA GPUs and Mellanox Interconnect

Gil Bloch(Mellanox Technologies)
Learn how to build a data-centric GPU cluster for artificial intelligence. Mellanox is a leader in high-performance, scalable, low-latency network interconnects for both InfiniBand and Ethernet. We will briefly present state-of-the-art techniques for distributed machine learning and examine what special requirements these techniques impose on the system. We'll also give an overview of interconnect technologies used to scale and accelerate distributed machine learning including RDMA, NVIDIA's GPUDirect technology, and in-network computing that accelerates large-scale deployments in HPC and artificial intelligence.