CVPR 2020: Dramatic Gains in Performance and Utilization with Multi-Instance GPUs

Tech Demo Team, NVIDIA
CVPR 2020
Multi-Instance GPU (MIG) mode on the NVIDIA A100 Tensor Core GPU can guarantee performance for up to seven jobs running concurrently on the same GPU.