The NVIDIA A100 Tensor Core GPU features a new technology – Multi-Instance GPU (MIG), which can guarantee performance for up to seven jobs running concurrently on the same GPU.
This unique capability of the A100 GPU offers the right-sized GPU for every job and maximizes data center utilization.
This demo runs a natural language processing inference workload to identify native regions of different birds from their sound, showing inference performance on a single slice of MIG and then scaling linearly across the entire A100 GPU.
NVIDIA A100 Tensor Core GPU delivers 7X AI performance compared to NVIDIA V100, and MIG helps maximize GPU utilization by enabling multiple workloads on the same GPU.
