It is no secret that you will need powerful GPUs for demanding AI applications. The NVIDIA A100 80GB GPU has double the memory bandwidth of its predecessor. It comes with third-generation Tensor Cores with the TF32 format. It also features 2.5x FP64 for HPC, 20x INT8 for AI inference and support for the BF16 data format.
This GPU comes with third generation NVLink & NVSwitch with twice the GPU-to-GPU bandwidth of the previous generation. The NVIDIA A100 80GB GPU is available in NVIDIA DGX A100 and NVIDIA DGX Station A100 systems.