Introduction

The NVIDIA A100 Tensor Core GPU delivers acceleration at every scale for AI, data analytics, and HPC to tackle the world’s toughest computing challenges. As the engine of the NVIDIA data center platform, A100 can efficiently scale up to thousands of GPUs or, using new Multi-Instance GPU (MIG) technology, can be partitioned into seven isolated GPU instances to accelerate workloads of all sizes. A100’s third-generation Tensor Core technology now accelerates more levels of precision for diverse workloads, speeding time to insight as well as time to market.

Processor

CUDA

Y

CUDA cores

6912

Graphics processor family

NVIDIA

Graphics processor

A100

Memory

Discrete graphics card memory

40 GB

Graphics card memory type

High Bandwidth Memory 2 (HBM2)

Data transfer rate

1.555 Gbit/s

Memory bandwidth (max)

32 GB/s

Ports & interfaces

Interface type

PCI Express 4.0

Design

Cooling type

Passive

Form factor

Full-Height/Full-Length (FH/FL)

Product colour

Black, Gold

Power

Power consumption (typical)

250 W