Description

The NVIDIA A2 Tensor Core GPU is Powered by the NVIDIA Ampere architecture represents a significant advancement in GPU technology. It has a Single Slot card featuring 16 GB of GDDR6 memory and a 60W maximum power limit. The A2 supports x8 PCIe Gen4 connectivity. It is a Passively cooled card with a superior thermal design that requires system airflow to operate and handles challenging ambient environments with ease (NEBS-3 capable). A2’s versatility, compact size, and low power exceed the demands for edge deployments at scale, instantly upgrading existing entry-level CPU servers to handle inference

Peak FP32: 4.5 TF

TF32 Tensor Core: 9 TF

BFLOAT16 Tensor Core: 18 TF

Peak FP16 Tensor Core: 18 TF

Peak INT8 Tensor Core: 36 TOPS

Peak INT4 Tensor Core: 72 TOPS

RT Cores: 10

Media engines: 1 video encoder, 2 video decoders (includes AV1 decode)

GPU memory: 16GB GDDR6

GPU memory bandwidth: 200GB/s

Interconnect: PCIe Gen4 x8

Form factor: 1-slot, low-profile PCIe

Max thermal design power (TDP): 40 – 60W (configurable)