Hardware

91 GPUs, chips and CPU configurations

Advertised memory and peak bandwidth as published by each vendor. “Usable” is what a runtime can actually claim once the display and driver reserve is gone — that is the number every fit on this site is measured against.

NVIDIA · Data centre

DeviceMemoryBandwidthUsableArchitectureModels that fit
H100 SXM 80 GB HBM3 3350 GB/s 78.4 GB Hopper 66 of 80 Open
H100 PCIe 80 GB HBM3 2000 GB/s 78.4 GB Hopper 66 of 80 Open
A100 80 GB 80 GB HBM2e 2039 GB/s 78.4 GB Ampere 66 of 80 Open

Missing a card? The table is hand-maintained, not scraped — every row was typed from the vendor's own spec sheet, which is why there are 91 of them and not ten thousand.