H100 SXM vs A100 SXM4.
prices baked 2026-08-24 06:03 UTC · live, always-current version of this comparison →
| vs | H100 SXM | A100 SXM4 |
|---|---|---|
| cheapest idle /GPU/hr | $0.534 | $0.130 |
| cheapest on-demand /GPU/hr | $1.61 | $0.269 |
| idle discount | −67% | −52% |
| live offers | 65 | 74 |
| vram, max listed | 80 GB | 80 GB |
| fp16 spec TFLOPS | 989 | 312 |
| mem bandwidth GB/s | 3,350 | 2,039 |
| TFLOPS·h per $ (at floor) | 1,852 | 2,394 |
| VRAM GB·h per $ (at floor) | 150 | 614 |
At today’s floors the A100 SXM4 delivers 2,394 FP16 TFLOPS·hours per dollar against 1,852 — 1.3× the training compute per dollar. Spec ceilings, not benchmarks.
The amber cell wins its row — lowest on price, highest on everything else. Prices are each model’s cheapest live listing across 10 marketplaces at bake time; idle prices are reclaimable bid-market floors. Spec figures are vendor ceilings, unrated cells say so.
Other classics: H200 vs H100 SXM B200 vs H200 RTX 4090 vs RTX 3090 RTX 5090 vs RTX 4090 RTX 4090 vs A100 PCIE L40S vs A100 PCIE A100 PCIE vs TESLA V100 RTX A6000 vs RTX 3090 RTX 6000 ADA vs RTX A6000 RTX 4090 vs L40S RTX 5090 vs H100 SXM RTX 4090 vs RTX 4080 RTX 4080 vs RTX 3090 RTX 3090 vs RTX 3080 RTX A6000 vs A100 PCIE RTX 5090 vs L40S L4 vs TESLA T4 H100 SXM vs MI300X RTX 5090 vs A100 PCIE H100 PCIE vs H100 SXM L40S vs RTX 6000 ADA RTX 4070 vs RTX 3080 B200 vs H100 SXM