Memory
141 GB
HBM3e
Bandwidth
4.8 TB/s
TDP
700 W
Process
N4
TSMC
FP16
989 T
FP8
1,979 T
Perf / Watt
1.41 T/W
Gecko Score
55
Announced
2023-11-13
Available
2024-03-01
List price
$32,000
Cloud $/h
$3.79/h
Fabricated at
TSMC
N4 · 0.0B transistors · 814 mm²
Memory generation
HBM3e · 141 GB
4.8 TB/s · 6 stacks · supplied by SK hynix, Micron
Performance envelope
FP precision matrix · manufacturer datasheet values
| FP16 dense TFLOPs | 989 |
| BF16 dense TFLOPs | 989 |
| FP8 dense TFLOPs | 1,979 |
| FP4 dense TFLOPs | — |
| INT8 TOPs | 1,979 |
| Memory bandwidth (TB/s) | 4.8 |
| TDP (Watts) | 700 |
| FP16 TFLOPs per Watt | 1.41 |
Rentable on
3 cloud providers · prices refreshed from public APIs
Known buyers
Disclosed in SEC filings, earnings calls, and press releases
| Company | Disclosed quantity | Year |
|---|---|---|
| Amazon | undisclosed | 2024 |
Generation lineage
What came before · what comes next
Geography
HQ and fab locations · feeds /countries
HQ country
USA · CaliforniaFab locations
Taiwan
Supply signal
Hand-curated · the same feed powering the AI Compute Demand Index
Live supply tightness for H200 is tracked on the Chip Demand Ladder and rolls up into the AI Compute Demand Index. Updated weekly from hyperscaler order books, earnings calls, and secondary-market signals.
Sources
Every spec on this page is reproducible
More from NVIDIA
Other chips from the same maker