Memory
384 GB
HBM3e
Bandwidth
16 TB/s
TDP
2700 W
Process
N4P
TSMC
FP16
4,500 T
FP8
9,000 T
Perf / Watt
1.67 T/W
Gecko Score
86
Announced
2024-03-18
Available
2025-03-01
List price
$70,000
Cloud $/h
—
Fabricated at
TSMC
N4P · 0.0B transistors
Memory generation
HBM3e · 384 GB
16 TB/s · 16 stacks · supplied by SK hynix, Micron, Samsung
Performance envelope
FP precision matrix · manufacturer datasheet values
| FP16 dense TFLOPs | 4,500 |
| BF16 dense TFLOPs | 4,500 |
| FP8 dense TFLOPs | 9,000 |
| FP4 dense TFLOPs | 18,000 |
| INT8 TOPs | 9,000 |
| Memory bandwidth (TB/s) | 16 |
| TDP (Watts) | 2,700 |
| FP16 TFLOPs per Watt | 1.67 |
Rentable on
2 cloud providers · prices refreshed from public APIs
Known buyers
Disclosed in SEC filings, earnings calls, and press releases
Generation lineage
What came before · what comes next
Geography
HQ and fab locations · feeds /countries
HQ country
USA · CaliforniaFab locations
Taiwan
Supply signal
Hand-curated · the same feed powering the AI Compute Demand Index
Live supply tightness for GB200 is tracked on the Chip Demand Ladder and rolls up into the AI Compute Demand Index. Updated weekly from hyperscaler order books, earnings calls, and secondary-market signals.
Sources
Every spec on this page is reproducible
More from NVIDIA
Other chips from the same maker