HBMVolume2022
High Bandwidth Memory 3
First JEDEC HBM3 generation with 1024-bit interface. Powers NVIDIA H100 and H200, AMD MI300X, Google TPU v5e, AWS Trainium. SK hynix was sole initial supplier for H100. Mature production with stable supply as demand shifts to HBM3e.
Bandwidth
819 GB/s
Interface
1024-bit
Max height
12-hi
Capacity/stack
16-24 GB
Process
1b nm DRAM
Voltage
1.1V
AI chips using
5
Suppliers
3
AI demand
80%
$/GB
$16
Suppliers
3 companies producing HBM3
SH
SK hynixVolumeMarket share
50%
Mature yields, shifting capacity to HBM3e
S
SamsungVolumeMarket share
35%
Qualified for AMD MI300X
M
MicronVolumeMarket share
15%
Late entry, stable production
Demand breakdown
Balanced · mature supply meeting demand as customers upgrade to HBM3e
AI80%
Networking10%
HPC10%
Sector detail
AI training · 55%
H100 clusters still dominant installed base
AI inference · 25%
H100 inference at scale
HPC / scientific · 15%
Government and research deployments
Networking · 5%
High-end network ASICs
Primary buyers
NVIDIA
AMD
Google
AWSPricing
Average selling price · year-over-year trend
Price per GB
$16
YoY change
-8%
Trend
Declining
Pricing softening as supply shifts to HBM3e
AI chips using HBM3
5 chips from /hardware cross-linked via memoryGenerationSlug
