THE ECONOMICS OF AI COMPUTE

What AI compute costs, and who sets the price:from watts to tokens

Independent data and research on chips, data centers, cloud and model serving: the cost, price and pricing power at each layer. Every number carries a date and a source.

Green: data-center regions · Black: upstream chips and HBM · Arcs are illustrative

Key figures

Research

Cost breakdowns, pricing mechanics, industry structure
All research
ReportChips & hardwareGlobal一颗 GPU 的成本:制造成本只占售价约两成

上游每个供应商的售价,就是 NVIDIA 的成本。以 B200 为例,零件和良率损失约 $6,400,摊上研发和管理费约 $1 万,售价却在 $3–4 万。

  1. 01B200 的制造成本约 $6,400,售价约 $3–4 万:制造成本只占售价约两成。
  2. 02制造成本里 HBM 最大,约占 45%,是跟踪 NVIDIA 成本变化最有效的指标。
  3. 03NVIDIA 定价靠供需而不是成本加成,零件涨价对售价的直接传导有限。
Read the report 2026-11-06 · 8 min read
B200 manufacturing cost · USDEstimate
≈$6,400/ GPU
HBM$2,90045%
CoWoS packaging$1,10017%
Yield loss$1,00016%
Two dies$90014%
Substrate, test & other$4808%

Sells for about $30–40k (industry reports, to be verified): manufacturing is about a fifth of the price.

2025-12 · Epoch AI · Estimate · Details →

Coverage

Seven layers of the chain, from chips to developer tools
  1. L01Chips & hardware1 reports1 datasets
  2. L02Servers & systemsComing
  3. L03Data centersComing
  4. L04Cloud & compute1 datasets
  5. L05Compute financeComing
  6. L06Model serving1 datasets
  7. L07Developer toolsComing

Data

Traceable and downloadable
All datasets
DatasetRegionLatestUnitUpdatedStatus
Open-model price basketGlobal27%$ / 1M tokensWeeklyPartly unverifiedCSV
B300 cost per GPU-hourUnited States$2.80$ / GPU·hAs neededPartly unverifiedCSV
GPU manufacturing cost breakdownGlobal$6,400$ / GPUAs neededEstimateCSV
GPU rental prices (on-demand / reserved / term)United States · Mainland China—$ / GPU·hWeeklyComing soon

Markets

Equities, read through the supply chain
All companies
METHODOLOGY

Every number is traceable

Every number has a date and a source; estimates show their working. Speculation, judgement and unverified items are flagged separately, so you can see what we know, what we don’t, and what we think.

SpeculationJudgementUnverifiedVerified
Read the methodology
B300 cost per GPU-hourEstimate
≈ $2.80 /GPU·h
Hardware depreciation 1.48
Cost of capital 0.47
Colocation 0.41–0.68
Power 0.16–0.24
Operations & other Speculation0.10–0.20
2026-11-04 · $2.4–$3.6 · Estimate
WEEKLY BRIEF

The weekly compute brief

New research and price moves, once a week. Subscriptions open soon — follow via RSS for now.

Follow via RSS Email sign-up opens soon

Contact us

Research partnerships, data citations, press, or a different read on our analysis.