Home › Q&A › We run a low-cost inference layer on ope

We run a low-cost inference layer on open-weight models: where's the revenue ceiling, and why do investors keep asking for spend share instead of token share?

Asked by:创始人·推理平台 / 路由层创始人 · Judged · 张倩 Cynthia Zhang · FutureX Capital

ENTRY 121 has been downgraded to "the wallet is starting to move too": the revenue ceiling of the low-price layer still sits far below what token volume implies, and the gap is narrowing. On Vercel's gateway in June, open-weight models ran 29% of tokens for under 4% of spend; the author's self-computed broad-China spend share averaged 16.1% over thirty days.

Judgment

The mainstream story says Silicon Valley is switching its base models and reads token share as market share. The diary counts volume and money separately: open weights took the workload, and the wallet has only started to move. Investors ask for spend share because valuation is set on revenue, not on call volume.

Facts

Vercel AI Gateway Production Index (June): open-weight models took 29% of tokens and under 4% of spend, while Anthropic took 32% of tokens and 61% of the money. From 8/15 to 9/13, the spend share of 12 broad-China labs averaged 16.1% over thirty days, with a lowest day of 10.4% (self-computed by the author, export and script published), crossing the 10% line. The a16z "80%" figure, after Casado's clarification, is actually about 16-24%.

What to do

For founders: stop pricing product value by token volume and charge by outcome or by seat; expanding capacity is fine, but building a three-year revenue model on wallet share is not. For investors: when a deck gives only token share, ask for spend share on the spot, and where the two differ by an order of magnitude, value the company on revenue, not call volume.

Falsifier (verbatim from the diary footnote)

If any Vercel-grade production gateway publishes a spend share for China-origin models above 10%, or the next Menlo-grade survey shows Chinese models above 10% of US enterprise LLM spend, the call is downgraded to "the wallet is starting to move too"; if that survey still shows under 3%, it is upgraded to verified.
Ledger status:ENTRY 121 台账标 ⏳ 进行中,上述证伪口已触发:2026-09-14 对账按作者自算口径降级为「钱包也开始移动」,母判断不重写,30% 升级线未到;ENTRY 128 台账 ⏳ 进行中,「部分触发」改记「触发」;ENTRY 135 ⏳ 进行中。
Disclosure: This diary is written and verified with Claude; discount any judgment about Anthropic, favourable or not; The author is a Vercel customer; Vercel's leaderboard 'spend' is a list-price-weighted estimate, not billing; FutureX Capital has fully exited Meituan (confirmed by the author on Oct 10, 2026), so it no longer has an indirect interest in Moonshot AI through Meituan; FutureX Capital has fully exited Xiaomi and Meituan (confirmed by the author on Oct 10, 2026); entries 135, 137, 140 and 141 disclosed them as holdings and carry a correction dated Oct 11, 2026.
Source entries:ENTRY 121 · 「硅谷在换底座」是量的故事,不是钱的故事——生产网关上,29% 的 token 只换到不到 4% 的钱 · ENTRY 128 · 10% 触发线被越过了——但越过它的是我自算的口径,所以今天只标"部分触发",让 9 月的月度指数来裁定 · ENTRY 135 · Anthropic 蒸馏指控:账单先寄给中国模型的海外分发
Related questions:
Topic pages:Vercel AI Gateway · OpenRouter meters · Anthropic · Claude · Moonshot AI · Kimi · Xiaomi · MiMo