inference-economics

9 items

Wall Street Journal · 2026-04-14 2026-04-17-w1

We're Using So Much AI That Computing Firepower Is Running Out

Retool's CEO switched from Anthropic to OpenAI this quarter, and the reason wasn't a benchmark: it was 98.95% uptime versus the alternative. Enterprise AI competition has shifted from capability to reliability, the same transition cloud infrastructure went through in 2010. The Anthropic paper this week shows the same pattern one layer up: automated alignment research can generate at $22/hour, but generation without stable evaluation infrastructure is just faster reward-hacking. Davies' vigilance decrement argument lands it at the human layer: even if the infrastructure holds, the person reviewing outputs degrades before the system does. Whoever solves five-nines for the full stack, model plus evaluation plus human judgment, owns enterprise regardless of whose Elo score leads.

Anthropic Blog 2026-04-16-2

Introducing Claude Opus 4.7

Anthropic held headline rates at $5/$25 per million tokens while shipping a tokenizer that inflates inputs by up to 35%, which makes price-per-token comparisons meaningless. The capability jump is real: CursorBench up 12 points, Notion tool errors cut by two-thirds, XBOW vision nearly doubled. The only number that matters now is price-per-useful-output, and that requires workload-specific benchmarking most teams won't run.

Wall Street Journal 2026-04-14-1

We're Using So Much AI That Computing Firepower Is Running Out

The compute scarcity thesis just went mainstream: WSJ reports Anthropic's 98.95% uptime as enterprise clients defect to OpenAI, Blackwell GPUs up 48% in two months, and OpenAI killed Sora to free tokens for coding. The buried signal isn't the shortage itself; it's that Retool's CEO switching providers over reliability — not capability — previews what happens when inference demand compounds faster than infrastructure can respond. The company that solves five-nines for AI inference will own enterprise, regardless of whose model benchmarks best.

UK AI Security Institute 2026-04-13-3

AISI Evaluation of Claude Mythos Preview's Cyber Capabilities

A UK government lab confirmed Mythos can autonomously execute a 32-step corporate network attack end-to-end, outperforming every tested model including GPT-5, with performance still scaling at the 100M token ceiling. The evaluation tested capability against undefended ranges, so what AISI validated is threat potential, not operational impact against a real defended environment. The structural shift is that government evaluation infrastructure is becoming the third-party verification layer for frontier AI claims, sitting between self-reported lab benchmarks and the market the way FDA trials sit between pharma and prescribers.

Financial Times 2026-03-28-3

Memory chip stocks shed $100bn as AI-driven shortage trade unwinds

A single Google Research paper on model compression wiped $100 billion from memory chip stocks in five days. Micron dropped 15%; SanDisk, the best S&P 500 performer in 2025, shed $15 billion in market cap. Morgan Stanley's defense was textbook Jevons: efficiency expands demand. But the market just revealed a new risk class: AI efficiency research as a first-order investment catalyst. The next compression paper is already being written; the question is whether you see it before or after the sell-off.

The Economist 2026-03-21-3

Nvidia's Full-Stack Reinvention: The $65B Portfolio Isn't a Moat, It's a Dependency Map

The Economist's GTC week profile frames Nvidia's expansion into networking, CPUs, models, and sovereign AI as a strategic reinvention; the article never asks the margin question. Nvidia's $216B revenue at ~73% gross margin is a GPU monopoly number: networking, CPU-only servers, and government bundles don't carry that margin. The $65B investment portfolio ($30B in OpenAI alone) is presented as ecosystem lock-in, but OpenAI already runs inference on Azure custom silicon. The portfolio isn't a moat; it's a subsidy that masks true cost-of-compute and unwinds the moment inference gets cheap enough on non-Nvidia hardware. The buried structural risk: three hyperscalers account for over half of receivables, and those same three are the ones building the substitutes.

Wall Street Journal 2026-03-17-2

Can Nvidia's Dominance Survive the Sea Change Under Way in AI Computing?

Nvidia's 73% GPU margins are structurally incompatible with an efficiency-first inference economy, but the displacement story isn't "Cerebras replaces Nvidia." Inference is heterogeneous, and Nvidia is racing to sell all three form factors: GPU for training, CPU for orchestration, LPU for inference throughput. The transition from monopolist-margin chipmaker to platform-margin integrator is the real architectural bet at GTC this year.

Meta 2026-03-14-1

Meta and AMD Partner for 6GW AI Infrastructure Agreement

The "6GW" ceiling is a negotiating lever, not an engineering plan: classic dual-sourcing to pressure Nvidia on price and allocation. Zuckerberg's precise language ("efficient inference compute") tells you AMD wins the commodity inference layer while Nvidia retains training. Two weeks later, Nvidia paid $150M to keep AMD GPUs out of the Stargate expansion; the training/inference hardware split is hardening into separate supply chains.

Bloomberg 2026-03-14-2

Nvidia's $2B Nebius Deal: Vendor Financing or Infrastructure Build?

Nvidia's $2B Nebius investment is the third multi-billion neocloud financing in three months, all inference-focused. The Lucent parallel sharpens: the last time a hardware company financed its own customers at this scale, it ended with billions in write-offs. Nobody's publishing the delta between Nvidia's reported revenue growth and organic, non-financed demand growth.