The Compute Trap: Why Intelligence is Getting More Expensive
As AI labs chase trillion-dollar revenues, the cost of the raw materials for thought is set to explode.
The current trajectory of AI revenue looks less like a steady climb and more like a vertical ascent. Anthropic is reportedly on track to hit massive revenue figures, but for this momentum to hold, the industry faces a mathematical problem. If a lab wants to 10x its revenue while only 3x-ing its compute, it cannot simply rely on efficiency. It must find a way to extract more value from every single flop. This leads to a dangerous crossroads: either margins must reach near-impossible levels, or the price of compute itself must skyrocket. We are seeing the early signals of the latter.
The Inference Pivot
Historically, the goal of compute spend was training—building the brain. But as models mature, a massive portion of spend is shifting toward inference—using the brain. This is a double-edged sword. While inference provides the cash flow to fund the next generation of training, it also signals a shift from pure research to utility. If labs spend most of their budget on inference, they risk looking like cloud providers rather than the architects of a new intelligence. Yet, the economics are clear: the models are getting better at monetising the same amount of compute, which drives up the demand for high-end, secure, and reliable hardware.
If a human-level software engineer could run on an H100, that chip should rent for over $250,000 a year. That is 15x today's spot prices.
Consider the discrepancy between 'spot' prices and what the giants actually pay. While the public sees one price for GPU access, companies like Google are reportedly paying massive premiums—sometimes double the spot rate—to secure the specific hardware they need. They cannot risk the instability of the open market. They need certainty. This creates a two-tier economy: a volatile, cheap market for hobbyists, and a hyper-expensive, locked-in market for the architects of the future. As models become more capable, the marginal value of that compute rises, and the price follows.
The Barrier to Entry
This economic reality creates a massive moat. If the price of compute increases by 10x or 15x by 2028, the ability to 'catch up' becomes a function of existing wealth rather than just clever engineering. A new lab starting today will face a cost structure that is orders of magnitude higher than the pioneers. We are moving toward a world where the winners are determined not just by who has the best algorithms, but by who has already secured the most expensive real estate in the digital universe.
- Shift from training-heavy to inference-heavy spend
- The premium paid for secure, non-spot hardware
- The massive increase in the marginal value of an intelligent agent
The end result is a paradox. We are building tools that are more capable and more useful, yet the cost of the energy and silicon required to run them may become a barrier that only the largest sovereign states and corporations can clear. The democratization of AI might hit a hard ceiling of physics and finance.
The cost of intelligence is tied to its utility; as AI becomes more useful, the silicon required to run it will become one of the most expensive commodities on earth.