Get 5% cash back on your AWS bill from day one.Learn more →
Cloud Capital
Gradient blue and light yellow translucent 3D cubes stacked in a rising pattern on a white background.

The Cost of Compute:
AI Edition

What 100 CFOs Reveal About AI Infrastructure's Impact on the P&L

Ed Barrow

Read a note from Ed Barrow, CEO of Cloud Capital

I’ve watched a strange thing happen on the P&L of every startup we work with. A cost that barely registered five years ago has become, for a growing number of companies, one of the largest lines they carry, and one of the hardest to explain. Finance leaders who feel confident about nearly every other part of their business tell me AI infrastructure is the line they trust least. Engineering leaders tell me they cannot fully explain last month’s bill. Both are describing the same problem from opposite ends.

That problem is why we commissioned this research, a survey of 100 CFOs and senior finance leaders at growth-stage software companies, run independently by Sapio Research.

The pattern is almost always the same. A team ships a new AI-powered feature, adoption is strong, usage climbs, and then the invoice arrives three or four times higher than Finance modeled, driven by usage no one forecasted and billed by a vendor Finance wasn’t watching.

Our survey found that most of it isn’t actually tokens, counterintuitive as that sounds. It’s the compute, data, and storage that sit underneath, and that downstream spend is far more challenging to predict.

But the most surprising finding wasn’t about the cost at all. A few years ago, simply having visibility into cloud and AI spend was an advantage. Today, it’s about what companies do with that visibility. Top performers can trace their AI cost down to the individual customer and price to recover it, and the distance between them and everyone else was wider than I expected. It tracks how a company is built more than its size or age.

What ties it together is that AI infrastructure has stopped being a technical line item and become a financial one. It now sits close enough to the center of the P&L that how a company sees it, forecasts it, and prices for it is starting to separate durable AI economics from a cost that simply grows. The pages that follow dig into how the strongest companies do it, and what it would take to follow.

I hope you find it useful.

Ed Barrow

Edward Barrow

Chief Executive Officer, Cloud Capital

Executive SummaryThe Cost Is Large and Growing FastThe Cost Is Hard to Forecast, and Margin Pressure Is BuildingThe Differentiator Is Attribution and Pricing, Not GovernanceThe Economics Follow the ArchitectureAbout This Research

Executive Summary

Across every part of this survey, one picture holds: AI infrastructure cost is large, rising fast, hard to forecast, and unevenly managed.

For a meaningful share of companies, infrastructure has become one of the largest lines on the P&L, reaching a third of revenue for the companies most dependent on AI, and it’s growing 25 to 50 percent or more a year. It is also hard to see coming. Nearly every company overran an AI cost forecast in the past year, and the overruns concentrate in compute and data storage rather than the model bill most teams watch. Forecasting that cost is now the top concern finance leaders name for the year ahead.

The companies that handle AI cost well share two capabilities: they attribute the cost precisely, down to the individual customer, and they price to recover it. Where those capabilities are present, AI is a healthy line of business. Where they are absent, it is a cost that grows faster than the tools to see it. The number of formal cost controls a company runs does little to separate the two groups; attribution and pricing power do.

The clearest fault line in the data runs between two kinds of company. AI-native companies, whose product is the AI, carry cost visibility as a structural feature of how they are built. AI-enabled companies, traditional software businesses that have added AI features to an existing product, more often absorb AI as a secondary cost they struggle to see or predict. That distinction explains who is managing AI economics well better than company size or company age does, and it holds even after accounting for scale. The report returns to it in every section, because the economics follow the architecture.

A note on scope. This survey measures the cost side of AI infrastructure (spend, growth, forecasting, attribution, pricing) and the margin outcome. It does not measure the drivers of margin change such as headcount, labor productivity, or overall pricing, so where margins are discussed, the analysis is bounded to what the data can support. Full methodology and respondent profile appear at the back.

31%

of AI-native companies spend more than 30% of revenue on infrastructure

96%

of respondents had at least one AI cost category exceed forecast

70%

of AI-native companies say their AI pricing is accretive to gross margin

1. The Cost Is Large and Growing Fast

The first thing the data establishes is scale. For a meaningful share of companies, AI infrastructure is one of the largest cost lines they carry, and it is growing faster than almost anything else on the P&L.

Across the full sample, infrastructure spend (cloud plus AI) runs at a median of 16 to 20 percent of revenue. That median understates the story, because the market is split. One cluster of companies runs infrastructure at 13 to 20 percent of revenue; a second, nearly as large, runs it at 31 to 40 percent. A third of all companies spend more than 30 percent of revenue on infrastructure. The sample holds two distinct populations rather than one, and the split between them follows a clear pattern.

How much of revenue goes to infrastructure

Share of all companies at each level of infrastructure spend. The market splits into two groups: one near 16–20% of revenue, another near 31–40%.

0% 8% 15% 22% 30% 2% <5% 7% 5-8% 9% 9-12% 15% 13-15% 23% 16-20% 13% 21-30% 21% 31-40% 5% 41-50% 5% >50%
0% 15% 30% 2% <5% 7% 5-8% 9% 9-12% 15% 13-15% 23% 16-20% 13% 21-30% 21% 31-40% 5% 41-50% 5% >50%

Source: June 2026 CFO survey, n=100, administered by Sapio Research: all respondents; bars show % of companies in each band.

The division runs along business model. For AI-native companies, infrastructure spend reaches roughly a third of revenue, and half of them spend more than 30 percent. AI-enabled companies sit materially lower, with a median in the 16 to 20 percent range and essentially none above 40 percent. When the AI is the product, the infrastructure to run it is a dominant cost of goods; when AI is a feature added to an existing product, it is a smaller, though still growing, line.

Infrastructure spend as % of revenue, by company type

Share of each group at each spending level. Half of AI-native companies spend over 30% of revenue on infrastructure; almost no AI-enabled company does.

AI-native (n=46)
AI-enabled (n=51)
0% 11% 22% 34% 45% above 30% of revenue 0% 2% 0% 12% 9% 11% 11% 20% 23% 29% 9% 18% 37% 8% 3% 6% 9% 0% <5% 5-8% 9-12% 13-15% 16-20% 21-30% 31-40% 41-50% >50%
AI-native (n=46)
AI-enabled (n=51)
0% 22% 45% above 30% of revenue 0% 2% 9% 11% 23% 29% 37% 8% 9% 0% <5% 5-8% 9-12% 13-15% 16-20% 21-30% 31-40% 41-50% >50%

Source: June 2026 CFO survey, n=100, administered by Sapio Research: points show % of each cohort in each band. Bands are ordinal categories: connecting lines aid readability and do not imply values between bands.

2. The Cost Is Hard to Forecast, and Margin Pressure Is Building

96%

of respondents had an AI cost category exceed forecast in the past year.

Beyond its size, AI infrastructure cost is difficult to see coming. It overruns estimates for almost everyone, and it does so in a way that misleads the teams trying to forecast it.

Ninety-six percent of respondents had at least one AI cost category exceed its forecast over the past year. Only 4 percent came through clean. The categories that most often break the forecast are the ones finance teams watch least closely: compute infrastructure (named by 64 percent among their top overruns) and data and storage (60 percent) both outrank foundation-model API and token costs (47 percent). The overruns hide in the infrastructure lines beneath the model bill everyone tracks.

Where forecasts break: categories exceeding forecast

Share of companies naming each category among their top forecast overruns.

Compute (GPU / self-hosted) 64% Data & storage 60% Foundation model API / tokens 47% Networking & egress 44% Tooling & observability 36%
Compute (GPU / self-hosted) 64% Data & storage 60% Foundation model API / tokens 47% Networking & egress 44% Tooling & observability 36%

Source: June 2026 CFO survey, n=100, administered by Sapio Research: "select up to three"; only 4% said nothing exceeded forecast.

An iceberg, with a small visible tip above the waterline and a much larger mass submerged below

This ordering points to a blind spot worth sitting with. The token bill is the visible, explicit cost of AI. It has a published per-token price, it arrives on a dedicated invoice, and it is the number most teams reach for when they estimate what an AI feature will cost. The compute, data, and storage required to build, serve, and support that AI are larger and less legible, spread across the broader infrastructure bill and rarely tagged as "AI." The survey does not isolate the cause, but the pattern is consistent with a simple explanation: teams forecast the cost they are watching and under-scope the cost they are not, so the overruns land where attention is thinnest. The practical consequence is that AI cost is a full-stack infrastructure question. Treating it as a model-pricing question is what leaves forecasts exposed.

Top AI cost concerns, next 12 months

Share of finance leaders citing each, among their top three concerns.

Forecasting AI costs accurately 54% Preparing for AI cost growth 45% Improving visibility into cost drivers 41%
Forecasting AI costs accurately 54% Preparing for AI cost growth 45% Improving visibility into cost drivers 41%

Get the complete analysis with every finding, chart, and benchmark from the full report.

Download Report

Source: June 2026 CFO survey, n=100, administered by Sapio Research: "select up to three"; top three of seven options shown.

3. The Differentiator Is Attribution and Pricing, Not Governance

A jar of coins overflowing and spilling out around a tightly screwed-on cap

Formal AI governance controls are widespread and evenly held. The average company runs about 2.8 controls, and that count is essentially identical for AI-native and AI-enabled companies. Yet the two groups reach very different outcomes on cost visibility and pricing recovery despite deploying the same amount of monitoring. Controls appear at the same rate whether or not a company can actually see and price its AI costs, which makes them close to table stakes. The capability that separates the two groups sits underneath the controls: cost attribution and pricing recovery.

On attribution, customer-level cost visibility exists in only about half the market (49 percent), and it splits hard by type. Seventy-two percent of AI-native companies can attribute AI cost down to the individual customer, versus 29 percent of AI-enabled companies. The gap holds regardless of company size, which marks it as a trait of how the business is built rather than a function of finance-team scale.

Which companies can break AI cost down by customer

Share that can trace AI cost to individual customers, by company type.

AI-enabled 29% AI-native 72%
AI-enabled 29% AI-native 72%

Source: June 2026 CFO survey, n=100, administered by Sapio Research: % of cohort with excellent customer-level cost attribution.

On pricing, the gap is the cleanest single result in the survey. Seventy percent of AI-native companies say their AI pricing is accretive to gross margin, versus 33 percent of AI-enabled companies. More than twice as many AI-native companies successfully price to recover AI cost, and the gap widens further among the most AI-intensive companies, reaching 79 percent accretive among those with AI at 21 percent or more of cloud spend. The finding strengthens under a stricter definition rather than weakening.

Who prices AI to make money

Share of companies whose AI pricing adds to gross margin, by company type.

AI-enabled 33% AI-native 70%
AI-enabled 33% AI-native 70%

Among the most AI-intensive companies, 79% price AI profitably.

Get the complete analysis with every finding, chart, and benchmark from the full report.

Download Report

Source: June 2026 CFO survey, n=100, administered by Sapio Research: % of cohort saying AI pricing is accretive to gross margin.

The mechanism of pricing matters less than the power behind it. Bundled, add-on, and usage-based pricing all succeed or fail at roughly equal rates. Companies that bundle AI into their subscription without a separate charge actually show a higher accretive rate than those with explicit add-ons or usage meters, because the bundlers are disproportionately AI-native companies for whom the AI is the product and the subscription price already recovers its cost. Pricing power beats pricing structure.

4. The Economics Follow the Architecture

The differences across attribution, pricing, and forecasting all track a single underlying variable: whether cost visibility is designed into the product. In AI-native companies, the AI is the product, so its economics are instrumented from the start and cost attribution is inherent. In AI-enabled companies, AI is added to an existing product where cost visibility was not part of the original design. The gap between the two groups is structural, best understood as a property of how each kind of company is built.

A child's tricycle fitted with a full motorcycle engine

This is the report's central claim, so it is worth addressing the obvious objection directly. One might suspect the AI-native advantage is really a size or maturity advantage in disguise, that the AI-native companies simply happen to be larger or further along and would look better on any measure. The data rules this out. When each finding is examined while holding company size constant, the gaps in margin, attribution, and pricing persist within every size band, which identifies them as effects of business model rather than scale. The one capability that does track size is distinct cost tracking, the basic act of separating AI from general cloud in the ledger, which builds with finance-team maturity. Everything else that shapes the economics tracks how the company is architected, not its scale.

The gaps track business model, not company size

How much of each gap comes from business model versus company size (percentage points).

Type (business model)
Scale (company size)
Gross margin 27pt 2pt Customer-level visibility 45pt 4pt Pricing recovery 32pt 14pt Distinct cost tracking 19pt 30pt
Type (business model)
Scale (company size)
Gross margin 27pt 2pt Customer-level visibility 45pt 4pt Pricing recovery 32pt 14pt Distinct cost tracking 19pt 30pt

Get the complete analysis with every finding, chart, and benchmark from the full report.

Download Report

Approximate percentage-point effect, holding the other factor constant.

Source: June 2026 CFO survey, n=100, administered by Sapio Research: relative effect of business model vs company size.

About This Research

Cloud Capital partnered with Sapio Research, an independent insights firm, to ensure this report reflects decision-grade, unbiased data. The study was designed to capture how senior finance leaders at growth-stage technology companies are navigating the cost, forecasting, and margin pressures of AI infrastructure spend.

Fieldwork was conducted online in June 2026 using a structured email invitation and a secure survey environment. This ensured consistent screening, validated respondent identities, and eliminated channel-based sampling bias.

Where the respondents are

70 United States, 30 United Kingdom — the same senior finance leaders whose answers appear throughout this report.

United States (70) United Kingdom (30)
United States (70) United Kingdom (30)

Source: June 2026 CFO survey, n=100, administered by Sapio Research: respondent country of record.

We collected 100 fully qualified responses from the senior-most finance leaders at US- and UK-based companies employing 50 to 1,000 people, the scale at which cloud and AI infrastructure becomes one of the largest contributors to cost of goods sold and operating variability. By focusing exclusively on these leaders, the study captures strategic priorities and real-world decision-making rather than departmental sentiment.

These methodological choices give Cloud Capital and Sapio Research high confidence in the clarity, relevance, and reliability of the findings. Our intent is simple: to equip finance leaders with an objective, data-backed benchmark for navigating the economics of AI infrastructure.

Research partner

Sapio Research

Fieldwork dates

June 2026

Method

Email invitation to online survey

Respondent profile

Senior-most finance leader in the organization

Sample size

100 qualified respondents

Company size

50 to 1,000 employees

Company type

AI-native and AI-enabled SaaS / technology

Geographies

70% United States, 30% United Kingdom

The Cost of Compute: AI Edition — report cover

Download the full report

Get the complete analysis with every finding, chart, and benchmark from 100 CFOs building with AI in production.

Data directly from 100 CFOs
Full training, inference & talent benchmarks
Delivered as a 22-page PDF
Thanks for submitting the form.