AI is crushing software's 80% gross margins — and the old SaaS playbook no longer works
Something is changing in the unit economics of software
Software's historic superpower — near-zero marginal cost per user — is eroding as AI products require expensive LLM calls for every interaction. Gross margins on AI products average just 52% in 2026, down from the 75-85% SaaS investors expected. This forces a new tradeoff between model quality and cost, pushes pricing toward usage-based models, and demands that founders rethink unit economics from day one. The era of subsidized growth is ending.
The zero marginal cost era produced extraordinary companies. It also produced a lot of businesses that mistook a favourable cost structure for a genuine competitive advantage, and never had to find out the difference.
- chr15m
"Inference" is just software running. It has always cost money to run software, it's just that it is generally too cheap to matter. If a client makes a regular API call to your server, you pay for that compute, probably in the form of a flat hosting fee. If too many calls come in and workload goes up, you pay for a more expensive hosting tier to handle it (or do dynamic scaling which is per-unit of compute).
Right now the "hosting" cost for inference is per-unit because it's new and expensive, but that won't last.
There is a lot of inefficiency right now keeping prices elevated. That will change very fast and soon paying for inference will likely resemble paying for hosting your app.
The bigger problem for SaaS is that the floor has risen - people can build their own solutions for things that they used to buy SaaS for. So the industry needs to level up and solve harder problems.
- roncesvalles
>Users began expecting something fundamentally different from software: not just tools that store and retrieve, but products that reason, generate, and respond.
Not really.
>Every inference call costs money.
Not really, either. If you buy your own GPU, rack it, and run an open model, there is no unit cost. This is just expensive hosting infra. You also pay unit costs for SaaS that your software uses (things like SMS etc).
- zmmmmm
I don't think it's at all certain this won't land back on the same unit economics as the old way. The cost of serving a user doesn't have to be free - it never has been - it just has to not be the dominating factor in your costs. I'm guessing there are still quite a lot of per-user costs that aren't easily visible. Like how many of your users are logging support requests, or suing you, or demanding bug fixes or custom integrations or a myriad of other things. And how much are you having to invest in security updates, regulatory compliance, marketing etc. Not to mention, users are getting well acclimatised to the idea of quotas and paying for increased limits.