Revolut moves 2,000 engineers onto self-hosted GLM and cuts AI coding costs by 90%
Revolut moves to self-hosted GLM
Revolut shifted roughly 2,000 engineers from Claude Code and Codex to self-hosted GLM for coding, running on 56 Nvidia B200s at a blended 30 cents per million tokens — about a tenth of what it paid Anthropic and OpenAI. Engineering lead time improved 70%. The real shift, per AI ops lead David Abitbol, came once tokens stopped being rationed: engineers pointed AI at everything, not just hard tickets.
The gains showed up when tokens stopped being rationed. Engineers quit saving AI for the hard tickets and pointed it at everything.
- littlecranky67
"the gains showed up when tokens stopped being rationed" - I can totally see that. I am leading (as an external consultant) a larger dev team for a huge insurance company. The devs are quite junior or in general more the "I became a sw-eng here because that company is the only big employer in a 1h radius" type of people (meaning: No rockstar developers). Most of them do not play with AI in their spare time, and they have been told to spend claude tokens wisely. Everybody is too afraid now to play with it and explore during work hours for fear of being token shamed.
At the same time, most of their junior devwork can be replaced completely by AI - so they really should start to learn how to work with it. I recommended everybody to get a private 20€/month claude subscription and use it for toy projects. I have younger devs (early 20s) in the team that told me they won't spend private money, or simply have no usecase in their private life for AI. We talk about software engineers here, and IMHO most of them are in denial of the fact that their skills have mostly become worthless if they don't start to pivot to something valueable.
- jacquesm
We did the same thing, on much less powerful hardware but it has served us very well and we don't need to worry at all about the question whether or not the suppliers of inference services can be trusted long term with our data. The answer to that question in my opinion is 'absolutely not'.
- redmalang
For the past several months about 90% of the work we do goes to open source models. If you ignore the noise around 'cheap' etc, you might find that with a little extra effort to more precisely define what you need not only do these models generally work as well, and they will generally more closely follow instructions - on longer timeframes this is actually pretty helpful.
They are less good on ambiguous prompts like 'fix all the problems' (which to my chagrin is a very common prompt it turns out..)
- gosen
> Per David Abitbol, who leads AI ops there: 56 Nvidia B200s, a blended 30 cents per million tokens, roughly a tenth of what they paid Anthropic and OpenAI.
So they've invested around $2.5M-3M into hardware + monthly operating costs (electricity, updates, cooling). I wonder how much did they spend on tokens to decide to make such a switch. I mean if they used to spend $500k-1M per month just on tokens then it would pay off in a year or so, assuming their infra will be stable and efficient.
We'll see if that's a trend for mid-big companies or just an experiment.
All that math is assuming that it's all self-hosted in their data center or so and not paying to a cloud provider, which will be probably more expensive.
- world2vec
At dayjob we're also using self-hosted GLM-5.3 via our flavour of pi.dev but teams still have discretionary power over using Claude Code or not (there's a team's budget to spend on whatever the team decides). Some teams like mine still like to use Claude Code for a lot of the work but most stuff doesn't require the latest and greatest LLM and can be done with "lesser" LLMS by simply throwing a lot of tokens and compute to it.
- andy99
This is a sane version of what “sovereign” AI can look like for many. In Canada we’ve just had this national plan to overpay for an inferior AI product in the name of sovereignty. Even if GLM is slightly behind, this is likely close to the Pareto frontier.
They also could consider putting this on openrouter when they have spare capacity to make the most effective use of the hardware.
- irthomasthomas
https://xxcancel.com/guilleflorvs/status/2117379073785696395
- InsidiousWombat
If investors knew how powerful open models are the AI companies valuation would tank overnight