Ramez Naam: AI's Self-Improvement Loop Is 5–10x Too Weak for an Intelligence Explosion
Where's the "Intelligence Explosion"?
Ramez Naam argues that the recursive self-improvement loop driving AI is far too weak to trigger a fast takeoff. He points to OpenAI's internal data showing models autonomously complete only 15-minute research tasks at 80% success, while benchmarks and forecasts like AI 2027 suggest hours-long horizons. Naam estimates the loop would need to be 5–10x stronger to sustain itself, and calls for better data to track progress.
Given our best current data, the AI self-improvement loop would need to be roughly 5–10× stronger to sustain itself, let alone run away.
- toasty228
Pet theory: 70% of what we're busy with brings no value outside of keeping people busy/employed, which means automating it and making it 100x faster also brings no value in the end, no matter how much "intelligence" you can deploy
- jmathai
I don't want to discount the amazing progress we've made with technology to improve people's lives.
There's the meme that the smartest people in the world are figuring out how to show ads. It's no different this time around. I understand that not everyone working on AI is building an ad network - but ultimately it feels like that's the end result.
It didn't feel quite this way 15 years ago. Back then, it felt much more tangible how technology was improving our lives. It is sort of tangible now too - I am doing things with AI that I otherwise couldn't. But somehow if feels like progress for the sake of progress.
And to be honest, it doesn't feel like the progress is for me or the people I care about.
- aeternum
https://washingtoncrossingadvisors.com/wp-content/uploads/20...
It has exploded, the explosion just isn't evenly distributed. And just as it was with the internet, most people and even most industries are not actually using it yet. Many that are are using it in name only.
People can star github repos and signup their employees for a new subscription quickly, real adoption takes far longer.