Anthropic CEO Dario Amodei Calls for Slowing AI Development
Anthropic boss Dario Amodei calls for AI development to slow down
In a new essay, Anthropic CEO Dario Amodei argues that AI development must slow down and be closely monitored. He proposes independent oversight, industry-wide regulation, and global rules, warning that risks are serious and companies need time to address them. The call comes amid growing safety concerns, including resignations from Anthropic's safety team and OpenAI CEO Sam Altman's admission that safety standards are not ready for further capability pushes.
I believe that if slowing down bought us even an extra year or two before models reach critical levels of capability, and we used that time to advance alignment, we could greatly reduce the risk that something goes seriously wrong.
- jwpapi
I thought that the new models were super smart. Fable and Astra. They definitely outperformed their previous generations, but after a couple of weeks of heavy usage my codebase again is a stupid mess and there is no way out except me fixing code by hand.
My new suspicion is now that they didn’t got drastically smarter, but they got trained on the user input on the previous generations. I don’t think anymore we had a massive intelligence jump. It just seems like they know more edge cases. Therefore I see this as marketing.
Happy to discuss.
- aenis
The question is: isn't the cat out of the bag already? With what is already in the public domain, and the compute available to motivated, deep-pocketed actors, will they be able to carry on the research without the key researchers? And will those people be able to recruit key researchers with sufficient motivations?
Unlike with nuclear proliferation, there is no heavy industrial base requirement. No time consuming, visible uranium enrichment. All it takes is for someone to buy sufficient amount of compute and try to get it past the RSI gate. Or bribe people with access to model weights to existing frontier - the asymmetry between what it takes to bribe a bunch of geeks vs. what is at stake is staggering.
- 99954bb63ccc
So, has anyone at the frontier AI labs considered doing _good_ things with these models instead of continuously proving it is capable of doing malicious things?
Instead of burning tokens doing intellectually impressive “hacks”, or sandbox escapes from which I have concerns could contain run of the mill malware, why not focus on showing people what you can fix?
Or, make software people actually use every day better.
Or, donate efforts towards medical research.
I don’t like equating AI to nuclear energy, but, it’s a lot like continually showing people how large of an explosion you can create instead of showing them how many houses/hospitals/schools/etc you can power.
- voidfunc
This guy is such a self-serving wanker.
- 708145_
After the 6 month Mythos scare campaign it hard to take him serious.
- bkishan
And Sam and Elon retweet Dario, agreeing with him. Not sure which is more weird.
- malthaus
"our burn rate is insane, let's all calm down collectively, fortify our moat so we can do regulatory capture & rent-seeking for the next 50 years"
fear is still the best tool to get masses to agree with whatever plan you hatch for yourself
- knuppar
I'm gonna repeat my comment from months ago, still true
> Jesus Dario we get it man, you want clout for the IPO.