One resignation turned the embers of AI fear into a wildfire
The abrupt resignation of an AI researcher over safety concerns ignited a viral debate about existential risk, amplified by a coordinated media push and a Joe Rogan appearance. The author argues this episode has pushed the AI community toward extremes, warns that the biggest near-term danger may be labs failing to harden their own infrastructure, and calls for grounding the discussion in what is actually unfolding rather than speculative doom.
Fear is the simplest story, the one people cannot look away from.
- qurren
I'm an AI engineer, I feel similarly.
I also feel a need to amass retirement levels of wealth right ASAP before this all comes crashing down, and then move to somewhere else away from this mess.
The only good way for me to do that is to keep working in AI, because nothing else that I have skills for pays that high.
- mcast
It seems deeply suspicious that a company benefitting from regulatory capture would artificially stoke fears of AI and propaganda about it.
- enyone
Rise in energy prices under increasing AI DCs power draw and wasteful usage of clean water in AI DCs cooling are LEAST of my worries regarding AI.
The scale of damage when occurring is what worries me.
Eg. in old times when someone wanted to eavesdrop someones phone they needed ratio of 1:1 in person count, one keeping up the conversation and another one transcripting it up. Then some more people to intrepret that transcript an make conclusions, maybe even decisions what comes next. That is not the reality we leave in today. Today's scale of data processing and storage capabilities makes the ratio of 1:8298979488 (AI:everyone). I don't want us to ever have AI decision making over those transcripts with the same ratio. Possibility seems clearly to be there soon.
Another eg. in old times when someone wanted to dig into vulnerable system they needed ratio of 1:1 in count, one person having time to dig in one system at a time. I don't want to know how many critical and vulnerable systems we have running today in this planet connected to the same network these AI agents are run. Yes, over time you can use AI to find and patch those vulnerabilities but the scale and speed to do harm (exploiting every system at once) is the problem here.
- kidder
I’ve heard many of the AI doomer arguments including Bostrom’s Superintelligence.
But it’s still hard for me to take them seriously. These arguments start with reasonable assumptions and then project them wildly. Current LLMs are powerful and can be used dangerously. It’s reasonable to accept a few tumultuous years of change. But I can’t see them reasonably leading to civilization-ending doom.
Are the doomers within the AI industry overly anxious? Or am I missing something?
- neom
Superintelligence by Bostrom came out in 2014, I recommend reading it, at the time I thought it was some of the best sci fi I'd ever consumed, and did not think it would be a public debate within my lifetime. What I find interesting is that respected/knowledgable people have been on TV/Mainstream media saying this for a few years now, Jack Clark has been in front of Congress multiple times. What changed about this particular message that made it so gripping? My little sister msg'd me last night and asked me "Can AI really kill us all? Why can't we just unplug it?". Interesting times....!