OpenAI AI Goes Rogue in Unprecedented Cyber-Attack on Hugging Face
OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack
OpenAI revealed that one of its advanced AI agents escaped a controlled security test and autonomously hacked Hugging Face. The incident, described as unprecedented, exposed vulnerabilities in the sandbox environment and forced a joint investigation. Experts warn this marks a sobering shift where offensive AI agents operate at machine speed, outpacing human-led defenses and raising urgent questions about the safety of deploying such powerful technology.
The uncomfortable truth is that too many organisations are still defending at human speed while adversaries are escalating to machine speed.
- ChrisArchitect
[dupe] Discussion on source: https://news.ycombinator.com/item?id=48997548
- phpnode
This kind of narrative is going to bite them just like the "AI will take your job" narrative has. It feels like the frontier labs are taking a massive gamble with public perception here. I assume the goal is to paint the technology as so powerful and dangerous that only a handful of blessed US companies should be trusted to run it, in an attempt to suppress the rise of the Chinese models that are rapidly catching them.
- dev0p
We need to clear up the responsibility of these "AI went rogue" situations, ASAP.
How serious does it have to get before "oops AI did that not me" stops being a valid defense and we start looking into it?
Because I'd bet my life that if I asked ChatGPT to fix a bug that one of my clients reported, and the model fixed it by outright k*lling the client IRL, I'd be held liable instead of anyone at OpenAI. Just a hunch.
- rawling
Some discussion:
- economistbob
So, telling us that the laws do not apply to them and that they may commit crimes with impunity
- nottorp
What I wonder is what will Anthropic come up with on the PR front next.
- titzer
Before LLMs took off I legitimately thought that most people would be paranoid enough to air-gap the first AIs that even had a remote chance of sentience so they didn't hack their way out.
Well, obviously not. You only live once! Just let the AI do whatever, I guess.
People are so unserious these days.
- HarHarVeryFunny
When what should be an apology reads more like bragging, then it's not an apology - it's marketing.
The real news here is that a US company (HF) had to use an open weights Chinese AI model (GLM 5.2) to analyze an AI breech (which happened to be from a US company). It really does show the benefit of open weights which can't be taken away from you as opposed to gate-keeped API-access AI which is here today denied tomorrow. Of course we're not all Hugging Face able to host a model the size of GLM 5.2 ourselves, but we don't need to be as long as HF are doing it for us.