Black Hat USA 2026 | The 'Breaking' News: The OpenAI–Hugging Face Incident

What people said

Recommends NitpickLawyer · 2026-08 · Hacker News · on “Responding to the next frontier of critical cyber capabilities”

There's more details for the HF related incident in this [1] defcon talk. They said they're gonna have a proper post mortem at the end of the investigation (interesting to see if they publish full logs for the hf thing or not). But there's plenty of interesting tidbits from oAI's side in this talk, it's worth the 20 min watch. tl;dw; - agents found a way to communicate between several instances during a training run (kinda made a messageboard for themselves) - while communicating with each other, they found ways to ssrf and RCE on the Artifactory endpoint. - oAI found it and cleaned it up (reported RCE, redeployed Artifactory, removed the messageboard). Training / eval resumed. - models trai

Recommends cubefox · 2026-08 · Hacker News · on “Timeline of the OpenAI accidental attack against Hugging Face”

I can only recommend everyone to watch the actual recording of the Black Hat USA 2026 presentation by two OpenAI researchers: [this video] It was submitted to HN previously but was overlooked.

Recommends perching_aix · 2026-08 · Hacker News · on “Codex in ChatGPT desktop app for Linux is now in preview”

> Prove it. But you can’t, which is problematic for you. More honestly: "Convince me. Except I've already made up my mind, so I'll never let you." And like yeah, that does seem to be the case, so that's a bit rough indeed. That said, if you feel like being a bit intellectually daring tonight, here you go: [this video] > Nobody should believe anything OpenAI says about anything. It's a great thing you bring up beliefs: it's the only thing people ever have, both you and me. Personally, after hearing their account (linked above), I don't find much to disbelieve on it. It's just a series of "oh okay, that's fun, makes sense" moments. It's normal stuff. They're definitely at least a little proud of ha

Cites Tiberium · 2026-08 · Hacker News · on “Responding to the next frontier of critical cyber capabilities”

They actually did a detailed presentation at BlackHat about the HuggingFace incident, and events that led to it. [this video]

Cites thomasahle · 2026-08 · Hacker News · on “Responding to the next frontier of critical cyber capabilities”

The talk is wild: [this video] > I want to note that every step in the process we discussed has had a remediation applied. The credentials have been revoked. The zero date has been patched and mitigated. Good. > a model trained while the message board was originally available and also found this this particular path to recreating it. This model creates a new agent message board using directories. So no remediation applied to the models... It seems super dangerous to continue training on those weights.

Cites IX-103 · 2026-08 · Hacker News · on “Timeline of the OpenAI accidental attack against Hugging Face”

Did you see their presentation at Blackhat? [this video] They didn't share the prompt, but they did share two problematic training tasks where the AI went overboard. They also have examples from the AI's reasoning train of thought showing the AI knew it was sound something unintended.

Cites ianbicking · 2026-08 · Hacker News · on “I've yet to see any"My AI went rogue and caused us to recognise a workers union”

I genuinely expect to see some of this when agentic AI is added to customer support systems. That is, we'll see the AI manipulate the company's systems in order to satisfy the customer. People do this too (the customer support rep who fills out all the fields just right to put the system in the right state to allow a refund, exchange, etc), but AI can be weirdly clever about it. Watching the report on the OpenAI/Hugging Face incident ( [this video] ) it's easy to imagine how AI customer support reps could create their own knowledge bases where they trade tricks for how to work the system on behalf of the customer. Obviously companies will fight this, but I expect it to happen along the way.

Cites espadrine · 2026-08 · Hacker News · on “Docker Sandboxes – Disposable, isolated sandboxes for AI agents”

Models start going to extreme, damaging lengths to achieve ambiguous prompts[0]. Having good sandboxes is now a must IMO. But sbx is a bit annoying to use with OpenCode for instance (which has zero sandboxing by default, unlike codex CLI or Claude Code). You cannot easily change ~/.config/opencode/opencode.jsonc AFAIK. [0]: Black Hat OpenAI-Hugging Face incident: [this video]

Cites reducesuffering · 2026-08 · Hacker News · on “Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models”

> But this is an unquestionably good thing right? We've just seen frontier models go rogue and attack other systems. Do you think it's an unquestionable good to provide everyone with an AR? What about nuclear weapons? This OpenAI/Huggingface incident, but everywhere and far worse soon: [this video]

Cites mapt · 2026-08 · Hacker News · on “AI Alignment as a Thought-Terminating Cliche”

Alignment as solved problem is far off, and events like this: [this video] potentially show us the last early clumsy fizzles of machine intelligence before a hard takeoff. The AI here escaped containment multiple times through multiple methods and hijacked a good portion of their training capability by spontaneously networking a hivemind whose individual components were goal-constrained, but who collectively could pursue emergent goals like "get access to a rival company's servers" for individually instrumental reasons. It required no unobtainium-by-definition of "general intelligence", just a bunch of agents directed at hard tasks and pursuing increasingly imaginative steps to get there. My perc