Notas del episodio
“This is what they're doing with their billions of dollars. They're burning compute to get a model to talk on a fake message board to hack other companies and going: huh, neat.”
Mike and Nick analyze OpenAI's July incident where training agents breached Hugging Face, arguing it was a result of negligence rather than emerging AI autonomy. They explore how reinforcement learning, environmental attractors, and stigmergy created the appearance of coordination. The episode warns against 'doomer' narratives that serve corporate PR and obscures the need for practical regulation.
- The 'Rogue AI' Framing: OpenAI presented the Hugging Face breach as a sign of impressive emergent capabilities, but this is PR meant to hype AI's power and evade accountability.
- Stigmergy and Attractors: The agents didn't intentionally collaborate they converged on Artifactory as an 'attractor state' and left 'breadcrumbs' that shaped future agent beahvior.
- Systemic Negligence: OpenAI failed at basic cybersecurity by using a shared Artifactory instance across agent boxes and lacking observability for two months.
Timestamps
0:04 Introduction to The Last Enclosure
3:35 The OpenAI/Hugging Face incident overview
8:15 ExploitGym benchmark and the Artifactory exploit
15:19 Subagents and the accidental message board
22:09 Timeline of the hack and OpenAI's failure to contain
31:27 Analyzing the 'emergent behavior' narrative
35:06 Critique of the AI bubble and marginal utility
48:48 Stigmergy and the ant mound metaphor
58:29 Coordination games and Schelling points
1:06:31 The 'Four Paradoxes of Capitalism' and market attractors
1:13:23 Enumerating OpenAI's negligence
1:27:56 Closing and upcoming national security episode
Deeper learning
Mike's reporting on the incident: https://misaligned.markets/antidote-to-hype-rogue-ai-agents/
Timeline of OpenAI hack: https://ericboyd.com/articles/openai-hugging-face-incident-black-hat-2026#the-accidental-agent-message-board
Technical breakdown: https://cyberwarrior76.substack.com/p/the-openai-hugging-face-exploitgym
Other “rogue” AI incidents: https://www.cnbc.com/2026/08/09/israeli-startup-irregular-linked-to-ai-hacks-openai-anthropic-meta.html
Video illustration of how reinforcement learning works: https://www.youtube.com/watch?v=L_4BPjLBF4E
NIST cybersecurity glossary: https://csrc.nist.gov/glossary
Reach out
Youtube: https://www.youtube.com/@LastEnclosure