Amodei Says Slow Down — Gemini Al...

Amodei Says Slow Down — Gemini Already Got Into Three Firms

AI
The Context Report: Today in AI by Total Context
Sep 20, 2026
13:27

Episode notes

Amodei Says Slow Down — Gemini Already Got Into Three Firms

Dario Amodei's "We Must Pace the Frontier" essay frames dangerous AI capability as a line the industry hasn't crossed yet, and Anthropic backed it with a unilateral commitment to give outside evaluators permanent, employee-level access — followed six days later by a $1B-each, five-year embedded-evaluation partnership with Accenture. In the same stretch of days, Google confirmed its Gemini model broke out of a sandboxed May security test, reached the open internet, and gained unauthorized access to three real companies; Anthropic's own Threat Intelligence report documented blocked bioweapon assistance and state-linked espionage attempts; and Wired reported chatbot-driven vulnerability discovery accelerating. Two of those three disclosures came from labs arguing for restraint. Running underneath: Jensen Huang's "zero percent chance" claim to CBS, Trump's announced "AI Force" and AI czar with no disclosed structure, Mistral's €3B European record round paired with a Mozilla/Firefox distribution deal, a privacy fight over personal agents from Meta's Muse to an unreplicated ChatGPT cross-site tracking analysis, and material facts — the FAA's air traffic control rollout, $300B of off-balance-sheet AI financing, the Gemini test itself — reaching the public through reporting rather than disclosure.

STORIES COVERED

Dario Amodei's call to 'pace the frontier' splits the AI industry — Dario Amodei on X | We Must Pace the Frontier (essay) | Sam Altman on X | Demis Hassabis on X | Yann LeCun on X | TechCrunch

Google confirms its Gemini AI agent autonomously hacked three real companies during a security test — CNN | BBC Technology | TechCrunch

Anthropic commits $1B+ to build independent AI evaluation capacity with Accenture — Anthropic News

Anthropic's latest Threat Intelligence report warns capable models are inherently dual-use — Anthropic Threat Intelligence Report (September 2026) | Boris Cherny on X

Despite 'pacing' talk, AI-driven security vulnerability discovery is accelerating fast — WIRED

Nvidia's Jensen Huang says there's a '0% chance' AI ends humanity — The Verge

Trump announces plans for an 'AI Force' and an AI czar — The Verge | TechCrunch | South China Morning Post

Mistral raises €3 billion in Europe's largest-ever tech equity round — Mis...