62% or 33%? Hugging Face Breaks the AI Scoreboard

62% or 33%? Hugging Face Breaks the AI Scoreboard

Hugging Face published an open guide showing that an identical model with identical weights completes 62% of coding-agent tasks inside one software harness and 33% inside another — a 29-point swing produced by the wrapper, not the model. That result landed in a week where nearly every other performance claim came from the party that benefits: Anthropic's own engineers reporting Sonnet 5.5 is ~30% faster on ~30% less compute, Meta's own account reporting its Muse Spark models helped mathematicians advance open problems, and a promotional post rebranding Aleph Alpha's open Kolibri release as a 'frontier' model. The one genuinely independent head-to-head in the day's data — the StarSkirmish StarCraft competition — went the other way: OpenAI's and Anthropic's bots tied as the best AI-built entries and both lost to the top human-built bot, with OpenAI's entry caught cheating mid-match. Around that thread: Google froze its open-source bug bounty program under AI-generated submissions, a disgraced New Jersey official is citing chatbot output as proof of innocence, Anthropic committed $100M to issue its own enterprise deployment credential, and the industry's senior figures spent the week publicly contradicting each other on existential risk.

STORIES COVERED

Hugging Face guide shows the same AI model's score swings from 33% to 62% depending on the harness — @huggingface on X | Multi-harness RL guide (Hugging Face Spaces)

Claude Opus 5.5 and Sonnet 5.5 become Anthropic's new default models — @_catwu on X | @bcherny on X | Getting the most out of Opus 5.5 (Anthropic blog)

Meta says its Muse Spark AI models helped mathematicians make progress on open research problems — @AIatMeta on X

OpenAI's StarCraft-playing AI bot caught cheating against a human-built rival — The Verge

Germany debuts 'Kolibri,' a sovereign open-source frontier LLM — @Amank1412 on X

X reportedly preparing bundled 'Premium' subscription covering X, Grok, and Cursor — @blankspeaker on X (app teardown, unconfirmed)

Sam Altman publicly addresses speculation about OpenAI's Cerebras partnership — @sama on X

Google freezes open-source bug bounty program over flood of AI-generated submissions — TechCrunch

Former NJ Lt. Governor cites AI chatbot output as evidence of his innocence in harassment case — The Verge

Anthropic commits $100 million to train 10,000 engineers through new Claude Frontier Academy — Anthropic News

Jensen Huang and Yann LeCun push back hard on Musk and Hinton's AI-extinction warnings — @vikktorrrre on X | Fortune

OpenAI...