

Agent S family of computer-use agents (CUAs)
AI Cutting Edge by Sujith
S1 · E2
Oct 4, 2025
16:13
Episode notes
These sources chronicle the evolution of the Agent S family of computer-use agents (CUAs), detailing improvements in performance and methodology across several iterations. Agent S introduced hierarchical planning, memory, and a constrained action space to tackle complex desktop tasks, achieving a state-of-the-art (SoTA) result of 20.6% on the OSWorld benchmark. Agent S2 significantly advanced this by implementing Proactive Hierarchical Planning and a Mixture-of-Grounding strategy, pushing the SoTA to 48.8%. Finally, Agent S3 incorporated a native coding agent and a wide-scaling framework called Behavior Best-of-N (bBoN), which generates multiple rollouts and uses concise "behavior narratives" for principled traje ...
Keywords
Artificial Intelligence
Computation and Language
Computer Vision and Pattern Recognition
Machine Learning
memory
planning
cua
computer-automation
mllm
retrieval-augmented-generation
in-context-reinforcement-learning
, agent-computer-interface
gui-agents
computer-use
omputer-use-agent
Behavior Best-of-N (bBoN)
OSWorld
WindowsAgentArena
AndroidWorld
Scaling Agents
behavior narratives
trajectory selection
Agent S
Agent S2
Agent S3
Mixture-of-Grounding
MoG
Proactive Hierarchical Planning
flat policy
native coding agent
foundation models
LLMs
advanced reasoning
autonomous agents
AGI
GPT
AIOps
federated learning
trustworthy AI
UI design
GUI
UI
California
Canada
Florida
New York
Texas
user agents
United Kingdom
Washington
user agents
innovative navigation
Bill Gates
Sam Altman
sandbox environments
Ilya Sutskever
IEEE
MIT Technology Review
cyber attacks
data integrity
OpenAI's ChatGPT
DALL-E
Kai-Fu Lee
incident management
stargate datasets
deepfake prevention
open-source
agentic frameworks
LinkedIn
Where this episode is made
Country