Agent S is a new open agentic framework that enables autonomous interaction with computers through a GUI.

Agent S tackles challenges such as acquiring knowledge, planning over long-task horizons, and handling dynamic interfaces.

It introduces experience-augmented hierarchical planning which leverages both search and retrieval. This agentic framework leverages an agent-computer interface to perform reasoning and control GUI agents.

Evaluation on the OSWorld benchmark shows that Agent S outperforms the baseline by 9.37% in success rate (an 83.6% relative improvement) and achieves a new state-of-the-art.