It's called "Adaptation of Agentic AI" and it's most important work I've read this year.
Right now, everyone is obsessed with idea of creating autonomous agents. We give them tools, memory and a goal and expect them to do our work, but when deployed in real world, they start hallucinating tool calls.
Fail at long-term planning and break down.
➡️ The WHY?
We're trying to cram all the learning into the "brain" of the model.
When developers try to fix a broken agent, they usually just retrain the main model to make it better at outputting final answers.
Researchers have discovered a critical flaw in this approach.
If you only reward AI for the correct final answer, it starts to "lazy".
It literally learns to stop using tools. It tries to guess the answer instead of doing the calculations. It ignores the calculator and tries to calculate "in its head".
To fix this, the researchers proposed a new 4-part framework describing how agents should actually learn.
And the main conclusion completely overturns the current approach.
Instead of constantly retraining the large and expensive "brain" of the agent, the most reliable systems do the opposite.
They fix the model. And adapt the tools.
This approach is called Agent-Supervised Tool Adaptation.
Instead of forcing LLMs to memorize new workflows, the LLM itself is used to dynamically build more efficient memory systems, update its own search strategies, and generate custom sub-tools on the fly.
The base model remains unchanged. It's its execution environment that becomes smarter.
For the past two years, we've treated AI as a brilliant employee who needs to learn all the company's internal rules.
But the most effective employees don't memorize everything.
They simply build a more efficient system for storing and accessing information.
Paper by Stanford & Harvard
••••••••••••••••••••••••••••••••••••••
🤖 Data & ML | @DataXplore