#python

Terminal-Bench is a tool that tests how well AI agents perform real tasks in a terminal, like compiling code or setting up servers, all on their own. It includes a set of tasks with instructions and tests, plus a system that connects AI models to a safe terminal environment. You can install it easily with pip and run tests to see how good your AI is at practical, real-world jobs. This helps you build, compare, and improve AI agents for coding and system tasks, making your AI development more reliable and measurable. You can also contribute new tasks or join a leaderboard to track progress.

https://github.com/laude-institute/terminal-bench