I took Karpathy's Autoresearch concept and adapted it into AutoPredict: a research framework for evaluating, backtesting, and iteratively improving prediction market trading agents
AutoPredict evaluates agents on
- forecast quality
- calibration
- execution (slippage, liquidity, and fills)
- drawdown and risk adjusted returns
It also supports domain specialists for weather, finance, and politics under a shared evaluation harness
This framework is NOT for building agents but for agent improvement via a evaluation + mutation + selection loop
https://x.com/howdymerry/status/2037683950085378240
Post #4312
506