Hugging Face (Twitter)

We just shipped Community Evals and Benchmark repositories for decentralized evals 🤗

> Scores you and model authors report are on leaderboards 🙌🏻
> Benchmark datasets host live leaderboards of reported results 🚀
> You can open PRs to add scores, they live in model repositories.

Community Evals will expose scores currently distributed across model cards, papers, and benchmarks.
It won’t solve the differences in scores, but it is transparent!