Nokia AI Research Open-Sources AnyJev: A Training-Free Layer That Turns Any Open LLM Into a Calibrated Decision Model

It reads typed answers straight from the model's next-token distribution. It removes position and label bias without any training.

▪️ Apache-2.0, pip install "anyjev[hf]"

▪️ Choice, yes/no and score questions, nothing generated

▪️ Hugging Face transformers and vLLM backends

▪️ L0 needs zero labels, L1 needs 100 to 500

▪️ Order-flip rate 0.230 to 0.073 at L0

▪️ Calibration error 0.240 to 0.095 at L1

▪️ Auto-decidable at 5% error: 7.7% to 52.0% at L1

▪️ Tested on Qwen3-8B, BANKING77 20-way, 300 test items


Accuracy moves 6 points, but the traffic you can safely automate grows 6.8x.

Full analysis: https://www.marktechpost.com/2026/09/23/nokia-open-sources-anyjev-a-training-free-layer-that-turns-any-open-llm-into-a-calibrated-decision-model/

Repo: https://github.com/nokia-applied-research/AnyJev