TGViewer
Gusarich's thoughts Gusarich's thoughts @gusarich_thoughts · 680K subscribers
Post #59 10.6K
✍️ My First Blog Post: Measuring and Analyzing Entropy in Large Language Models

I benchmarked 52 models across 12 different prompts, with 500 generations per combination, resulting in many interesting charts.

https://gusarich.com/blog/measuring-llm-entropy/
Daniil Sedov Measuring and Analyzing Entropy in Large Language Models A detailed benchmarking study exploring entropy and randomness across 52 large language models using diverse prompting strategies, revealing notable biases and significant variability influenced by model architectures and prompt engineering.
  • ❤ 14
  • 👍 9
  • 🔥 4
  • 🥰 2
  • 💋 1
Open in Telegram All posts from @gusarich_thoughts
More from @gusarich_thoughts
  1. Feb 15, 2026When I wrote that post earlier, I realized that this would become obsolete very soon once…
  2. Jan 27, 2026Things got too easy with AI AI provides incredible value to me and to many other people in…
  3. Jan 8, 2026I gave Codex its own Mac Mini I was playing around with Codex CLI a lot over the holidays,…
  4. Jan 2, 2026https://gusarich.com/blog/ton-vanity/
  5. Dec 31, 2025Happy new year 🕺
  6. Dec 31, 2025A new blog post with my predictions on AI progress in 2026. https://gusarich.com/blog/ai-i…
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →