TGViewer
🚨 AI News | TestingCatalog 🚨 AI News | TestingCatalog @testingcatalog · 7.79K subscribers
Post #9646 325
Inworld launched Inworld Inference, an LLM inference API built for consumer AI apps, serving open models including Gemma 4, GLM, DeepSeek, and MiMo.

> Inworld optimizes how each model runs to deliver faster responses for tutors, companions, games, and other consumer apps.

> On Gemma 4 26B, median time to first token is 0.17 seconds, compared with 0.61 seconds for the median of the other providers on OpenRouter - 3.6× faster.

> At the 95th percentile, time to first token is 0.31 seconds versus 2.42 seconds for the median of those providers - 7.8× faster.

> Developers can also set requests to switch automatically to a fallback model if the first model fails or takes too long.

Gemma 4 26B costs $0.07 per million input tokens - nearly 40% below the median among the compared providers offering the same model that don't train on customer data.

Developers can choose a service tier for each request, prioritizing live replies while spending less on tasks that can wait.

Try hosted models in the playground!
https://platform.inworld.ai
#sponsored
  • 👍 2
  • ❤ 1
  • 👀 1
More from @testingcatalog
  1. Oct 14, 2026Mistral AI ❤️ New Material New Material is joining Mistral to help build its frontier solu…
  2. Oct 14, 2026Claude Managed Agents, the Messages API, and the Claude SDK now support OpenTelemetry trac…
  3. Oct 14, 2026ANTHROPIC 🔥: Claude Code Desktop now has a new sessions hub, live session statuses on the…
  4. Oct 14, 2026SPACEXSI 🔥: Grok Voice 3.0 has been announced, and it is now a SOTA speech-to-speech mode…
  5. Oct 14, 2026ICYMI 👀: Google will let users release their personalized vibe-coded apps to Google Play.…
  6. Oct 14, 2026DAILY AI BRIEF 🗞 — Oct 14 GOOGLE 🔥: - Google released Gemini 4 Argon globally in the pai…
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →