Inworld launched Inworld Inference, an LLM inference API built for consumer AI apps, serving open models including Gemma 4, GLM, DeepSeek, and MiMo.
> Inworld optimizes how each model runs to deliver faster responses for tutors, companions, games, and other consumer apps.
> On Gemma 4 26B, median time to first token is 0.17 seconds, compared with 0.61 seconds for the median of the other providers on OpenRouter - 3.6× faster.
> At the 95th percentile, time to first token is 0.31 seconds versus 2.42 seconds for the median of those providers - 7.8× faster.
> Developers can also set requests to switch automatically to a fallback model if the first model fails or takes too long.
Gemma 4 26B costs $0.07 per million input tokens - nearly 40% below the median among the compared providers offering the same model that don't train on customer data.
Developers can choose a service tier for each request, prioritizing live replies while spending less on tasks that can wait.
Try hosted models in the playground!
https://platform.inworld.ai
#sponsored
Post #9646
325

- 👍 2
- ❤ 1
- 👀 1