TGViewer
rtfm.co.ua | English rtfm.co.ua | English @rtfmcoua_en · 21 subscribers
Post #35 34
LiteLLM: AI Gateway on Kubernetes and Metrics in VictoriaMetrics

In the first part – LiteLLM: AI Gateway for LLMs – features overview we got familiar with what LiteLLM can do in general – now we can run it in Kubernetes and connect clients. At the same time we’ll check the integration with our existing monitoring stack – for now just metrics to VictoriaMetrics. Logs…

https://rtfm.co.ua/en/litellm-ai-gateway-on-kubernetes-and-metrics-in-victoriametrics/

#AI #AWS #Helm #Kubernetes #LiteLLM #VictoriaMetrics
RTFM: Linux, DevOps, and system administration | DevOps-engineering, and system administration. Cases from practice. LiteLLM: AI Gateway on Kubernetes and Metrics in VictoriaMetrics How to deploy LiteLLM AI Gateway on Kubernetes with Helm, AWS RDS PostgreSQL, and Redis, External Secrets Operator, and collect metrics to VictoriaMetrics
Open in Telegram All posts from @rtfmcoua_en
More from @rtfmcoua_en
  1. Sep 30, 2026AI: LLMs, Agents, Work, and Us – Engineers. Personal Thoughts. A very random text. Wasn’t…
  2. Sep 24, 2026AI: LLM Spend Control with LiteLLM Budgets and OpenAI Limits The main goal we had when int…
  3. Sep 16, 2026LiteLLM: Debugging AI Cost Monitoring with VictoriaMetrics Had a pretty interesting case w…
  4. Sep 11, 2026LiteLLM: Custom Callbacks and LLM Evaluations with Judge LLM A quick recap of what we are…
  5. Sep 9, 2026LiteLLM: Custom Callback for Traffic Mirroring and OTel Tracing to VictoriaTraces We’re cu…
  6. Aug 21, 2026LiteLLM: Traffic Mirroring, Batch Completions, and Traffic to Two Providers We’re getting…
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →