keda-gpu-scaler is a KEDA external scaler that reads GPU metrics from NVML on each node, so vLLM and Triton deployments scale on real GPU load instead of CPU, including scale to zero.
More: https://ku.bz/KB6slMgk4
Post #3988
683

KU Kube Architect @kubearchitect · 8.96K subscribers 