96 B200 GPUs. 12 nodes. A load balancer distributing requests across them.
https://medium.com/google-cloud/1-million-tokens-per-second-qwen-3-5-27b-on-gke-with-b200-gpus-161da5c1b592
Post #7438
3.3K
1 Million Tokens Per Second: Qwen 3.5 27B on GKE with B200 GPUs
https://medium.com/google-cloud/1-million-tokens-per-second-qwen-3-5-27b-on-gke-with-b200-gpus-161da5c1b592
https://medium.com/google-cloud/1-million-tokens-per-second-qwen-3-5-27b-on-gke-with-b200-gpus-161da5c1b592