🔍 Google unveils TPU 8t and 8i, splits chips for training and inference

Google introduced TPU 8t for training and TPU 8i for inference and reasoning. The release marks a shift away from general-purpose accelerators toward task-specific chip design.

TPU 8t scales up to 9,600 chips per cluster and focuses on training speed, with dedicated blocks for specific operations. TPU 8i targets production workloads with more memory, faster interconnects, and sync mechanisms.

Google claims up to 2.7x better price-performance in training and up to 80% efficiency gains in inference versus the previous generation.

📊 @tech