🔍 Google speeds up Gemma-4 with multi-token drafts

Google introduced Multi-Token Prediction (MTP) drafters for Gemma-4, letting it predict several tokens at once instead of one by one. This cuts down the slow step-by-step token generation typical of transformer models.

A small auxiliary model drafts multiple tokens ahead. The main model then verifies this batch in a single pass. If a token is wrong, it gets replaced and the draft restarts from that point. This saves multiple passes through the main model.

MTP boosts generation speed by about 3 times without quality loss. Google released all drafters, so this faster mode is ready for testing.

📊@tech