A hub for startup news, trends, and insights, covering the global startup ecosystem for founders, investors, and innovators.
Community: @startupdis
Buy Ads: @strategy (this is our only account).
Post #3345
7.26K

🔍 Google speeds up Gemma-4 with multi-token drafts
Google introduced Multi-Token Prediction (MTP) drafters for Gemma-4, letting it predict several tokens at once instead of one by one. This cuts down the slow step-by-step token generation typical of transformer models.
A small auxiliary model drafts multiple tokens ahead. The main model then verifies this batch in a single pass. If a token is wrong, it gets replaced and the draft restarts from that point. This saves multiple passes through the main model.
MTP boosts generation speed by about 3 times without quality loss. Google released all drafters, so this faster mode is ready for testing.
📊@tech
Google introduced Multi-Token Prediction (MTP) drafters for Gemma-4, letting it predict several tokens at once instead of one by one. This cuts down the slow step-by-step token generation typical of transformer models.
A small auxiliary model drafts multiple tokens ahead. The main model then verifies this batch in a single pass. If a token is wrong, it gets replaced and the draft restarts from that point. This saves multiple passes through the main model.
MTP boosts generation speed by about 3 times without quality loss. Google released all drafters, so this faster mode is ready for testing.
📊@tech
- 🤝 67
- 🤔 61
- 💯 60
- 👏 56
- 👍 53
- 🔥 52
- 😁 50
- 👎 49
- 💔 49
- 😱 42
- 🐳 38















