Hugging Face (Twitter)
RT @LysandreJik: Transformers v5's FINAL, stable release is out 🔥 Transformers' biggest release.
The big Ws of this release:
- Performance, especially for MoE (6x-11x speedups)
- No more slow/fast tokenizers -> way simpler API, explicit backends, better performance
- dynamic weight loading: way faster, and enabling: MoE now working w/ {quants, tp, peft, ...}
We have a migration guide on the main branch; please take a look at it in case you run into issues. Come in our GH issues if you still do after reading it 😀
Post #2244
68
