Apple 官方的 neural engine 推理加速 SDK — 直接让 PyTorch 的推理速度提速十倍
Use ane_transformers as a reference PyTorch implementation if you are considering deploying your Transformer models on Apple devices with an A14 or newer and M1 or newer chip to achieve up to 10 times faster and 14 times lower peak memory consumption compared to baseline implementations.
https://github.com/apple/ml-ane-transformers
Post #104
415
DPS Build Weights & Biases 测试了在 M2Pro Mac Mini 上跑深度学习的训练。比前一代的 M1 Pro 快了不少，Tensorflow 大约有 15% 的增长，Pytorch 大约有18%。 结论是，这一代的 Mac Mini 可以拿来写模型原型，但是要想训练，还是需要 N 卡。 https://wandb.ai/capecape/pytorch-M1Pro/reports/Is-the-New-M2Pro-Mac-Mini-a-Deep-Learning-Workstation---…
