Post #1462
139
χаотичні нотатки meantime we've downloaded a-little-bit-quantized Kimi K3 checkpoint and now trying to fit it into that setup. Which is quite a quest. 900 GiB of weights, 8x128 GiB of RAM and 8x the OS/driver overhead, plus various CUDA buffers... funny side quest is it doesn't…

...ofc taking 4xgb10 REAPs is boring so let's debug a custom quant and a custom REAP
- 🔥 1