Arc B60 or 9060 XT 16GB for server
I'm currently running a server with OpenMediaVault, on which I also run several docker containers for Home Assistant, Jellyfin, and Frigate among other things.
It's running on an AM4 platform -- Ryzen 4750G with 32GB of RAM. For Frigate, I'm using a Google Coral USB. The Coral has been abandoned for a while, and just recently the Debian repository for it stopped working, which set off alarm bells in my head. So now I'm looking to add a GPU to use as a detector for Frigate and also to dip my toes into LLMs. I don't have any specific plans yet on the LLM side -- it's going to be more for learning than anything else.
My first choice is the Intel Arc B60. It has 24GB of RAM and having SR-IOV could be great for experimenting with VMs. It's not available locally, though. I can get one from Amazon (the Asrock Creator) for $650, but after duties/taxes it's going to be closer to $830.
Another potential issue for the B60 is that my case (Fractal Arc Midi R2) might be a bit short on clearance for the Asrock card. The case has 290mm of clearance for the GPU (with the HDD cages installed, which I need). The Asrock card is 271mm, but they recommend another 30mm due to the PCIE cable. So it's going to be tight, but that's a problem for another day I guess. In the worst case, the case can be replaced, but that's going to cost even more.
The other choice is the 9060 XT 16GB. I can get one locally for ~$500. Overpriced I know, but everything is right now, and it's still significantly cheaper than importing a B60. The GPU itself seems to be faster than the B60, but there's less RAM and no SR-IOV. There should be no case clearance issues as long as I stick with the dual fan models.
Do you think the extra 8GB of VRAM and SR-IOV of the B60 is worth the additional ~$300 compared to the 9060 XT? Are there any other issues/considerations I should be aware of for either one?
https://redd.it/1x4s82x
@r_SelfHosted
Post #54098
29