WebGPU for client side browser inference on Linux
Has anyone tinkered around with trying to run small models in the browser. Have been super blown away by the performance, but I’m having a tough time getting it to play nice on Linux
Not 100% an expert in this but I do know there’s spotty support for Vulkan drivers with webgpu. Specifically fp16 shaders don’t work even if they are enabled on my gpu.
Anyone have any experience here?
https://redd.it/1tlnaag
@r_linux
Post #41970
47