leyten/shard
Pipeline-parallel LLM inference across GPUs on separate machines.
Language: Python
Stars: 302 Issues: 2 Forks: 35
https://github.com/leyten/shard
Post #13444
1.71K
GI GitHub repos @github_repos · 27.5K subscribers