Thinking Machines Lab is hiring an onsite Software Engineer Production Inference Distributed Inference in San Francisco, CA
Thinking Machines Lab is looking for a Software Engineer Production Inference Distributed Inference to build and operate distributed production systems for large-scale model serving.
💵 $350,000 - $500,000
🤓 LLM inference | request routing | Kubernetes | concurrency | Performance optimization | C# | tensor parallelism | model parallelism | distributed system | Pipeline Parallelism | batching | networking | GPU workload | TensorRT-LLM | Rust | SGLang | inference infrastructure | orchestration | Python | vLLM
Want your message here? Ask @duckdegen about sponsoring JobStash!
Telegram | X
Post #28462
44