#rust
Switchyard is a Rust proxy and library for LLM traffic that lets coding agents keep using their normal OpenAI or Anthropic API while requests are routed to different model backends and translated as needed. It can also split traffic for testing, measure latency and errors, and use custom routing rules, which helps you run or compare models more easily without changing your agent setup.
https://github.com/NVIDIA-NeMo/Switchyard
Post #15924
831