NVIDIA-NeMo/Switchyard

Overview

Switchyard is an open-source LLM traffic router from NVIDIA that sits between clients and multiple model providers, keeping APIs compatible with OpenAI and Anthropic while optimizing for cost and performance. It lets teams configure routing rules, fallbacks, and policies without changing application code. Developers should care because it simplifies using many LLM providers at once and provides a central place for optimization and governance.