Policy routing
Route by model, tenant, endpoint, or cost class without scattering configuration through application code.
Open source · Apache-2.0
Northgate routes production model calls with stable routing rules, explicit retries, and first-class streaming. It keeps infrastructure readable while protecting upstreams from noisy clients.
Route by model, tenant, endpoint, or cost class without scattering configuration through application code.
Preserve chunked responses and server-sent events across retries, timeouts, and upstream failover.
Emit structured logs, trace requests end to end, and expose only the metrics an operator actually needs.
curl -fsSL https://get.northgate.dev | sh
northgate init --profile production
northgate serve --config northgate.yaml