Northgate

Open source · Apache-2.0

A deterministic gateway for AI traffic

Northgate routes production model calls with stable routing rules, explicit retries, and first-class streaming. It keeps infrastructure readable while protecting upstreams from noisy clients.

Policy routing

Route by model, tenant, endpoint, or cost class without scattering configuration through application code.

Streaming first

Preserve chunked responses and server-sent events across retries, timeouts, and upstream failover.

Operable by default

Emit structured logs, trace requests end to end, and expose only the metrics an operator actually needs.

Quickstart Linux / macOS
curl -fsSL https://get.northgate.dev | sh
northgate init --profile production
northgate serve --config northgate.yaml