Nexus – open-source AI gateway for enterprise LLM traffic
Nexus Gateway is an open-source AI gateway designed to manage enterprise LLM traffic securely. It operates at three layers, ensuring compliance and audit capabilities through a unified control system. The platform supports multiple AI providers and offers features like cost control, compliance pipelines, and a multi-tier caching system.
- ▪Nexus Gateway intercepts enterprise LLM traffic at three layers: AI Gateway, Compliance Proxy, and Agent.
- ▪It normalizes requests to a canonical OpenAI shape and translates them to various provider formats.
- ▪The system includes multi-axis quotas for cost control and a comprehensive compliance pipeline for data safety.
Opening excerpt (first ~120 words) tap to expand
Nexus Gateway Make AI safe to use across the enterprise. Nexus Gateway intercepts enterprise LLM traffic at three layers and runs all of it through one compliance engine, one audit pipeline, and one control plane. Mode Where it intercepts Code 🔑 AI Gateway SDK layer — virtual keys on /v1/chat/*, /v1/responses, /v1/embeddings, /v1/messages packages/ai-gateway/ 🌐 Compliance Proxy Network layer — transparent TLS bump (CONNECT + MITM) packages/compliance-proxy/ 💻 Desktop Agent OS layer — macOS / Linux / Windows builds all in development, awaiting QA packages/agent/platform/{darwin,linux,windows}/ The three pipes are independent: AI Gateway, Compliance Proxy, and Agent each run the full hooks pipeline on their own traffic (packages/shared/policy/hooks/, plus the per-service compliance…
Excerpt limited to ~120 words for fair-use compliance. The full article is at GitHub.