TakebackcontrolofyourGenerativeAI

Powered by French Government, OpenGateLLM is an open-source, production-ready API gateway for Generative AI.
It centralizes, secures, and governs access to AI models across your organization, enabling teams to focus on building high-value AI applications instead of managing infrastructure complexity and data security risks.
Designed for organizations that require full control over their data and infrastructure, OpenGateLLM is optimized for self-hosted models. It provides a sovereign and cost-effective foundation to deploy, manage, and scale Generative AI securely — without vendor lock-in.

Key features

Unified routing across model providers

Expose one OpenAI-compatible API while routing requests across OpenAI, vLLM, Mistral, Text Embeddings Inference, and more.

Built-in access governance

Structure your platform with roles, users, and organizations to enforce clear permissions and secure collaboration at scale.

Usage control and observability

Control costs and reliability with user budgets, rate limiting, inference monitoring, and environmental footprint tracking.

OpenAI-compatible API

Integrate quickly with existing GenAI tools and frameworks through standard OpenAI-compatible endpoints.

Sovereign self-hosted deployment

Keep data and infrastructure under your control with a production-ready gateway designed for self-hosted AI.