Usage control and monitoring

This section presents how to manage usage controls in OpenGateLLM. You will find features that help you control costs and protect your APIs against abuse.

Usage controls

User budget Set and monitor per-user spending limits.

Rate limiting Restrict request throughput to protect service stability.

Usage monitoring

Inference monitoring Monitor of API requests on models.

Environmental footprint Monitor the carbon footprint of API requests.