← Use Cases / use-cases / ai
Control costs and improve quality
AI inference costs can grow unpredictably as your application scales, especially when using multiple providers. Cloudflare AI Gateway caches identical queries to avoid redundant inference calls, applies rate limits per user or API key, and provides unified analytics across all providers.
Solutions
AI Gateway
Cache responses, rate limit requests, and monitor usage across providers. Learn more about AI Gateway.
- Response caching - Cache identical queries so repeated prompts do not trigger a new inference call
- Rate limiting - Set request limits per user or Application Programming Interface (API) key to prevent abuse and control spending
- Unified analytics - Track usage, latency, and cost across all AI providers from one dashboard
Workers Analytics Engine
Store and query time-series analytics data from Workers. Learn more about Workers Analytics Engine.
- Custom metrics - Build AI-specific dashboards tracking tokens, latency distributions, and error rates