Reference Architectures

Learn how you can use AI Gateway within your existing architecture.

​​ Reference architectures

Explore the following reference architectures that use AI Gateway:

• Multi-vendor AI observability and control: By shifting features such as rate limiting, caching, and error handling to the proxy layer, organizations can apply unified configurations across services and inference service providers.