API Gateway - August 3rd, 2026 [Feature]
Share
Services
## Feature
Feature
**Route LLM requests with model routing**
You can now use model routing in API Gateway as a managed traffic management layer to accept OpenAI-compatible prompt requests, transcode them in-flight, and route them to specific foundation models in Gemini Enterprise Agent Platform Model Garden (including Gemini, Anthropic Claude, and OpenAI GPT models).
Key benefits and capabilities include:
* **Centralized traffic management**: Consolidate AI traffic routing and lifecycle management at the network edge without hosting standalone client-side proxies.
* **In-flight transcoding**: Standardize client applications on an OpenAI-compatible REST interface while dynamically dispatching requests to diverse underlying Agent Platform Model Garden endpoints.
* **OpenAPI 3.x configuration**: Define model routing tables, explicit routing rules, and default model fallbacks using the new `x-google-api-management.ai.models.routing` and `x-google-model-router` OpenAPI 3.x extensions.
For more information, see [Overview of model routing](https://cloud.google.com/api-gateway/docs/model-routing-overview) and [Configure model routing](https://cloud.google.com/api-gateway/docs/model-routing-configure).