LLM Gateway Service

Loading component author status...

The LLM Gateway service component provisions the Google Cloud projects, networking, and CI/CD repository for the platform's central foundation model routing and governance layer.

Architecture

• GCP Projects: Dedicated projects per environment (development, staging, production) configured for Vertex AI model endpoints, quota management, and logging.
• CI/CD Repository: Dedicated repository (uk-dvt-gcloud-llm-gateway-iac) for deploying gateway routing rules, rate limiters, and telemetry.
• Consumer Integration: Exposes IAM permissions and API endpoints for downstream AI agents and applications.