Update envoy-ai-gateway docs and configs (#403)

Author: carlory

chart/templates/prometheus/serviceaccount.yaml

@@ -38,5 +38,5 @@ roleRef:
 subjects:
   - kind: ServiceAccount
     name: {{ include "chart.fullname" . }}-prometheus
-    namespace: llmaz-system
+    namespace: {{ .Release.Namespace }}
 {{- end }}

chart/values.global.yaml

@@ -42,7 +42,9 @@ open-webui:
   persistence:
     enabled: false
   enableOpenaiApi: true
-  openaiBaseApiUrl: "https://api.openai.com/v1"
+  # Assumes the OpenAI-compatible API is exposed via the Envoy AI Gateway. Please replace this value if you 
+  # deployed the envoy-ai-gateway example to a namespace other than "default".
+  openaiBaseApiUrl: "http://envoy-default-default-envoy-ai-gateway-dbec795a.llmaz-system.svc.cluster.local/v1"
   extraEnvVars:
   - name: OPENAI_API_KEY
     value: "ChangeMe"

docs/examples/envoy-ai-gateway/basic.yaml

@@ -59,7 +59,6 @@ apiVersion: gateway.networking.k8s.io/v1
 kind: Gateway
 metadata:
   name: default-envoy-ai-gateway
-  namespace: default
 spec:
   gatewayClassName: default-envoy-ai-gateway
   listeners:
@@ -71,7 +70,6 @@ apiVersion: aigateway.envoyproxy.io/v1alpha1
 kind: AIGatewayRoute
 metadata:
   name: default-envoy-ai-gateway
-  namespace: default
 spec:
   schema:
     name: OpenAI
@@ -99,7 +97,6 @@ apiVersion: aigateway.envoyproxy.io/v1alpha1
 kind: AIServiceBackend
 metadata:
   name: qwen2-0--5b
-  namespace: default
 spec:
   timeouts:
     request: 3m
@@ -114,7 +111,6 @@ apiVersion: aigateway.envoyproxy.io/v1alpha1
 kind: AIServiceBackend
 metadata:
   name: qwen2--5-coder
-  namespace: default
 spec:
   timeouts:
     request: 3m

site/content/en/docs/integrations/envoy-ai-gateway.md

@@ -29,14 +29,22 @@ We'll deploy two models `Qwen/Qwen2-0.5B-Instruct-GGUF` and `Qwen/Qwen2.5-Coder-
 
 The full example is [here](https://github.com/InftyAI/llmaz/blob/main/docs/examples/envoy-ai-gateway/basic.yaml), apply it.
 
+```bash
+kubectl apply -f https://raw.githubusercontent.com/InftyAI/llmaz/refs/heads/main/docs/examples/envoy-ai-gateway/basic.yaml
+```
+
 ### 3. Check Envoy AI Gateway APIs
 
 If Open-WebUI is enabled, you can chat via the webui (recommended), see [documentation](./open-webui.md). Otherwise, following the steps below to test the Envoy AI Gateway APIs.
 
 I. Port-forwarding the `LoadBalancer` service in llmaz-system, like:
 
 ```bash
-kubectl port-forward svc/envoy-default-default-envoy-ai-gateway-dbec795a 8080:80
+kubectl -n llmaz-system port-forward \
+  $(kubectl -n llmaz-system get svc \
+    -l gateway.envoyproxy.io/owning-gateway-name=default-envoy-ai-gateway \
+    -o name) \
+  8080:80
 ```
 
 II. Query `http://localhost:8008/v1/models | jq .`, available models will be listed. Expected response will look like this:

site/content/en/docs/integrations/open-webui.md

@@ -12,7 +12,7 @@ weight: 2
 
 ## How to use
 
-If open-webui already installed, what you need to do is just update the OpenAI API endpoint in the admin settings. You can get the value from step2 & 3 below. Otherwise, following the steps here to install open-webui.
+If open-webui already installed, what you need to do is just update the OpenAI API endpoint in the admin settings if you deployed the [Basic AI Gateway Example](docs/envoy-ai-gateway.md) to a namespace other than "default". You can get the value from step2 & 3 below. Otherwise, following the steps here to install open-webui.
 
 1. Enable Open WebUI in the `values.global.yaml` file, open-webui is enabled by default.
 
@@ -35,6 +35,7 @@ If open-webui already installed, what you need to do is just update the OpenAI A
     ```yaml
     open-webui:
       enabled: true
+      # Please replace this value if you deployed the envoy-ai-gateway example to a namespace other than "default".
       openaiBaseApiUrl: http://envoy-default-default-envoy-ai-gateway-dbec795a.llmaz-system.svc.cluster.local/v1
     ```