Consolidate Kubeflow tests (#2805)

* Training operator  CICD improvements (#2779)

* Add the networkpolicies

Signed-off-by: juliusvonkohout <[email protected]>

* rework the training operator tests

Signed-off-by: juliusvonkohout <[email protected]>

* fix the comments

Signed-off-by: juliusvonkohout <[email protected]>

* fix filename

Signed-off-by: juliusvonkohout <[email protected]>

* try to fix the permissions

Signed-off-by: juliusvonkohout <[email protected]>

* try to fix the permissions

Signed-off-by: juliusvonkohout <[email protected]>

* change to the user namespace

Signed-off-by: juliusvonkohout <[email protected]>

* update the image to rc.1

Signed-off-by: juliusvonkohout <[email protected]>

* fixes

Signed-off-by: juliusvonkohout <[email protected]>

* fixes

Signed-off-by: juliusvonkohout <[email protected]>

* fixes

Signed-off-by: juliusvonkohout <[email protected]>

* fixes

Signed-off-by: juliusvonkohout <[email protected]>

* fixes

Signed-off-by: juliusvonkohout <[email protected]>

---------

Signed-off-by: juliusvonkohout <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* create seperate file for install_KinD_create_KinD_cluster_install_kustomize.sh to avoid code repitition

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* make sh file executable

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* remove reduntant codes

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* combine kind, kuztomize and kind-cluster create sh files into one file

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* fix issues with combined file

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* fix configurations issues

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* fix linting issues in workflow files

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* fix trailing issues in workflow files

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* fix trailing issues in workflow file bentoml

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* made tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh executable and removed chmod command from the workflow files

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* made modifications in workflow files

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* deleted redundant files from tests folder

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* Add kustomize installation file

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* made install_kustomize.sh file executable

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* made a fix

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* fix issue with linting of YAML files (#2825)

* fix issue with linting of YAML files

Signed-off-by: hansinikarunarathne <[email protected]>

* delete a file to check the functionality

Signed-off-by: hansinikarunarathne <[email protected]>

* Add the after checking the functionality

Signed-off-by: hansinikarunarathne <[email protected]>

* Add folders to yaml linting

Signed-off-by: hansinikarunarathne <[email protected]>

* check linting issues

Signed-off-by: hansinikarunarathne <[email protected]>

* check linting issues

Signed-off-by: hansinikarunarathne <[email protected]>

* check linting changes

Signed-off-by: hansinikarunarathne <[email protected]>

* check linting functionality by chnaging different files

Signed-off-by: hansinikarunarathne <[email protected]>

* made some fixes in linting YAML file

Signed-off-by: hansinikarunarathne <[email protected]>

* made some fixes in linting YAML file

Signed-off-by: hansinikarunarathne <[email protected]>

* made some fixes in linting YAML file and check the functionality

Signed-off-by: hansinikarunarathne <[email protected]>

* made some fixes in linting YAML file and check the functionality

Signed-off-by: hansinikarunarathne <[email protected]>

* Add github, hack and tests folders also for linting

Signed-off-by: hansinikarunarathne <[email protected]>

* Check functionality by deleting sh from hack and yaml file common

Signed-off-by: hansinikarunarathne <[email protected]>

* Added deleted files

Signed-off-by: hansinikarunarathne <[email protected]>

---------

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* Expose Ray and Seldon to example kustomization.yaml file (#2834)

* Expose Ray and Seldon to example kustomization.yaml file

Signed-off-by: hansinikarunarathne <[email protected]>

* Add internal documentations for ray and seldon

Signed-off-by: hansinikarunarathne <[email protected]>

---------

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* Increase the time out of notebook and katib test

Signed-off-by: hansinikarunarathne <[email protected]>

* increase the timout time

Signed-off-by: hansinikarunarathne <[email protected]>

* increase timeout of the create pipeline Run from Kubeflow Notebook to 2400s

Signed-off-by: hansinikarunarathne <[email protected]>

* Add code to calculate time taken to pull a docker image

Signed-off-by: hansinikarunarathne <[email protected]>

* fix syntax error in yaml file

Signed-off-by: hansinikarunarathne <[email protected]>

* increase pipeline time

Signed-off-by: hansinikarunarathne <[email protected]>

* remove one step in action

Signed-off-by: hansinikarunarathne <[email protected]>

* Added tests to tests/gh-actions to enable baseline and restricted PSS (#2819)

* Patched PSS labels to multi_tenancy

Signed-off-by: biswajit-9776 <[email protected]>

* Added script in gh-actions to patch PSS/static/baseline/pacthes

Signed-off-by: biswajit-9776 <[email protected]>

* Added PSS scripts for both baseline and restricted labels of static namespaces and renamed directories

Signed-off-by: biswajit-9776 <[email protected]>

* Added tests to enable PSS in gh-actions

Signed-off-by: biswajit-9776 <[email protected]>

* Added workflow test for PSS labels

Signed-off-by: biswajit-9776 <[email protected]>

* Fixed indentation

Signed-off-by: biswajit-9776 <[email protected]>

---------

Signed-off-by: biswajit-9776 <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* add kind cluster step into pss test yaml file

Signed-off-by: hansinikarunarathne <[email protected]>

* change time pot time

Signed-off-by: hansinikarunarathne <[email protected]>

---------

Signed-off-by: juliusvonkohout <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: biswajit-9776 <[email protected]>
Co-authored-by: Julius von Kohout <[email protected]>
Co-authored-by: biswajit-9776 <[email protected]>

Author: 3 people

.github/workflows/admission_webhook_test.yaml

@@ -2,11 +2,9 @@ name: Build & Apply PodDefaults manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/admission_webhook_test.yaml
     - apps/admission-webhook/upstream/**
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_istio.sh
     - tests/gh-actions/install_cert_manager.sh
     - common/cert-manager/**
@@ -18,14 +16,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install Istio
       run: ./tests/gh-actions/install_istio.sh

.github/workflows/bentoml_test.yaml

@@ -2,10 +2,8 @@ name: Build & Apply BentoML Yatai Stack manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/bentoml_test.yaml
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_cert_manager.sh
     - common/cert-manager/**
     - contrib/bentoml/**
@@ -17,14 +15,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install cert-manager
       run: ./tests/gh-actions/install_cert_manager.sh

.github/workflows/centraldashboard_test.yaml

@@ -2,11 +2,9 @@ name: Build & Apply CentralDashboard manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/centraldashboard_test.yaml
     - apps/centraldashboard/upstream/**
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_istio.sh
 
 jobs:
@@ -16,14 +14,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install Istio
       run: ./tests/gh-actions/install_istio.sh

.github/workflows/dex_test.yaml

@@ -2,11 +2,9 @@ name: Build & Apply Dex manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/dex_test.yaml
     - common/dex/base/**
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_istio.sh
 
 jobs:
@@ -16,14 +14,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install Istio
       run: ./tests/gh-actions/install_istio.sh

.github/workflows/jupyter_web_application_test.yaml

@@ -2,11 +2,9 @@ name: Build & Apply JWA manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/jupyter_web_application_test.yaml
     - apps/jupyter/jupyter-web-app/upstream/**
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_istio.sh
 
 jobs:
@@ -16,14 +14,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install Istio
       run: ./tests/gh-actions/install_istio.sh

.github/workflows/katib_test.yaml

@@ -2,11 +2,9 @@ name: Build & Apply Katib manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/katib_test.yaml
     - apps/katib/upstream/**
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_istio.sh
     - tests/gh-actions/install_cert_manager.sh
     - common/cert-manager/**
@@ -18,14 +16,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install Istio
       run: ./tests/gh-actions/install_istio.sh
@@ -57,7 +49,7 @@ jobs:
         kubectl wait --for=condition=Running experiments.kubeflow.org -n kubeflow-user --all --timeout 300s
 
         echo "Waiting for all Trials to become Succeeded..."
-        kubectl wait --for=condition=Succeeded trials.kubeflow.org -n kubeflow-user --all --timeout 300s
+        kubectl wait --for=condition=Succeeded trials.kubeflow.org -n kubeflow-user --all --timeout 1200s
 
         echo "Waiting for the Experiment to become Succeeded..."
         kubectl wait --for=condition=Succeeded experiments.kubeflow.org -n kubeflow-user --all --timeout 300s

.github/workflows/kserve_cni_test.yaml

@@ -2,10 +2,8 @@ name: Build & Apply KServe manifests in KinD, using istio CNI
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/kserve_cni_test.yaml
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - common/istio-cni-1-22/**
     - tests/gh-actions/install_cert_manager.sh
     - common/cert-manager/**
@@ -20,14 +18,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Create kubeflow namespace
       run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -

.github/workflows/kserve_m2m_test.yaml

@@ -2,12 +2,10 @@ name: Deploy and test KServe with m2m auth in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/kserve_m2m_test.yaml
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - contrib/kserve/**
-    - common/oauth2-proxy/**
+    - common/oidc-client/oauth2-proxy/**
     - common/istio*/**
     - tests/gh-actions/install_istio_with_ext_auth.sh*
     - tests/gh-actions/install_cert_manager.sh
@@ -23,18 +21,12 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install kubectl
       run: ./tests/gh-actions/install_kubectl.sh
 
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
-
     - name: Create kubeflow namespace
       run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -
 

.github/workflows/kserve_test.yaml

@@ -2,10 +2,8 @@ name: Build & Apply KServe manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/kserve_test.yaml
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - contrib/kserve/**
     - tests/gh-actions/install_cert_manager.sh
     - common/cert-manager/**
@@ -20,14 +18,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Create kubeflow namespace
       run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -

.github/workflows/metacontroller_test.yaml

@@ -2,10 +2,8 @@ name: Build & Apply contrib/metacontroller in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/metacontroller_test.yaml
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - contrib/metacontroller/**
     - tests/gh-actions/install_cert_manager.sh
     - common/cert-manager/**
@@ -19,14 +17,8 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config ./tests/gh-actions/kind-cluster.yaml
-
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install Istio
       run: ./tests/gh-actions/install_istio.sh

.github/workflows/model_registry_test.yaml

@@ -4,9 +4,8 @@ name: Deploy and test Kubeflow Model Registry
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - apps/model-registry/upstream/**
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kustomize.sh
     - tests/gh-actions/install_istio.sh
     - common/istio*/**
 
@@ -17,18 +16,12 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install kubectl
       run: ./tests/gh-actions/install_kubectl.sh
 
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
-
     - name: Create kubeflow namespace
       run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -
 

.github/workflows/notebook_controller_m2m_test.yaml

@@ -2,12 +2,10 @@ name: Test Notebook Controller with m2m auth manifests in KinD
 on:
   pull_request:
     paths:
+    - tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
     - .github/workflows/notebook_controller_m2m_test.yaml
-    - tests/gh-actions/kind-cluster.yaml
-    - tests/gh-actions/install_kind.sh
-    - tests/gh-actions/install_kustomize.sh
     - apps/jupyter/**
-    - common/oauth2-proxy/**
+    - common/oidc-client/oauth2-proxy/**
     - common/istio*/**
     - tests/gh-actions/install_istio_with_ext_auth.sh*
     - tests/gh-actions/install_multi_tenancy.sh
@@ -19,18 +17,12 @@ jobs:
     - name: Checkout
       uses: actions/checkout@v4
 
-    - name: Install KinD
-      run: ./tests/gh-actions/install_kind.sh
-
-    - name: Create KinD Cluster
-      run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
+    - name: Install KinD, Create KinD cluster and Install kustomize
+      run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
 
     - name: Install kubectl
       run: ./tests/gh-actions/install_kubectl.sh
 
-    - name: Install kustomize
-      run: ./tests/gh-actions/install_kustomize.sh
-
     - name: Create kubeflow namespace
       run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -