[Feature Request]: Collect extra-manifests recursive

[markusheinemann]

Background

I want to deploy multiple initial workloads on my new cluster after creation. They need to be deployed in different namespaces. This can be archived with a kustomize feature by using a common base. So I leveraged a folder structure for my extra-manifests:

.
├── extra-manifests/
│   ├── app1/
│   │   └── kustomization.yaml.tpl
│   ├── app2/
│   │   └── kustomization.yaml.tpl
│   └── kustomization.yaml.tpl
└── kube.tf

The purpose of extra-manifests/kustomization.yaml.tpl is to import extra-manifests/app1/kustomization.yaml.tpl and extra-manifests/app2/kustomization.yaml.tpl

Issue

Unfortunately, kube-hetzner does not copy subfolders from extra-manifests to the nodes which results in an error when executing the custom manifests:

error: accumulating resources: accumulation err='accumulating resources from 'app1': evalsymlink failure on '/var/user_kustomize/app1' : lstat /var/user_kustomize/app1: no such file or directory': must build at directory: not a valid directory: evalsymlink failure on '/var/user_kustomize/app1' : lstat /var/user_kustomize/app1: no such file or directory

Proposal

Recursive consideration of user-defined kubernetes manifests so that files from subfolders are copied correctly.

I think this feature can be implemented very easily by updating the respective fileset tofileset("extra-manifests", "**/*.yaml.tpl"):

terraform-hcloud-kube-hetzner/kustomization_user.tf

Line 2 in d1ba708

user_kustomization_templates = try(fileset("extra-manifests", "*.yaml.tpl"), toset([]))

[markusheinemann]

I will test the changes and create PR to validate the solution

[markusheinemann]

Solved with #1314