Description
Summary
enabling kube-ovn do not work: coredns ko
Versions and config
ubuntu 24.04.2
MicroK8s v1.32.3 revision 7964
filesystems:
/ : btrfs
/microk8s/xfs/ : xfs
/microk8s/btrfs/ : btrfs
/dev/mapper/ubuntu--vg-ubuntu--lv--btrfs on / type btrfs (rw,noatime,compress=zstd:3,ssd,space_cache=v2,autodefrag,subvolid=5,subvol=/)
/dev/mapper/ubuntu--vg-ubuntu--lv--xfs on /microk8s/xfs type xfs (rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota)
/dev/mapper/ubuntu--vg-ubuntu--lv--btrfs on /microk8s/xfs/microk8s/io.containerd.snapshotter.v1.btrfs type btrfs (rw,noatime,compress=zstd:3,ssd,space_cache=v2,autodefrag,subvolid=557,subvol=/microk8s/btrfs/snapshotter)
/var/snap/microk8s/current/args/containerd:
--root /microk8s/xfs/microk8s
/var/snap/microk8s/current/args/containerd-template.toml:
[plugins."io.containerd.grpc.v1.cri".containerd]
# snapshotter is the snapshotter used by containerd.
snapshotter = "btrfs"
fstab:
/dev/disk/by-id/dm-uuid-LVM-vE23bD62zX28eJCFvac8QqVV9DuK5leZB288JscoI30So8sY6rDdDBhA1ApMBse6 /microk8s/xfs xfs defaults 0 1
/microk8s/btrfs/snapshotter /microk8s/xfs/microk8s/io.containerd.snapshotter.v1.btrfs none bind 0 0
sudo btrfs sub list /
ID 285 gen 1859 top level 5 path data-btrfs-compressed
ID 557 gen 34825 top level 5 path microk8s/btrfs/snapshotter
ID 558 gen 7279 top level 5 path microk8s/btrfs/registry
ID 559 gen 7279 top level 5 path microk8s/btrfs/data
ID 859 gen 34817 top level 557 path microk8s/btrfs/snapshotter/snapshots/1
ID 865 gen 32829 top level 557 path microk8s/btrfs/snapshotter/snapshots/6
ID 867 gen 32832 top level 557 path microk8s/btrfs/snapshotter/snapshots/5
ID 870 gen 32834 top level 557 path microk8s/btrfs/snapshotter/snapshots/7
ID 872 gen 32836 top level 557 path microk8s/btrfs/snapshotter/snapshots/9
ID 874 gen 32838 top level 557 path microk8s/btrfs/snapshotter/snapshots/8
ID 876 gen 32841 top level 557 path microk8s/btrfs/snapshotter/snapshots/12
What Should Happen Instead?
enabling kube-ovn addon should remove calico completly, and kube ovn should deliver ips to pods.
Reproduction Steps
- sudo snap install microk8s --classic
- microk8s config to ket kubeconfig
- sudo microk8s enable community
- sudo microk8s enable kube-ovn --force
- microk8s kubectl get pods -n kube-system
-> unable to delete calico pods
kube-system 0s Warning FailedKillPod pod/calico-kube-controllers-5947598c79-srbvc error killing pod: failed to "KillPodSandbox" for "a1fbccc4-a2ac-4156-b441-94be51fcb865" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox "a769a15b0f787289f897c0927c9649853ba8f36e1912a9889eb9506b4d3386d7": plugin type="
+lots of iptables rules caliXXX
+vxlan net link still here
= 6. reboot
7. sudo microk8s enable kube-ovn --force , again
8. kubectl get pods -A
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system coredns-79b94494c7-sgv4x 0/1 ContainerCreating 2 3h30m
kube-system ovn-central-687b87db67-5kt89 1/1 Running 5 95m
kube-system ovs-ovn-vtk7w 1/1 Running 5 95m
- journalctl:
Apr 05 20:38:39 node3 microk8s.daemon-kubelite[9104]: E0405 20:38:39.750701 9104 kuberuntime_manager.go:1546] "Failed to stop sandbox" podSandboxID={"Type":"containerd","ID":"33a6172891b53d11605ed0791f96f75a876cd54a88d005987866124d7345d124"}
Apr 05 20:38:39 node3 microk8s.daemon-kubelite[9104]: E0405 20:38:39.750748 9104 kuberuntime_manager.go:1146] "killPodWithSyncResult failed" err="failed to "KillPodSandbox" for "c5fc8889-4854-43b7-83f2-e1e838f04297" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"33a6172891b53d11605ed0791f96f75a876cd54a88d005987866124d7345d124\": plugin type=\"calico\" failed (delete): error getting ClusterInformation: connection is unauthorized: Unauthorized""
Introspection Report
inspection-report-20250405_201029.tar.gz
Can you suggest a fix?
no
Are you interested in contributing with a fix?
no