Skip to content

Unable to enable kube-ovn: coredns still make reference to calico #5012

Open
@gaetanquentin

Description

@gaetanquentin

Summary

enabling kube-ovn do not work: coredns ko

Versions and config

ubuntu 24.04.2
MicroK8s v1.32.3 revision 7964

filesystems:
/ : btrfs
/microk8s/xfs/ : xfs
/microk8s/btrfs/ : btrfs

/dev/mapper/ubuntu--vg-ubuntu--lv--btrfs on / type btrfs (rw,noatime,compress=zstd:3,ssd,space_cache=v2,autodefrag,subvolid=5,subvol=/)
/dev/mapper/ubuntu--vg-ubuntu--lv--xfs on /microk8s/xfs type xfs (rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota)
/dev/mapper/ubuntu--vg-ubuntu--lv--btrfs on /microk8s/xfs/microk8s/io.containerd.snapshotter.v1.btrfs type btrfs (rw,noatime,compress=zstd:3,ssd,space_cache=v2,autodefrag,subvolid=557,subvol=/microk8s/btrfs/snapshotter)

/var/snap/microk8s/current/args/containerd:
--root /microk8s/xfs/microk8s

/var/snap/microk8s/current/args/containerd-template.toml:
[plugins."io.containerd.grpc.v1.cri".containerd]

# snapshotter is the snapshotter used by containerd.
snapshotter = "btrfs"

fstab:
/dev/disk/by-id/dm-uuid-LVM-vE23bD62zX28eJCFvac8QqVV9DuK5leZB288JscoI30So8sY6rDdDBhA1ApMBse6 /microk8s/xfs xfs defaults 0 1
/microk8s/btrfs/snapshotter /microk8s/xfs/microk8s/io.containerd.snapshotter.v1.btrfs none bind 0 0

sudo btrfs sub list /
ID 285 gen 1859 top level 5 path data-btrfs-compressed
ID 557 gen 34825 top level 5 path microk8s/btrfs/snapshotter
ID 558 gen 7279 top level 5 path microk8s/btrfs/registry
ID 559 gen 7279 top level 5 path microk8s/btrfs/data
ID 859 gen 34817 top level 557 path microk8s/btrfs/snapshotter/snapshots/1
ID 865 gen 32829 top level 557 path microk8s/btrfs/snapshotter/snapshots/6
ID 867 gen 32832 top level 557 path microk8s/btrfs/snapshotter/snapshots/5
ID 870 gen 32834 top level 557 path microk8s/btrfs/snapshotter/snapshots/7
ID 872 gen 32836 top level 557 path microk8s/btrfs/snapshotter/snapshots/9
ID 874 gen 32838 top level 557 path microk8s/btrfs/snapshotter/snapshots/8
ID 876 gen 32841 top level 557 path microk8s/btrfs/snapshotter/snapshots/12

What Should Happen Instead?

enabling kube-ovn addon should remove calico completly, and kube ovn should deliver ips to pods.

Reproduction Steps

  1. sudo snap install microk8s --classic
  2. microk8s config to ket kubeconfig
  3. sudo microk8s enable community
  4. sudo microk8s enable kube-ovn --force
  5. microk8s kubectl get pods -n kube-system
    -> unable to delete calico pods
    kube-system 0s Warning FailedKillPod pod/calico-kube-controllers-5947598c79-srbvc error killing pod: failed to "KillPodSandbox" for "a1fbccc4-a2ac-4156-b441-94be51fcb865" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox "a769a15b0f787289f897c0927c9649853ba8f36e1912a9889eb9506b4d3386d7": plugin type="

+lots of iptables rules caliXXX
+vxlan net link still here
= 6. reboot
7. sudo microk8s enable kube-ovn --force , again
8. kubectl get pods -A
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system coredns-79b94494c7-sgv4x 0/1 ContainerCreating 2 3h30m
kube-system ovn-central-687b87db67-5kt89 1/1 Running 5 95m
kube-system ovs-ovn-vtk7w 1/1 Running 5 95m

  1. journalctl:
    Apr 05 20:38:39 node3 microk8s.daemon-kubelite[9104]: E0405 20:38:39.750701 9104 kuberuntime_manager.go:1546] "Failed to stop sandbox" podSandboxID={"Type":"containerd","ID":"33a6172891b53d11605ed0791f96f75a876cd54a88d005987866124d7345d124"}
    Apr 05 20:38:39 node3 microk8s.daemon-kubelite[9104]: E0405 20:38:39.750748 9104 kuberuntime_manager.go:1146] "killPodWithSyncResult failed" err="failed to "KillPodSandbox" for "c5fc8889-4854-43b7-83f2-e1e838f04297" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"33a6172891b53d11605ed0791f96f75a876cd54a88d005987866124d7345d124\": plugin type=\"calico\" failed (delete): error getting ClusterInformation: connection is unauthorized: Unauthorized""

Introspection Report

inspection-report-20250405_201029.tar.gz

Can you suggest a fix?

no

Are you interested in contributing with a fix?

no

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions