Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] ovs-dpdk无法接管网卡 #4964

Open
alin-code opened this issue Feb 5, 2025 · 5 comments
Open

[Bug] ovs-dpdk无法接管网卡 #4964

alin-code opened this issue Feb 5, 2025 · 5 comments
Labels
bug Something isn't working dpdk

Comments

@alin-code
Copy link

alin-code commented Feb 5, 2025

Description

使用kube-ovn:v1.12.18-dpdk的镜像拉起的ovs-dpdk pod,使用dpdk-devbind后无法接管网卡,ovs中有报错

Image

宿主机操作系统是centos7.8,OVS以及dpdk的编译是Ubuntu22.04(使用官方提供的Dockerfile),这是否会造成影响。

已尝试在宿主机安装ovs2.16和dpdk20.11可以接管网卡

Who will benefit from this feature?

No response

Anything else?

No response

@alin-code alin-code added the feature New network feature label Feb 5, 2025
@dosubot dosubot bot added the dpdk label Feb 5, 2025
@alin-code
Copy link
Author

alin-code commented Feb 5, 2025

经过进一步的测试,发现首先/dev/uio0在pod中是没有的,需要额外挂载这个目录,调整后,ovs-vswtichd的日志里有如下报错:
2025-02-05T09:49:41.275Z|00445|dpdk|INFO|EAL: Probe PCI driver: net_ice (8086:159b) device: 0000:5e:00.1 (socket 0)
2025-02-05T09:49:41.945Z|00446|dpdk|ERR|ice_load_pkg(): failed to search file path
2025-02-05T09:49:41.945Z|00447|dpdk|ERR|ice_dev_init(): Failed to load the DDP package,Use safe-mode-support=1 to enter Safe Mode
2025-02-05T09:49:41.946Z|00448|dpdk|ERR|EAL: Driver cannot attach the device (0000:5e:00.1)
2025-02-05T09:49:41.946Z|00449|dpdk|ERR|EAL: Failed to attach device on primary process
2025-02-05T09:49:41.946Z|00450|netdev_dpdk|WARN|Error attaching device '0000:5e:00.1' to DPDK
2025-02-05T09:49:41.946Z|00451|netdev|WARN|dpdk1: could not set configuration (Invalid argument)
2025-02-05T09:49:41.946Z|00452|dpdk|ERR|Invalid port_id=32

而已经经过了dpdk-devbind的调整,这里应该是igb_uio才对

Image

@zhangzujian zhangzujian added bug Something isn't working and removed feature New network feature labels Feb 6, 2025
@zhangzujian zhangzujian changed the title [Feature Request] ovs-dpdk无法接管网卡 [Bug] ovs-dpdk无法接管网卡 Feb 6, 2025
@alin-code
Copy link
Author

alin-code commented Feb 28, 2025

E810的网卡需要挂载两个宿主机的目录,可以成功接管,目前的ovs-dpdk并非开箱即用。我这里的用法是使用igb_uio的driver,还必须关闭iommu才能使用

一些额外的挂载:
volumeMounts:

  • mountPath: /lib/firmware/updates/intel/ice/ddp
    name: host-ice
  • mountPath: /dev
    name: host-dev

volumes:

  • hostPath:
    path: /lib/firmware/updates/intel/ice/ddp
    type: ""
    name: host-ice
  • hostPath:
    path: /dev
    type: ""
    name: host-dev

@zbb88888
Copy link
Collaborator

zbb88888 commented Mar 1, 2025

@alin-code 大佬,有空的话,帮忙提个PR修复下?

@alin-code
Copy link
Author

后续经过完备的测试会提交一个PR上来

@zbb88888
Copy link
Collaborator

zbb88888 commented Mar 6, 2025

后续经过完备的测试会提交一个PR上来

感谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working dpdk
Projects
None yet
Development

No branches or pull requests

3 participants