[Feature Request]: Add support for Intel Ultra NPUs (AI Boost)

[guillaume-rce]

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits

What would your feature do ?

It would be interesting if NPUs from the new Intel Ultra processor range were added to the list of available devices.
When I tested the OpenVINO toolkit, I saw that it was already supported, so why not add it to Stable diffusion Web UI?

Proposed workflow

Simply add the NPU to the device list

Additional information

No response

[ustas-eth]

Do you think it'll work without any additional tweaks other than adding the device to the list?

Can you see "NPU" in the list if you run python -c "from openvino import Core; print(Core().available_devices)"?

It seems like they just get the list from your system. If you don't see NPU by using the command above, I guess you lack the drivers.

stable-diffusion-webui/scripts/openvino_accelerate.py

Line 1203 in e5a634d

openvino_device = gr.Dropdown(label="Select a device", choices=list(core.available_devices), value=model_state.device)

I can't check it myself because I'm on OpenSUSE, and I don't know if there's a way to install drivers on OSs other than Ubuntu.

[iamPorter]

Can you see "NPU" in the list if you run python -c "from openvino import Core; print(Core().available_devices)"?

I saw "NPU" after running the command you mentioned, but "NPU" does not appear in SD Web UI.

p.s. Tested on Windows 11 with Intel Ultra 9 185H.

[btbxbob]

NPU show up when upgrade openvino to 2024.4. but cannot get result with many torch.compile error.

[maxi201567]

Can you see "NPU" in the list if you run python -c "from openvino import Core; print(Core().available_devices)"?

I saw "NPU" after running the command you mentioned, but "NPU" does not appear in SD Web UI.

p.s. Tested on Windows 11 with Intel Ultra 9 185H.

the requirement_version.txt require openvino version 2023.2, change to 2024.5 will work, but it will got torch.compile error