Troubles installing webui for AMD

[RalkeyOfficial]

I am trying to install Webui for AMD with directml.
For which I downloaded @lshqqytiger's fork with directml.

Using this tutorial partially (since it does't go in depth)
https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Install-and-Run-on-AMD-GPUs

I use these command line args

--update-check --use-directml --skip-torch-cuda-test --data-dir C:\\webui\\data

Note: that I did not use these command line args during installation (since it wasn't specified inside the tutorial)
and only started using them after I got a bunch of other errors.

However, I get this error saying that torch has no attribute dml

[RalkeyOfficial]

Also, it for some reason has to download these extra 12 GB of data / models.

[lshqqytiger]

When the installation is done without --use-directml, it will not install directml package and lead to torch has no attribute dml error.
Also, what gpu do you have?

[RalkeyOfficial]

I have a 9070XT. I had a RTX 3070 before, so I am desperately trying to get this GPU to work.

[lshqqytiger]

DirectML should work after wiping venv folder.

If you want faster speed and lower vram usage, try ZLUDA.
https://github.com/vladmandic/sdnext/wiki/ZLUDA
As HIP SDK 6.2 does not support of your card, you should install custom rocBLAS and copy System32/amdhip64_6.dll to ROCm/6.2/bin.

[RalkeyOfficial]

Welp. Didn't get it to work (yet), this is what I did:

• downloaded HIP SKD with ROCm 6.2.4
• disabled raytracing in the installation option (not sure if others are also necessary, I would prefer to keep a small installation)
• continued with install of HIP SDK
• downloaded the gfx1201 from custom rocBLAS
• • specifically rocm.gfx1201.for.hip.skd.6.2.4-no-optimized.7z
• replaced library in C:\Program Files\AMD\ROCm\6.2\bin\rocblas
• • Of course I made backups
• replaced rocblas.dll in C:\Program Files\AMD\ROCm\6.2\bin with the one from gfx1201
• copied amdhip64_6.dll from system32 to C:\Program Files\AMD\ROCm\6.2\bin
• restarted my PC
• ran this command git clone https://github.com/vladmandic/sdnext . to install to a directory of my choosing
• • I would prefer not to use SD next as the UI is awful, but I don't have much of a choice I believe.
• Copied over webui-user.bat from my previous installation with Nvidia, containing the following data

set PYTHON=C:\Users\Ralkey\.pyenv\pyenv-win\versions\3.10.6\python.exe
set GIT=
set VENV_DIR=
set COMMANDLINE_ARGS=--use-zluda --debug --data-dir C:\\webui\\data

• ran webui-user.bat
• • both my iGPU and dGPU appear to be recognized:

12:37:45-244989 INFO     ROCm: AMD toolkit detected
12:37:46-202449 INFO     ROCm: agents=['gfx1036', 'gfx1201']
12:37:46-204449 INFO     ROCm: version=6.2, using agent gfx1201

• • got 1 error during PIP installation

ERROR: Could not install packages due to an OSError: [WinError 5] Access is denied: 'C:\\webui\\!AMD\\venv\\Lib\\site-packages\\~umpy.libs\\libscipy_openblas64_-c16e4918366c6bc1f1cd71e28ca36fc0.dll'
Check the permissions.

• • got a ton of errors in the end

12:43:09-544083 DEBUG    Starting module: <module 'webui' from 'C:\\webui\\!AMD\\webui.py'>
┌─────────────────────────────────────────────────────────────────────────────────────────────────── Traceback (most recent call last) ────────────────────────────────────────────────────────────────────────────────────────────────────┐
│ C:\webui\!AMD\launch.py:294 in <module>                                                                                                                                                                                                  │
│                                                                                                                                                                                                                                          │
│   293 if __name__ == "__main__":                                                                                                                                                                                                         │
│ > 294     main()                                                                                                                                                                                                                         │
│   295                                                                                                                                                                                                                                    │
│                                                                                                                                                                                                                                          │
│ C:\webui\!AMD\launch.py:266 in main                                                                                                                                                                                                      │
│                                                                                                                                                                                                                                          │
│   265                                                                                                                                                                                                                                    │
│ > 266     uv, instance = start_server(immediate=True, server=None)                                                                                                                                                                       │
│   267     t_server = time.time()                                                                                                                                                                                                         │

A lot more here

│
│ C:\webui\!AMD\venv\lib\site-packages\numpy\random\__init__.py:180 in <module>                                                                                                                                                            │
│                                                                                                                                                                                                                                          │
│   179 # add these for module-freeze analysis (like PyInstaller)                                                                                                                                                                          │
│ > 180 from . import _pickle                                                                                                                                                                                                              │
│   181 from . import _common                                                                                                                                                                                                              │
│                                                                                                                                                                                                                                          │
│ C:\webui\!AMD\venv\lib\site-packages\numpy\random\_pickle.py:1 in <module>                                                                                                                                                               │
│                                                                                                                                                                                                                                          │
│ >  1 from .mtrand import RandomState                                                                                                                                                                                                     │
│    2 from ._philox import Philox                                                                                                                                                                                                         │
│                                                                                                                                                                                                                                          │
│ in init numpy.random.mtrand:1                                                                                                                                                                                                            │
└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
ValueError: numpy.dtype size changed, may indicate binary incompatibility. Expected 96 from C header, got 88 from PyObject
Press any key to continue . . .

INSTALL_LOG.txt

So yeah.
this is where im at now.