[1.1.435] Depth Anything

[huchenlei]

Depth Anything project

https://github.com/LiheYoung/Depth-Anything

How to use

Download depth_anything ControlNet model here. You need to rename the file for ControlNet extension to correctly recognize it. We recommend user to rename it as control_sd15_depth_anything.

Model comparison

Depth anything comes with a preprocessor and a new SD1.5 ControlNet model trained with images annotated by this preprocessor. They do not need to be used together. Here is a grid of result comparisons against existing preprocessors/models.

input image

midas

leres

leres++

depth_anything

xyz grid

Conslusion

I would say depth_anything might not outperforms depth_leres++ for amount details captured. We still adds the preprocessor anyway as it is fairly lightweight code wise.

Update 2024-01-23

According to thread https://www.reddit.com/r/StableDiffusion/comments/19d7fx1/controlnet_has_been_updated_to_1435_includes/, depth_anything is better at handling motion blur and has better temporal consistency/stability. Maybe it is a superior choice when doing video generation, i.e. AnimateDiff.

[aimarxjg]

@huchenlei大佬，求助，我已经下载了1.5G的深度模型改名后放入了F:\sd-webui-aki-v4.5\extensions\sd-webui-controlnet\models 文件夹里面

在文生图下使用CN 点击预览就错误

开始进入WEBUI控制台就提示错误

点击预览报错 后台显示

今天更新这个后我发现修手也报错了，还是一样的提示

[softhearter]

我比较疑问的是这个logging.py这样写不会有问题吗我之前一直在他程序引用的时候出现错误直到我把这个scripts中间的logging.py改成logging_.py并修改了相关引用才让这个手部修复变得正常，请问有什么更好的办法解决吗，感谢你的回复

[huchenlei]

这里root是scripts。logging是scripts module下的namespace，不会和global的logging冲突。

[softhearter]

根据你的回答我认为应该是我把handfiner给搞错地方了，由于某些不可抗因素我没有办法从ui界面直接下载到拓展包，我想请教您一个问题

这个包他本来应该是放在那个目录下的，我的报错基本上来自于上面的包的安放位置不确定导致的，于是我修改的logging，感谢你的回复

ps;我修改过logging.py为logging_.py后可以正常运行hand refiner，但是您上面提到的确实是对的，那么问题应该是我存放package的位置存在问题，所以我想问问这个包它本来应该到那里去 QAQ

[huchenlei]

这个包是要pip安装到A1111的venv里的。你把代码checkout下来，activate A1111的venv，然后pip install {本地的repo路径}。

[softhearter]

好的，感谢你

[Cokeheart]

我也是这问题，我的handrefiner安装正常了，但是depth还是不能正常安装，这是为何
Commit hash: cf2772fab0af5573da775e7437e6acdca424f26e
Installing sd-webui-controlnet requirement: depth_anything
Couldn't install sd-webui-controlnet requirement: depth_anything.
Command: "D:\sd-webui-aki-v4.6\python\python.exe" -m pip install https://modelscope.cn/api/v1/studio/hanamizukiai/resolver/gradio/wheel/depth_anything-2024.1.22.0-py2.py3-none-any.whl --prefer-binary
Error code: 1
stdout: Looking in indexes: https://mirror.baidu.com/pypi/simple
Looking in links: https://mirror.sjtu.edu.cn/pytorch-wheels/torch_stable.html, https://mirrors.aliyun.com/pytorch-wheels/torch_stable.html, https://www.modelscope.cn/api/v1/studio/hanamizukiai/resolver/gradio/pypi-index/index.html
Collecting depth-anything==2024.1.22.0

stderr: ERROR: HTTP error 404 while getting https://modelscope.cn/api/v1/studio/hanamizukiai/resolver/gradio/wheel/depth_anything-2024.1.22.0-py2.py3-none-any.whl
ERROR: Could not install requirement depth-anything==2024.1.22.0 from https://modelscope.cn/api/v1/studio/hanamizukiai/resolver/gradio/wheel/depth_anything-2024.1.22.0-py2.py3-none-any.whl because of HTTP error 404 Client Error: Not Found for url: https://modelscope.cn/api/v1/studio/hanamizukiai/resolver/gradio/wheel/depth_anything-2024.1.22.0-py2.py3-none-any.whl for URL https://modelscope.cn/api/v1/studio/hanamizukiai/resolver/gradio/wheel/depth_anything-2024.1.22.0-py2.py3-none-any.whl

Warning: Failed to install depth_anything. Some processors will not work.