-
Notifications
You must be signed in to change notification settings - Fork 7.1k
Add CREStereo weights. #6629
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add CREStereo weights. #6629
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi @TeodorPoncu , thanks for the PR! Could you give the command that you use to test and get those numbers on the PR description? (see #5793 for example)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! Thanks
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @TeodorPoncu , the PR looks good to me!
I have a minor NIT, but I will approve to unblock.
"relepe": 0.114, | ||
"fl-all": 90.429, | ||
"_detailed": { | ||
1: { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
NIT, lets give comment indicating that 1
is the number of cascade
…u/vision into add-crestereo-weights
Hey @TeodorPoncu! You merged this PR, but no labels were added. The list of valid labels is available at https://github.com/pytorch/vision/blob/main/.github/process_commit.py |
Summary: * added crestereo author weights * update weights name * synced fl-all metric * changed resize size config param name * extended weight sets * changed weight link Reviewed By: YosuaMichael Differential Revision: D39885429 fbshipit-source-id: 7d268ce2121101cb30b2aab5b99c70637182a2a1
This PR includes a CREStereo weight-template pointing towards the author provided weights and reference script trained weights.
Test commands are as following:
Reference base weights:
torchrun --nproc_per_node 1 --nnodes 1 cascade_evaluation.py --dataset middlebury2014-train --batch-size 1 --dataset-root $dataset_root --model crestereo_base --weights CREStereo_Base_Weights.CRESTEREO_ETH_MBL_V1
will yield for 10 recursive iterations and 1 cascade:
'mae': 1.416, 'rmse': 3.53, '1px': 0.777, '3px': 0.896, '5px': 0.933, 'relepe': 0.148, 'fl-all': 78.388
Reference finetuned weights:
torchrun --nproc_per_node 1 --nnodes 1 cascade_evaluation.py --dataset middlebury2014-train --batch-size 1 --dataset-root $dataset_root --model crestereo_base --weights CREStereo_Base_Weights.CRESTEREO_FINETUNE_MULTI_V1
will yield for 10 recursive iterations and 1 cascade:
'mae': 1.02, 'rmse': 3.073, '1px': 0.854, '3px': 0.938, '5px': 0.96, 'relepe': 0.129, 'fl-all': 86.042
Author weights:
torchrun --nproc_per_node 1 --nnodes 1 cascade_evaluation.py --dataset middlebury2014-train --batch-size 1 --dataset-root $dataset_root --model crestereo_base --weights CREStereo_Base_Weights.MEGVII_V1
will yield for recursive iterations and 1 cascade:
'mae': 0.792, 'rmse': 2.765, '1px': 0.905, '3px': 0.958, '5px': 0.97, 'relepe': 0.114, 'fl-all': 90.429