Skip to content

Add CREStereo weights. #6629

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 13 commits into from
Sep 23, 2022
Merged

Conversation

TeodorPoncu
Copy link
Contributor

@TeodorPoncu TeodorPoncu commented Sep 22, 2022

This PR includes a CREStereo weight-template pointing towards the author provided weights and reference script trained weights.

Test commands are as following:

Reference base weights:
torchrun --nproc_per_node 1 --nnodes 1 cascade_evaluation.py --dataset middlebury2014-train --batch-size 1 --dataset-root $dataset_root --model crestereo_base --weights CREStereo_Base_Weights.CRESTEREO_ETH_MBL_V1

will yield for 10 recursive iterations and 1 cascade:
'mae': 1.416, 'rmse': 3.53, '1px': 0.777, '3px': 0.896, '5px': 0.933, 'relepe': 0.148, 'fl-all': 78.388

Reference finetuned weights:
torchrun --nproc_per_node 1 --nnodes 1 cascade_evaluation.py --dataset middlebury2014-train --batch-size 1 --dataset-root $dataset_root --model crestereo_base --weights CREStereo_Base_Weights.CRESTEREO_FINETUNE_MULTI_V1

will yield for 10 recursive iterations and 1 cascade:
'mae': 1.02, 'rmse': 3.073, '1px': 0.854, '3px': 0.938, '5px': 0.96, 'relepe': 0.129, 'fl-all': 86.042

Author weights:
torchrun --nproc_per_node 1 --nnodes 1 cascade_evaluation.py --dataset middlebury2014-train --batch-size 1 --dataset-root $dataset_root --model crestereo_base --weights CREStereo_Base_Weights.MEGVII_V1

will yield for recursive iterations and 1 cascade:
'mae': 0.792, 'rmse': 2.765, '1px': 0.905, '3px': 0.958, '5px': 0.97, 'relepe': 0.114, 'fl-all': 90.429

Copy link
Contributor

@YosuaMichael YosuaMichael left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @TeodorPoncu , thanks for the PR! Could you give the command that you use to test and get those numbers on the PR description? (see #5793 for example)

Copy link
Contributor

@jdsgomes jdsgomes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks

Copy link
Contributor

@YosuaMichael YosuaMichael left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @TeodorPoncu , the PR looks good to me!
I have a minor NIT, but I will approve to unblock.

"relepe": 0.114,
"fl-all": 90.429,
"_detailed": {
1: {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

NIT, lets give comment indicating that 1 is the number of cascade

@TeodorPoncu TeodorPoncu merged commit 4c66712 into pytorch:main Sep 23, 2022
@github-actions
Copy link

Hey @TeodorPoncu!

You merged this PR, but no labels were added. The list of valid labels is available at https://github.com/pytorch/vision/blob/main/.github/process_commit.py

facebook-github-bot pushed a commit that referenced this pull request Sep 29, 2022
Summary:
* added crestereo author weights

* update weights name

* synced fl-all metric

* changed resize size config param name

* extended weight sets

* changed weight link

Reviewed By: YosuaMichael

Differential Revision: D39885429

fbshipit-source-id: 7d268ce2121101cb30b2aab5b99c70637182a2a1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants