This repository was archived by the owner on Mar 19, 2024. It is now read-only.
Adding a hook to profile memory usage #175
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Differential Revision: D26236748 fbshipit-source-id: 1a230c00bedd117ec142acdcbbca1386e79a9776
Differential Revision: D26276800 fbshipit-source-id: d6d9055600aabec2d338234ed8537fe77a2b1ecd
Differential Revision: D26276803 fbshipit-source-id: 4e7c92f88275806eb9adc23530ec7749414c700b
Summary: recently nvidia-smi was removed from fb cluster making it hard to see what the memory utilization was. using pytorch, we extract the information at various steps of training. the profiling hook is currently experimental and we will use it and adapt it for more better usability. down the line, we can move it to classy vision when the hook is trusted to be useful + changed accordingly Differential Revision: D26284304 fbshipit-source-id: 85b1454d3e6949ea2c131ccea1e3373e50cc6fce
facebook-github-bot
added
fb-exported
CLA Signed
|
This pull request was exported from Phabricator. Differential Revision: D26284304 |
facebook-github-bot
pushed a commit
that referenced
this pull request
Feb 9, 2021
Summary: Pull Request resolved: #175 recently nvidia-smi was removed from fb cluster making it hard to see what the memory utilization was. using pytorch, we extract the information at various steps of training. the profiling hook is currently experimental and we will use it and adapt it for more better usability. down the line, we can move it to classy vision when the hook is trusted to be useful + changed accordingly Reviewed By: min-xu-ai Differential Revision: D26284304 fbshipit-source-id: 1a8c3cd12a498fc55999e982a6c072723d54d144
facebook-github-bot
pushed a commit
that referenced
this pull request
Aug 3, 2021
…ures (#175) Summary: Correctly rely on config.MODEL.FEATURE_EVAL_SETTINGS.SHOULD_FLATTEN_FEATS to decide whether or not to flatten the features: In addition: - add options at loading of features to decide if we should flatten - add unit tests to ensure the right behaviour Pull Request resolved: fairinternal/ssl_scaling#175 Reviewed By: iseessel Differential Revision: D30069587 Pulled By: QuentinDuval fbshipit-source-id: 044389c46c5c1e658141c599545dc72c5c50dff2
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary: recently nvidia-smi was removed from fb cluster making it hard to see what the memory utilization was. using pytorch, we extract the information at various steps of training. the profiling hook is currently experimental and we will use it and adapt it for more better usability. down the line, we can move it to classy vision when the hook is trusted to be useful + changed accordingly
Differential Revision: D26284304