Add option to set desired GPU count #21
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR modifies the application to allow setting the desired GPU count via an functional option.
Since having a variable in the New function about gpu count makes it look like a required parameter, it is better to set it via an option instead.
Summary
If the desired GPU count is not set via environment variables, it defaults to 0.
When the desired GPU count is 0, GPU count checking is skipped.
This enables node-agent to run in both GPU and non-GPU environments.
Behavior
GPU environments:
Non-GPU environments:
This enhancement improves flexibility by supporting both GPU-equipped and non-GPU environments seamlessly.
This is not urgent, so it's fine to include it with the next release.