Skip to content

Adding the support tracing of child models invoked from a BLS model #277

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Aug 7, 2023

Conversation

oandreeva-nv
Copy link
Contributor

To allow tracing for sub models, user must provide request when creating InferenceRequest object in python model.
Sample:

for request in requests:
           ...

            infer_request = pb_utils.InferenceRequest(
                model_name=model_name_string,
                requested_output_names=["OUTPUT0", "OUTPUT1"],
                inputs=[in_0, in_1],
                request=request)

This is necessary, because request has an access to the main trace. Open to the discussion on this.

@oandreeva-nv oandreeva-nv force-pushed the oandreeva_bls_tracing branch from cf4bca7 to 6950941 Compare July 21, 2023 00:03
@oandreeva-nv oandreeva-nv requested a review from Tabrizian July 21, 2023 00:23
@oandreeva-nv oandreeva-nv merged commit 3ac4eb1 into main Aug 7, 2023
@Tabrizian Tabrizian deleted the oandreeva_bls_tracing branch August 10, 2023 19:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

6 participants