Skip to content

Commit e67a7e5

Browse files
committed
[Bugfix]: fix missing queue_time_start for requests from grammar_queue
**Motivation** Fixes a bug where requests appended to grammar_queue (typically the first tool call request requiring grammar resolution) do not have queue_time_start set **Changes** - Sets queue_time_start for any incoming request if `add_to_grammar_queue`
1 parent f036582 commit e67a7e5

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

python/sglang/srt/managers/scheduler.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -899,6 +899,7 @@ def handle_generate_request(
899899
add_to_grammar_queue = True
900900

901901
if add_to_grammar_queue:
902+
req.queue_time_start = time.time()
902903
self.grammar_queue.append(req)
903904
else:
904905
self._add_request_to_queue(req)

0 commit comments

Comments
 (0)