Skip to content

Commit 340d139

Browse files
feat(client): increase default HTTP max_connections to 1000 and max_keepalive_connections to 100 (#1281)
1 parent 94cd528 commit 340d139

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/openai/_constants.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
# default timeout is 10 minutes
99
DEFAULT_TIMEOUT = httpx.Timeout(timeout=600.0, connect=5.0)
1010
DEFAULT_MAX_RETRIES = 2
11-
DEFAULT_CONNECTION_LIMITS = httpx.Limits(max_connections=100, max_keepalive_connections=20)
11+
DEFAULT_CONNECTION_LIMITS = httpx.Limits(max_connections=1000, max_keepalive_connections=100)
1212

1313
INITIAL_RETRY_DELAY = 0.5
1414
MAX_RETRY_DELAY = 8.0

0 commit comments

Comments
 (0)