Skip to content

Commit 7269906

Browse files
authored
Merge pull request #25 from sebdotv/minor-fixes
Minor fixes
2 parents 28ebc14 + 4a320f0 commit 7269906

File tree

3 files changed

+10
-3
lines changed

3 files changed

+10
-3
lines changed

Dockerfile

+3
Original file line numberDiff line numberDiff line change
@@ -21,5 +21,8 @@ COPY authorized_users.txt .
2121
# Start the proxy server as entrypoint
2222
ENTRYPOINT ["ollama_proxy_server"]
2323

24+
# Do not buffer output, e.g. logs to stdout
25+
ENV PYTHONUNBUFFERED=1
26+
2427
# Set command line parameters
2528
CMD ["--config", "./config.ini", "--users_list", "./authorized_users.txt", "--port", "8080"]

README.md

+7-1
Original file line numberDiff line numberDiff line change
@@ -86,7 +86,13 @@ docker build -t ollama_proxy_server .
8686
Run the container:
8787

8888
```bash
89-
docker run -p 8000:8000 -v $(pwd)/config.ini:/app/config.ini -v $(pwd)/authorized_users.txt:/app/authorized_users.txt ollama_proxy_server
89+
docker run -p 8080:8080 -v $(pwd)/config.ini:/app/config.ini -v $(pwd)/authorized_users.txt:/app/authorized_users.txt ollama_proxy_server
90+
```
91+
92+
Test that it works:
93+
94+
```bash
95+
curl localhost:8080 -H "Authorization: Bearer user1:0XAXAXAQX5A1F"
9096
```
9197

9298
## Configuration

config.ini

-2
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,8 @@
11
[DefaultServer]
22
url = http://localhost:11434
3-
queue_size = 5
43

54
[SecondaryServer]
65
url = http://localhost:3002
7-
queue_size = 3
86

97
# Add more servers as you need.
108

0 commit comments

Comments
 (0)