Skip to content

Commit 4710080

Browse files
miledxzmiledxz
committed
NFR Test Results for NGF version edge (nginx#2229)
1 parent 0813406 commit 4710080

File tree

16 files changed

+319
-0
lines changed

16 files changed

+319
-0
lines changed

‎tests/results/dp-perf/edge/edge.md

+80
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,80 @@
1+
# Results
2+
3+
## Test environment
4+
5+
NGINX Plus: false
6+
7+
GKE Cluster:
8+
9+
- Node count: 12
10+
- k8s version: v1.29.4-gke.1043004
11+
- vCPUs per node: 16
12+
- RAM per node: 65855012Ki
13+
- Max pods per node: 110
14+
- Zone: us-east1-b
15+
- Instance Type: n2d-standard-16
16+
17+
## Test1: Running latte path based routing
18+
19+
```text
20+
Requests [total, rate, throughput] 30000, 1000.01, 999.98
21+
Duration [total, attack, wait] 30.001s, 30s, 986.95µs
22+
Latencies [min, mean, 50, 90, 95, 99, max] 562.91µs, 940.576µs, 912.579µs, 1.141ms, 1.212ms, 1.375ms, 12.402ms
23+
Bytes In [total, mean] 4770000, 159.00
24+
Bytes Out [total, mean] 0, 0.00
25+
Success [ratio] 100.00%
26+
Status Codes [code:count] 200:30000
27+
Error Set:
28+
```
29+
30+
## Test2: Running coffee header based routing
31+
32+
```text
33+
Requests [total, rate, throughput] 29999, 1000.00, 999.97
34+
Duration [total, attack, wait] 30s, 29.999s, 947.18µs
35+
Latencies [min, mean, 50, 90, 95, 99, max] 602.01µs, 984.263µs, 961.474µs, 1.162ms, 1.221ms, 1.367ms, 16.033ms
36+
Bytes In [total, mean] 4799840, 160.00
37+
Bytes Out [total, mean] 0, 0.00
38+
Success [ratio] 100.00%
39+
Status Codes [code:count] 200:29999
40+
Error Set:
41+
```
42+
43+
## Test3: Running coffee query based routing
44+
45+
```text
46+
Requests [total, rate, throughput] 29999, 1000.03, 1000.00
47+
Duration [total, attack, wait] 29.999s, 29.998s, 875.67µs
48+
Latencies [min, mean, 50, 90, 95, 99, max] 596.74µs, 998.15µs, 983.222µs, 1.188ms, 1.249ms, 1.386ms, 11.616ms
49+
Bytes In [total, mean] 5039832, 168.00
50+
Bytes Out [total, mean] 0, 0.00
51+
Success [ratio] 100.00%
52+
Status Codes [code:count] 200:29999
53+
Error Set:
54+
```
55+
56+
## Test4: Running tea GET method based routing
57+
58+
```text
59+
Requests [total, rate, throughput] 30000, 1000.01, 999.97
60+
Duration [total, attack, wait] 30.001s, 30s, 1.139ms
61+
Latencies [min, mean, 50, 90, 95, 99, max] 611.07µs, 1.005ms, 983.916µs, 1.193ms, 1.257ms, 1.41ms, 19.537ms
62+
Bytes In [total, mean] 4710000, 157.00
63+
Bytes Out [total, mean] 0, 0.00
64+
Success [ratio] 100.00%
65+
Status Codes [code:count] 200:30000
66+
Error Set:
67+
```
68+
69+
## Test5: Running tea POST method based routing
70+
71+
```text
72+
Requests [total, rate, throughput] 30000, 1000.04, 1000.00
73+
Duration [total, attack, wait] 30s, 29.999s, 967.36µs
74+
Latencies [min, mean, 50, 90, 95, 99, max] 595.57µs, 999.204µs, 982.831µs, 1.192ms, 1.255ms, 1.392ms, 14.948ms
75+
Bytes In [total, mean] 4710000, 157.00
76+
Bytes Out [total, mean] 0, 0.00
77+
Success [ratio] 100.00%
78+
Status Codes [code:count] 200:30000
79+
Error Set:
80+
```

‎tests/results/ngf-upgrade/edge/edge.md

+45
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,45 @@
1+
# Results
2+
3+
## Test environment
4+
5+
NGINX Plus: false
6+
7+
GKE Cluster:
8+
9+
- Node count: 12
10+
- k8s version: v1.29.4-gke.1043004
11+
- vCPUs per node: 16
12+
- RAM per node: 65855012Ki
13+
- Max pods per node: 110
14+
- Zone: us-east1-b
15+
- Instance Type: n2d-standard-16
16+
17+
## Test: Send http /coffee traffic
18+
19+
```text
20+
Requests [total, rate, throughput] 6000, 100.02, 100.01
21+
Duration [total, attack, wait] 59.991s, 59.991s, 878.01µs
22+
Latencies [min, mean, 50, 90, 95, 99, max] 687.75µs, 1.202ms, 1.174ms, 1.401ms, 1.463ms, 1.613ms, 12.928ms
23+
Bytes In [total, mean] 960000, 160.00
24+
Bytes Out [total, mean] 0, 0.00
25+
Success [ratio] 100.00%
26+
Status Codes [code:count] 200:6000
27+
Error Set:
28+
```
29+
30+
![http.png](http.png)
31+
32+
## Test: Send https /tea traffic
33+
34+
```text
35+
Requests [total, rate, throughput] 6000, 100.02, 100.01
36+
Duration [total, attack, wait] 59.991s, 59.99s, 966.11µs
37+
Latencies [min, mean, 50, 90, 95, 99, max] 603.69µs, 1.182ms, 1.153ms, 1.384ms, 1.449ms, 1.623ms, 12.779ms
38+
Bytes In [total, mean] 920039, 153.34
39+
Bytes Out [total, mean] 0, 0.00
40+
Success [ratio] 100.00%
41+
Status Codes [code:count] 200:6000
42+
Error Set:
43+
```
44+
45+
![https.png](https.png)

‎tests/results/ngf-upgrade/edge/http.png

4.24 KB
Loading

‎tests/results/ngf-upgrade/edge/https.png

4.24 KB
Loading

‎tests/results/scale/edge/TestScale_HTTPRoutes/cpu.png

8.12 KB
Loading

‎tests/results/scale/edge/TestScale_HTTPRoutes/memory.png

6.96 KB
Loading

‎tests/results/scale/edge/TestScale_HTTPRoutes/ttr.png

6.6 KB
Loading

‎tests/results/scale/edge/TestScale_HTTPSListeners/cpu.png

7.01 KB
Loading

‎tests/results/scale/edge/TestScale_HTTPSListeners/memory.png

5.96 KB
Loading

‎tests/results/scale/edge/TestScale_HTTPSListeners/ttr.png

8.61 KB
Loading

‎tests/results/scale/edge/TestScale_Listeners/cpu.png

6.71 KB
Loading

‎tests/results/scale/edge/TestScale_Listeners/memory.png

5.95 KB
Loading

‎tests/results/scale/edge/TestScale_Listeners/ttr.png

8.48 KB
Loading

‎tests/results/scale/edge/TestScale_UpstreamServers/cpu.png

6.23 KB
Loading

‎tests/results/scale/edge/TestScale_UpstreamServers/memory.png

5.18 KB
Loading

‎tests/results/scale/edge/edge.md

+194
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,194 @@
1+
# Results
2+
3+
## Test environment
4+
5+
NGINX Plus: false
6+
7+
GKE Cluster:
8+
9+
- Node count: 12
10+
- k8s version: v1.29.4-gke.1043004
11+
- vCPUs per node: 16
12+
- RAM per node: 65855012Ki
13+
- Max pods per node: 110
14+
- Zone: us-east1-b
15+
- Instance Type: n2d-standard-16
16+
17+
## Test TestScale_Listeners
18+
19+
### Reloads
20+
21+
- Total: 127
22+
- Total Errors: 0
23+
- Average Time: 148ms
24+
- Reload distribution:
25+
- 500ms: 127
26+
- 1000ms: 127
27+
- 5000ms: 127
28+
- 10000ms: 127
29+
- 30000ms: 127
30+
- +Infms: 127
31+
32+
### Event Batch Processing
33+
34+
- Total: 386
35+
- Average Time: 131ms
36+
- Event Batch Processing distribution:
37+
- 500ms: 349
38+
- 1000ms: 386
39+
- 5000ms: 386
40+
- 10000ms: 386
41+
- 30000ms: 386
42+
- +Infms: 386
43+
44+
### Errors
45+
46+
- NGF errors: 0
47+
- NGF container restarts: 0
48+
- NGINX errors: 0
49+
- NGINX container restarts: 0
50+
51+
### Graphs and Logs
52+
53+
See [output directory](./TestScale_Listeners) for more details.
54+
The logs are attached only if there are errors.
55+
56+
## Test TestScale_HTTPSListeners
57+
58+
### Reloads
59+
60+
- Total: 128
61+
- Total Errors: 0
62+
- Average Time: 179ms
63+
- Reload distribution:
64+
- 500ms: 128
65+
- 1000ms: 128
66+
- 5000ms: 128
67+
- 10000ms: 128
68+
- 30000ms: 128
69+
- +Infms: 128
70+
71+
### Event Batch Processing
72+
73+
- Total: 451
74+
- Average Time: 128ms
75+
- Event Batch Processing distribution:
76+
- 500ms: 404
77+
- 1000ms: 448
78+
- 5000ms: 451
79+
- 10000ms: 451
80+
- 30000ms: 451
81+
- +Infms: 451
82+
83+
### Errors
84+
85+
- NGF errors: 0
86+
- NGF container restarts: 0
87+
- NGINX errors: 0
88+
- NGINX container restarts: 0
89+
90+
### Graphs and Logs
91+
92+
See [output directory](./TestScale_HTTPSListeners) for more details.
93+
The logs are attached only if there are errors.
94+
95+
## Test TestScale_HTTPRoutes
96+
97+
### Reloads
98+
99+
- Total: 1001
100+
- Total Errors: 0
101+
- Average Time: 397ms
102+
- Reload distribution:
103+
- 500ms: 693
104+
- 1000ms: 1001
105+
- 5000ms: 1001
106+
- 10000ms: 1001
107+
- 30000ms: 1001
108+
- +Infms: 1001
109+
110+
### Event Batch Processing
111+
112+
- Total: 1008
113+
- Average Time: 450ms
114+
- Event Batch Processing distribution:
115+
- 500ms: 599
116+
- 1000ms: 1008
117+
- 5000ms: 1008
118+
- 10000ms: 1008
119+
- 30000ms: 1008
120+
- +Infms: 1008
121+
122+
### Errors
123+
124+
- NGF errors: 0
125+
- NGF container restarts: 0
126+
- NGINX errors: 0
127+
- NGINX container restarts: 0
128+
129+
### Graphs and Logs
130+
131+
See [output directory](./TestScale_HTTPRoutes) for more details.
132+
The logs are attached only if there are errors.
133+
134+
## Test TestScale_UpstreamServers
135+
136+
### Reloads
137+
138+
- Total: 98
139+
- Total Errors: 0
140+
- Average Time: 127ms
141+
- Reload distribution:
142+
- 500ms: 98
143+
- 1000ms: 98
144+
- 5000ms: 98
145+
- 10000ms: 98
146+
- 30000ms: 98
147+
- +Infms: 98
148+
149+
### Event Batch Processing
150+
151+
- Total: 101
152+
- Average Time: 275ms
153+
- Event Batch Processing distribution:
154+
- 500ms: 99
155+
- 1000ms: 100
156+
- 5000ms: 101
157+
- 10000ms: 101
158+
- 30000ms: 101
159+
- +Infms: 101
160+
161+
### Errors
162+
163+
- NGF errors: 0
164+
- NGF container restarts: 0
165+
- NGINX errors: 0
166+
- NGINX container restarts: 0
167+
168+
### Graphs and Logs
169+
170+
See [output directory](./TestScale_UpstreamServers) for more details.
171+
The logs are attached only if there are errors.
172+
173+
## Test TestScale_HTTPMatches
174+
175+
```text
176+
Requests [total, rate, throughput] 30000, 1000.02, 999.99
177+
Duration [total, attack, wait] 30s, 29.999s, 997.73µs
178+
Latencies [min, mean, 50, 90, 95, 99, max] 562.3µs, 982.897µs, 935.099µs, 1.154ms, 1.224ms, 1.418ms, 21.942ms
179+
Bytes In [total, mean] 4800000, 160.00
180+
Bytes Out [total, mean] 0, 0.00
181+
Success [ratio] 100.00%
182+
Status Codes [code:count] 200:30000
183+
Error Set:
184+
```
185+
```text
186+
Requests [total, rate, throughput] 30000, 1000.03, 999.99
187+
Duration [total, attack, wait] 30s, 29.999s, 1.259ms
188+
Latencies [min, mean, 50, 90, 95, 99, max] 674.09µs, 1.061ms, 1.035ms, 1.258ms, 1.322ms, 1.488ms, 16.879ms
189+
Bytes In [total, mean] 4800000, 160.00
190+
Bytes Out [total, mean] 0, 0.00
191+
Success [ratio] 100.00%
192+
Status Codes [code:count] 200:30000
193+
Error Set:
194+
```

0 commit comments

Comments
 (0)