Skip to content

Commit

Permalink
NFR Test Results for NGF version edge (#2393)
Browse files Browse the repository at this point in the history
  • Loading branch information
@nginx-bot
nginx-bot authored Aug 14, 2024
1 parent 6625a41 commit 7697510
Show file tree
Hide file tree
Showing 70 changed files with 6,482 additions and 175 deletions.
45 changes: 26 additions & 19 deletions tests/results/dp-perf/edge/edge-oss.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -4,10 +4,16 @@

NGINX Plus: false

NGINX Gateway Fabric:

- Commit: 9a85dbcc0797e31557a3731688795aa166ee0f96
- Date: 2024-08-13T21:12:05Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.29.6-gke.1038001
- k8s version: v1.29.6-gke.1326000
- vCPUs per node: 16
- RAM per node: 65855012Ki
- Max pods per node: 110
Expand All @@ -17,22 +23,23 @@ GKE Cluster:
## Test1: Running latte path based routing

```text
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 624.318µs
Latencies [min, mean, 50, 90, 95, 99, max] 496.907µs, 666.131µs, 651.971µs, 742.531µs, 778.713µs, 872.635µs, 11.772ms
Bytes In [total, mean] 4770000, 159.00
Requests [total, rate, throughput] 30000, 1000.01, 999.79
Duration [total, attack, wait] 30s, 30s, 701.442µs
Latencies [min, mean, 50, 90, 95, 99, max] 341.042µs, 737.394µs, 718.76µs, 827.697µs, 866.432µs, 962.831µs, 16.145ms
Bytes In [total, mean] 4769946, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Success [ratio] 99.98%
Status Codes [code:count] 200:29994 502:6
Error Set:
502 Bad Gateway
```

## Test2: Running coffee header based routing

```text
Requests [total, rate, throughput] 30000, 1000.03, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 697.125µs
Latencies [min, mean, 50, 90, 95, 99, max] 520.741µs, 681.361µs, 670.45µs, 761.428µs, 795.946µs, 884.223µs, 9.626ms
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 687.856µs
Latencies [min, mean, 50, 90, 95, 99, max] 554.445µs, 759.558µs, 740.252µs, 848.701µs, 889.401µs, 997.689µs, 22.657ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -43,9 +50,9 @@ Error Set:
## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 999.99
Duration [total, attack, wait] 30s, 29.999s, 753.834µs
Latencies [min, mean, 50, 90, 95, 99, max] 523.903µs, 693.564µs, 681.217µs, 776.952µs, 817.06µs, 913.016µs, 6.02ms
Requests [total, rate, throughput] 30000, 1000.04, 1000.02
Duration [total, attack, wait] 29.999s, 29.999s, 726.197µs
Latencies [min, mean, 50, 90, 95, 99, max] 550.722µs, 769.327µs, 747.389µs, 857.742µs, 898.394µs, 1.015ms, 13.026ms
Bytes In [total, mean] 5040000, 168.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -56,9 +63,9 @@ Error Set:
## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 680.402µs
Latencies [min, mean, 50, 90, 95, 99, max] 511.054µs, 680.638µs, 669.25µs, 763.254µs, 800.238µs, 900.815µs, 5.474ms
Requests [total, rate, throughput] 30000, 1000.00, 999.98
Duration [total, attack, wait] 30.001s, 30s, 705.904µs
Latencies [min, mean, 50, 90, 95, 99, max] 539.272µs, 750.546µs, 734.78µs, 841.798µs, 880.351µs, 979.455µs, 16.567ms
Bytes In [total, mean] 4710000, 157.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -69,9 +76,9 @@ Error Set:
## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 726.41µs
Latencies [min, mean, 50, 90, 95, 99, max] 511.128µs, 684.525µs, 671.866µs, 765.429µs, 801.43µs, 904.838µs, 10.938ms
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 772.597µs
Latencies [min, mean, 50, 90, 95, 99, max] 541.485µs, 752.07µs, 740.31µs, 847.409µs, 886.955µs, 981.786µs, 12.398ms
Bytes In [total, mean] 4710000, 157.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand Down
46 changes: 26 additions & 20 deletions tests/results/dp-perf/edge/edge-plus.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -4,10 +4,16 @@

NGINX Plus: true

NGINX Gateway Fabric:

- Commit: 9a85dbcc0797e31557a3731688795aa166ee0f96
- Date: 2024-08-13T21:12:05Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.29.6-gke.1038001
- k8s version: v1.29.6-gke.1326000
- vCPUs per node: 16
- RAM per node: 65855012Ki
- Max pods per node: 110
Expand All @@ -17,10 +23,10 @@ GKE Cluster:
## Test1: Running latte path based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 766.8µs
Latencies [min, mean, 50, 90, 95, 99, max] 535.083µs, 732.524µs, 709.951µs, 801.487µs, 837.721µs, 978.661µs, 19.138ms
Bytes In [total, mean] 4770000, 159.00
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 682.261µs
Latencies [min, mean, 50, 90, 95, 99, max] 515.366µs, 729.019µs, 712.033µs, 843.484µs, 895.476µs, 1.019ms, 9.154ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -30,10 +36,10 @@ Error Set:
## Test2: Running coffee header based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 750.962µs
Latencies [min, mean, 50, 90, 95, 99, max] 569.894µs, 751.471µs, 737.453µs, 830.219µs, 865.522µs, 975.891µs, 13.021ms
Bytes In [total, mean] 4800000, 160.00
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 599.51µs
Latencies [min, mean, 50, 90, 95, 99, max] 540.423µs, 740.62µs, 724.16µs, 857.72µs, 911.755µs, 1.042ms, 7.517ms
Bytes In [total, mean] 4830000, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -43,10 +49,10 @@ Error Set:
## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 30000, 1000.00, 999.98
Duration [total, attack, wait] 30.001s, 30s, 795.267µs
Latencies [min, mean, 50, 90, 95, 99, max] 566.893µs, 746.284µs, 731.685µs, 821.144µs, 856.146µs, 949.534µs, 18.228ms
Bytes In [total, mean] 5040000, 168.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.02
Duration [total, attack, wait] 29.999s, 29.999s, 683.488µs
Latencies [min, mean, 50, 90, 95, 99, max] 523.729µs, 756.497µs, 740.664µs, 870.743µs, 921.816µs, 1.062ms, 12.337ms
Bytes In [total, mean] 5070000, 169.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -57,9 +63,9 @@ Error Set:

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 733.608µs
Latencies [min, mean, 50, 90, 95, 99, max] 545.997µs, 736.79µs, 725.161µs, 816.5µs, 852.368µs, 950.282µs, 9.048ms
Bytes In [total, mean] 4710000, 157.00
Duration [total, attack, wait] 30.001s, 30s, 762.485µs
Latencies [min, mean, 50, 90, 95, 99, max] 499.61µs, 744.201µs, 726.564µs, 862.287µs, 914.928µs, 1.054ms, 7.531ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -69,10 +75,10 @@ Error Set:
## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 743.446µs
Latencies [min, mean, 50, 90, 95, 99, max] 553.99µs, 726.832µs, 715.508µs, 802.061µs, 835.171µs, 926.755µs, 8.575ms
Bytes In [total, mean] 4710000, 157.00
Requests [total, rate, throughput] 30000, 1000.01, 999.99
Duration [total, attack, wait] 30s, 30s, 651.893µs
Latencies [min, mean, 50, 90, 95, 99, max] 532.673µs, 751.908µs, 734.466µs, 872.179µs, 927.874µs, 1.068ms, 6.327ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand Down
24 changes: 15 additions & 9 deletions tests/results/ngf-upgrade/edge/edge-oss.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -4,10 +4,16 @@

NGINX Plus: false

NGINX Gateway Fabric:

- Commit: 9a85dbcc0797e31557a3731688795aa166ee0f96
- Date: 2024-08-13T21:12:05Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.29.6-gke.1038001
- k8s version: v1.29.6-gke.1326000
- vCPUs per node: 16
- RAM per node: 65855012Ki
- Max pods per node: 110
Expand All @@ -17,29 +23,29 @@ GKE Cluster:
## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 799.917µs
Latencies [min, mean, 50, 90, 95, 99, max] 450.094µs, 821.717µs, 823.258µs, 951.13µs, 997.824µs, 1.126ms, 11.934ms
Bytes In [total, mean] 920025, 153.34
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 763.57µs
Latencies [min, mean, 50, 90, 95, 99, max] 631.935µs, 834.342µs, 818.106µs, 916.549µs, 953.194µs, 1.06ms, 12.108ms
Bytes In [total, mean] 918000, 153.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Error Set:
```

![https.png](https.png)
![https-oss.png](https-oss.png)

## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 794.113µs
Latencies [min, mean, 50, 90, 95, 99, max] 618.014µs, 872.17µs, 856.784µs, 991.181µs, 1.038ms, 1.148ms, 12.075ms
Duration [total, attack, wait] 59.991s, 59.99s, 761.784µs
Latencies [min, mean, 50, 90, 95, 99, max] 605.288µs, 828.183µs, 816.906µs, 927.903µs, 968.164µs, 1.089ms, 3.097ms
Bytes In [total, mean] 960000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Error Set:
```

![http.png](http.png)
![http-oss.png](http-oss.png)
24 changes: 15 additions & 9 deletions tests/results/ngf-upgrade/edge/edge-plus.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -4,10 +4,16 @@

NGINX Plus: true

NGINX Gateway Fabric:

- Commit: 9a85dbcc0797e31557a3731688795aa166ee0f96
- Date: 2024-08-13T21:12:05Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.29.6-gke.1038001
- k8s version: v1.29.6-gke.1326000
- vCPUs per node: 16
- RAM per node: 65855012Ki
- Max pods per node: 110
Expand All @@ -17,10 +23,10 @@ GKE Cluster:
## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 867.428µs
Latencies [min, mean, 50, 90, 95, 99, max] 653.414µs, 901.844µs, 879.015µs, 1.006ms, 1.051ms, 1.18ms, 12.8ms
Bytes In [total, mean] 919993, 153.33
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 921.041µs
Latencies [min, mean, 50, 90, 95, 99, max] 616.005µs, 851.643µs, 821.167µs, 986.363µs, 1.055ms, 1.241ms, 12.227ms
Bytes In [total, mean] 921995, 153.67
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Expand All @@ -32,10 +38,10 @@ Error Set:
## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 839.172µs
Latencies [min, mean, 50, 90, 95, 99, max] 421.992µs, 816.859µs, 820.308µs, 942.646µs, 983.206µs, 1.111ms, 11.939ms
Bytes In [total, mean] 960000, 160.00
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 902.051µs
Latencies [min, mean, 50, 90, 95, 99, max] 483.51µs, 832.015µs, 814.172µs, 976.685µs, 1.031ms, 1.193ms, 12.788ms
Bytes In [total, mean] 966000, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Expand Down
Binary file modified tests/results/ngf-upgrade/edge/http-oss.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/http-plus.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-oss.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-plus.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading

0 comments on commit 7697510

Please sign in to comment.