NFR Test Results for NGF version 1.4.0

tests/results/dp-perf/1.4.0/1.4.0-oss.md

@@ -0,0 +1,90 @@
+# Results
+
+## Test environment
+
+NGINX Plus: false
+
+NGINX Gateway Fabric:
+
+- Commit: 16a95222a968aef46277a77070f79bea9b87da12
+- Date: 2024-08-16T15:29:44Z
+- Dirty: false
+
+GKE Cluster:
+
+- Node count: 12
+- k8s version: v1.29.7-gke.1008000
+- vCPUs per node: 16
+- RAM per node: 65855012Ki
+- Max pods per node: 110
+- Zone: us-west1-b
+- Instance Type: n2d-standard-16
+
+## Summary:
+
+- Performance seems to have improved.
+
+## Test1: Running latte path based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.04, 1000.01
+Duration      [total, attack, wait]             30s, 29.999s, 791.901µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  512.393µs, 734.831µs, 721.822µs, 819.183µs, 855.351µs, 951.452µs, 13.787ms
+Bytes In      [total, mean]                     4830000, 161.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```
+
+## Test2: Running coffee header based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.03, 1000.01
+Duration      [total, attack, wait]             30s, 29.999s, 701.809µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  579.713µs, 757.73µs, 746.299µs, 837.969µs, 873.063µs, 990.77µs, 8.953ms
+Bytes In      [total, mean]                     4860000, 162.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```
+
+## Test3: Running coffee query based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.04, 1000.01
+Duration      [total, attack, wait]             30s, 29.999s, 794.296µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  574.209µs, 766.349µs, 749.009µs, 851.856µs, 891.805µs, 1.011ms, 19.207ms
+Bytes In      [total, mean]                     5100000, 170.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```
+
+## Test4: Running tea GET method based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.02, 1000.00
+Duration      [total, attack, wait]             30s, 29.999s, 691.197µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  528.655µs, 742.271µs, 732.036µs, 826.113µs, 861.108µs, 954.498µs, 10.955ms
+Bytes In      [total, mean]                     4770000, 159.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```
+
+## Test5: Running tea POST method based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.00, 999.98
+Duration      [total, attack, wait]             30.001s, 30s, 635.237µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  570.721µs, 765.885µs, 751.85µs, 855.286µs, 896.876µs, 1.012ms, 12.648ms
+Bytes In      [total, mean]                     4770000, 159.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```

tests/results/dp-perf/1.4.0/1.4.0-plus.md

@@ -0,0 +1,90 @@
+# Results
+
+## Test environment
+
+NGINX Plus: true
+
+NGINX Gateway Fabric:
+
+- Commit: 16a95222a968aef46277a77070f79bea9b87da12
+- Date: 2024-08-16T15:29:44Z
+- Dirty: false
+
+GKE Cluster:
+
+- Node count: 12
+- k8s version: v1.29.7-gke.1008000
+- vCPUs per node: 16
+- RAM per node: 65855012Ki
+- Max pods per node: 110
+- Zone: us-west1-b
+- Instance Type: n2d-standard-16
+
+## Summary:
+
+- Performance seems to have improved.
+
+## Test1: Running latte path based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.01, 999.99
+Duration      [total, attack, wait]             30s, 30s, 563.254µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  485.302µs, 666.323µs, 637.029µs, 721.283µs, 754.013µs, 863.087µs, 15.211ms
+Bytes In      [total, mean]                     4800000, 160.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```
+
+## Test2: Running coffee header based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.01, 999.98
+Duration      [total, attack, wait]             30s, 30s, 721.605µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  515.404µs, 694.237µs, 678.089µs, 767.846µs, 801.31µs, 903.184µs, 12.586ms
+Bytes In      [total, mean]                     4830000, 161.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```
+
+## Test3: Running coffee query based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.01, 999.99
+Duration      [total, attack, wait]             30s, 30s, 631.83µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  516.613µs, 672.121µs, 656.131µs, 745.518µs, 781.046µs, 879.265µs, 19.659ms
+Bytes In      [total, mean]                     5070000, 169.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```
+
+## Test4: Running tea GET method based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.01, 999.99
+Duration      [total, attack, wait]             30s, 30s, 681.029µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  514.133µs, 659.359µs, 647.028µs, 734.385µs, 769.668µs, 860.748µs, 6.583ms
+Bytes In      [total, mean]                     4740000, 158.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```
+
+## Test5: Running tea POST method based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.03, 1000.01
+Duration      [total, attack, wait]             30s, 29.999s, 595.53µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  516.825µs, 666.438µs, 651.132µs, 733.055µs, 763.861µs, 851.963µs, 14.266ms
+Bytes In      [total, mean]                     4740000, 158.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```

tests/results/ngf-upgrade/1.4.0/1.4.0-oss.md

@@ -0,0 +1,55 @@
+# Results
+
+## Test environment
+
+NGINX Plus: false
+
+NGINX Gateway Fabric:
+
+- Commit: 16a95222a968aef46277a77070f79bea9b87da12
+- Date: 2024-08-16T15:29:44Z
+- Dirty: false
+
+GKE Cluster:
+
+- Node count: 12
+- k8s version: v1.29.7-gke.1008000
+- vCPUs per node: 16
+- RAM per node: 65855012Ki
+- Max pods per node: 110
+- Zone: us-west1-b
+- Instance Type: n2d-standard-16
+
+## Summary:
+
+- Performance seems to have improved.
+
+## Test: Send https /tea traffic
+
+```text
+Requests      [total, rate, throughput]         6000, 100.02, 100.01
+Duration      [total, attack, wait]             59.991s, 59.99s, 883.687µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  717.401µs, 1.039ms, 1.012ms, 1.192ms, 1.256ms, 1.426ms, 12.471ms
+Bytes In      [total, mean]                     924000, 154.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:6000  
+Error Set:
+```
+
+![https-oss.png](https-oss.png)
+
+## Test: Send http /coffee traffic
+
+```text
+Requests      [total, rate, throughput]         6000, 100.02, 100.01
+Duration      [total, attack, wait]             59.991s, 59.99s, 886.936µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  686.413µs, 949.204µs, 930.943µs, 1.071ms, 1.125ms, 1.246ms, 14.436ms
+Bytes In      [total, mean]                     967939, 161.32
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:6000  
+Error Set:
+```
+
+![http-oss.png](http-oss.png)

tests/results/ngf-upgrade/1.4.0/1.4.0-plus.md

@@ -0,0 +1,55 @@
+# Results
+
+## Test environment
+
+NGINX Plus: true
+
+NGINX Gateway Fabric:
+
+- Commit: 16a95222a968aef46277a77070f79bea9b87da12
+- Date: 2024-08-16T15:29:44Z
+- Dirty: false
+
+GKE Cluster:
+
+- Node count: 12
+- k8s version: v1.29.7-gke.1008000
+- vCPUs per node: 16
+- RAM per node: 65855012Ki
+- Max pods per node: 110
+- Zone: us-west1-b
+- Instance Type: n2d-standard-16
+
+## Summary:
+
+- Performance seems to have improved.
+
+## Test: Send http /coffee traffic
+
+```text
+Requests      [total, rate, throughput]         6000, 100.02, 100.01
+Duration      [total, attack, wait]             59.991s, 59.99s, 746.557µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  492.426µs, 916.951µs, 894.929µs, 997.453µs, 1.04ms, 1.225ms, 12.566ms
+Bytes In      [total, mean]                     960000, 160.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:6000  
+Error Set:
+```
+
+![http-plus.png](http-plus.png)
+
+## Test: Send https /tea traffic
+
+```text
+Requests      [total, rate, throughput]         6000, 100.02, 100.01
+Duration      [total, attack, wait]             59.991s, 59.99s, 844.339µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  714.591µs, 948.908µs, 919.169µs, 1.03ms, 1.081ms, 1.24ms, 12.421ms
+Bytes In      [total, mean]                     919974, 153.33
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:6000  
+Error Set:
+```
+
+![https-plus.png](https-plus.png)