NFR Test Results for NGF version edge

nginx · Jan 3, 2025 · dbd66a7 · dbd66a7
1 parent 9a47b6d
commit dbd66a7
Show file tree

Hide file tree

Showing 2 changed files with 223 additions and 186 deletions.
diff --git a/tests/results/reconfig/edge/edge-oss.md b/tests/results/reconfig/edge/edge-oss.md
@@ -6,16 +6,16 @@ NGINX Plus: false
 
 NGINX Gateway Fabric:
 
-- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
-- Date: 2024-11-14T18:42:55Z
+- Commit: 9a47b6d33e6c5e0568af0bfc367e5f1190354b05
+- Date: 2025-01-03T19:08:47Z
 - Dirty: false
 
 GKE Cluster:
 
 - Node count: 12
-- k8s version: v1.30.5-gke.1443001
+- k8s version: v1.30.6-gke.1125000
 - vCPUs per node: 16
-- RAM per node: 65853972Ki
+- RAM per node: 65853984Ki
 - Max pods per node: 110
 - Zone: us-west1-b
 - Instance Type: n2d-standard-16
@@ -27,163 +27,181 @@ GKE Cluster:
 - TimeToReadyTotal: 3s
 - TimeToReadyAvgSingle: < 1s
 - NGINX Reloads: 2
-- NGINX Reload Average Time: 126ms
+- NGINX Reload Average Time: 127ms
 - Reload distribution:
-	- 500ms: 2
-	- 1000ms: 2
-	- 5000ms: 2
-	- 10000ms: 2
-	- 30000ms: 2
+	- 500.0ms: 2
+	- 1000.0ms: 2
+	- 5000.0ms: 2
+	- 10000.0ms: 2
+	- 30000.0ms: 2
 	- +Infms: 2
 
 ### Event Batch Processing
 
 - Event Batch Total: 5
-- Event Batch Processing Average Time: 60ms
+- Event Batch Processing Average Time: 59ms
 - Event Batch Processing distribution:
-	- 500ms: 5
-	- 1000ms: 5
-	- 5000ms: 5
-	- 10000ms: 5
-	- 30000ms: 5
+	- 500.0ms: 5
+	- 1000.0ms: 5
+	- 5000.0ms: 5
+	- 10000.0ms: 5
+	- 30000.0ms: 5
 	- +Infms: 5
 
+### NGINX Error Logs
+
+
 ## Test 1: Resources exist before startup - NumResources 150
 
 ### Reloads and Time to Ready
 
-- TimeToReadyTotal: 2s
+- TimeToReadyTotal: 3s
 - TimeToReadyAvgSingle: < 1s
 - NGINX Reloads: 2
 - NGINX Reload Average Time: 126ms
 - Reload distribution:
-	- 500ms: 2
-	- 1000ms: 2
-	- 5000ms: 2
-	- 10000ms: 2
-	- 30000ms: 2
+	- 500.0ms: 2
+	- 1000.0ms: 2
+	- 5000.0ms: 2
+	- 10000.0ms: 2
+	- 30000.0ms: 2
 	- +Infms: 2
 
 ### Event Batch Processing
 
 - Event Batch Total: 6
 - Event Batch Processing Average Time: 50ms
 - Event Batch Processing distribution:
-	- 500ms: 6
-	- 1000ms: 6
-	- 5000ms: 6
-	- 10000ms: 6
-	- 30000ms: 6
+	- 500.0ms: 6
+	- 1000.0ms: 6
+	- 5000.0ms: 6
+	- 10000.0ms: 6
+	- 30000.0ms: 6
 	- +Infms: 6
 
+### NGINX Error Logs
+
+
 ## Test 2: Start NGF, deploy Gateway, create many resources attached to GW - NumResources 30
 
 ### Reloads and Time to Ready
 
 - TimeToReadyTotal: 8s
 - TimeToReadyAvgSingle: < 1s
-- NGINX Reloads: 52
-- NGINX Reload Average Time: 151ms
+- NGINX Reloads: 53
+- NGINX Reload Average Time: 150ms
 - Reload distribution:
-	- 500ms: 52
-	- 1000ms: 52
-	- 5000ms: 52
-	- 10000ms: 52
-	- 30000ms: 52
-	- +Infms: 52
+	- 500.0ms: 53
+	- 1000.0ms: 53
+	- 5000.0ms: 53
+	- 10000.0ms: 53
+	- 30000.0ms: 53
+	- +Infms: 53
 
 ### Event Batch Processing
 
-- Event Batch Total: 326
+- Event Batch Total: 329
 - Event Batch Processing Average Time: 24ms
 - Event Batch Processing distribution:
-	- 500ms: 326
-	- 1000ms: 326
-	- 5000ms: 326
-	- 10000ms: 326
-	- 30000ms: 326
-	- +Infms: 326
+	- 500.0ms: 329
+	- 1000.0ms: 329
+	- 5000.0ms: 329
+	- 10000.0ms: 329
+	- 30000.0ms: 329
+	- +Infms: 329
+
+### NGINX Error Logs
+
 
 ## Test 2: Start NGF, deploy Gateway, create many resources attached to GW - NumResources 150
 
 ### Reloads and Time to Ready
 
 - TimeToReadyTotal: 43s
 - TimeToReadyAvgSingle: < 1s
-- NGINX Reloads: 283
-- NGINX Reload Average Time: 152ms
+- NGINX Reloads: 287
+- NGINX Reload Average Time: 151ms
 - Reload distribution:
-	- 500ms: 283
-	- 1000ms: 283
-	- 5000ms: 283
-	- 10000ms: 283
-	- 30000ms: 283
-	- +Infms: 283
+	- 500.0ms: 287
+	- 1000.0ms: 287
+	- 5000.0ms: 287
+	- 10000.0ms: 287
+	- 30000.0ms: 287
+	- +Infms: 287
 
 ### Event Batch Processing
 
-- Event Batch Total: 1633
+- Event Batch Total: 1640
 - Event Batch Processing Average Time: 26ms
 - Event Batch Processing distribution:
-	- 500ms: 1633
-	- 1000ms: 1633
-	- 5000ms: 1633
-	- 10000ms: 1633
-	- 30000ms: 1633
-	- +Infms: 1633
+	- 500.0ms: 1640
+	- 1000.0ms: 1640
+	- 5000.0ms: 1640
+	- 10000.0ms: 1640
+	- 30000.0ms: 1640
+	- +Infms: 1640
+
+### NGINX Error Logs
+
 
 ## Test 3: Start NGF, create many resources attached to a Gateway, deploy the Gateway - NumResources 30
 
 ### Reloads and Time to Ready
 
 - TimeToReadyTotal: < 1s
 - TimeToReadyAvgSingle: < 1s
-- NGINX Reloads: 55
-- NGINX Reload Average Time: 148ms
+- NGINX Reloads: 58
+- NGINX Reload Average Time: 139ms
 - Reload distribution:
-	- 500ms: 55
-	- 1000ms: 55
-	- 5000ms: 55
-	- 10000ms: 55
-	- 30000ms: 55
-	- +Infms: 55
+	- 500.0ms: 58
+	- 1000.0ms: 58
+	- 5000.0ms: 58
+	- 10000.0ms: 58
+	- 30000.0ms: 58
+	- +Infms: 58
 
 ### Event Batch Processing
 
-- Event Batch Total: 296
+- Event Batch Total: 300
 - Event Batch Processing Average Time: 27ms
 - Event Batch Processing distribution:
-	- 500ms: 296
-	- 1000ms: 296
-	- 5000ms: 296
-	- 10000ms: 296
-	- 30000ms: 296
-	- +Infms: 296
+	- 500.0ms: 300
+	- 1000.0ms: 300
+	- 5000.0ms: 300
+	- 10000.0ms: 300
+	- 30000.0ms: 300
+	- +Infms: 300
+
+### NGINX Error Logs
+
 
 ## Test 3: Start NGF, create many resources attached to a Gateway, deploy the Gateway - NumResources 150
 
 ### Reloads and Time to Ready
 
 - TimeToReadyTotal: < 1s
 - TimeToReadyAvgSingle: < 1s
-- NGINX Reloads: 294
-- NGINX Reload Average Time: 148ms
+- NGINX Reloads: 324
+- NGINX Reload Average Time: 134ms
 - Reload distribution:
-	- 500ms: 294
-	- 1000ms: 294
-	- 5000ms: 294
-	- 10000ms: 294
-	- 30000ms: 294
-	- +Infms: 294
+	- 500.0ms: 324
+	- 1000.0ms: 324
+	- 5000.0ms: 324
+	- 10000.0ms: 324
+	- 30000.0ms: 324
+	- +Infms: 324
 
 ### Event Batch Processing
 
-- Event Batch Total: 1506
-- Event Batch Processing Average Time: 29ms
+- Event Batch Total: 1520
+- Event Batch Processing Average Time: 28ms
 - Event Batch Processing distribution:
-	- 500ms: 1506
-	- 1000ms: 1506
-	- 5000ms: 1506
-	- 10000ms: 1506
-	- 30000ms: 1506
-	- +Infms: 1506
+	- 500.0ms: 1520
+	- 1000.0ms: 1520
+	- 5000.0ms: 1520
+	- 10000.0ms: 1520
+	- 30000.0ms: 1520
+	- +Infms: 1520
+
+### NGINX Error Logs
+