Degraded node network throughput when retin is installed

[grzesuav]

Describe the bug
Along with 1.29 AKS upgrade, retina agens was installed on our nodes, which resulted in degraded network throughput, details in Azure/AKS#4508

To Reproduce
See related issue - Azure/AKS#4508
Expected behavior
Network throughput not impacted by retina

Screenshots
See related issue - Azure/AKS#4508

Platform (please complete the following information):

• OS: [AKSUbuntu]
• Kubernetes Version: [1.29/1.30]
• Host: AKS
• Retina Version:

Additional context
Add any other context about the problem here.

[vakalapa]

@grzesuav thanks for reporting the issue, can you give me some more information on if the perf degrade is within same Node, or with traffic between different nodes? We know that intra node has some affect with eBPF programs as there is no noise and it even a small ebpf prog can affect the line rate.

If the perf degrade you saw was in INTER node communication, we can run some tests based on criteria you provide. We can then root cause it to which one or more eBPF progs could be causing this issue.

[grzesuav]

@vakalapa as far I can tell it was between inter node and Azure (blob storage) - however I cannot say fo 100%. We have some internal S3 like app which is using azure blob as backend. The graphs from Azure/AKS#4508 shows network throughput of this app - not sure what more I can provide - as you can see there the overall throughput is very high

[grzesuav]

hi, is there any update on this ?

[vakalapa]

We are working on the performance pipeline for public test results. We were still unable to repro the issue, @ritwikranjan plz tie this issue to your performance pipeline work ?