[Task]: Refactor kubernetes kafka External load balancer dependency in tests

[damondouglas]

What needs to happen?

This task explores and refactors .test-infra/kubernetes/kafka-cluster use of type LoadBalancer to NodePort. This task may relate to #19465.

Below are measures of ready and done.

Ready

• Inventory tests that depend on .test-infra/kubernetes/kafka-cluster kubernetes Service
• Inventory .test-infra containing scripts that execute kubectl get svc <service> '-ojsonpath={.status.loadBalancer.ingress[*].ip}'
• Inventory GKE cluster network and kafka related tests Dataflow jobs network provisioning

Done

• Refactor .test-infra/kubernetes/kafka-cluster to kubernetes Service NodePort
• Refactor kubectl get svc scripts to query NodePort IP and port
• Refactor Google Cloud virtual private cloud (VPC) network usage, if needed, based on network provisioning findings

Issue Priority

Priority: 2 (default / most normal work should be filed as P2)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[damondouglas]

.take-issue

[damondouglas]

Unassigned this issue as its fix requires access to the jenkins environment for efficient debugging and testing that I do not have at this time.