enhancement(kafka sink): Allow OIDC usage for Kafka (#21103)

* Adding "cmake" and "curl" required for OIDC to work with rdkafka * Revert unneccessary update to rdkafka * Removed cmake-build * Create 21103_kafka_sink_oidc_authentication.enhancement.md * Add oidc to expected spelling * Update license file * Update Cargo.toml --------- Co-authored-by: Jesse Szwedko <[email protected]>
vectordotdev · Aug 20, 2024 · 97558d3 · 97558d3
1 parent 76a525b
commit 97558d3
Show file tree

Hide file tree

Showing 5 changed files with 23 additions and 2 deletions.
diff --git a/.github/actions/spelling/expect.txt b/.github/actions/spelling/expect.txt
@@ -779,6 +779,7 @@ nullishness
 numbackends
 oahd
 oap
+oidc
 OKD
 omfwd
 omitempty

diff --git a/Cargo.lock b/Cargo.lock
diff --git a/Cargo.toml b/Cargo.toml
@@ -324,7 +324,7 @@ postgres-openssl = { version = "0.5.0", default-features = false, features = ["r
 pulsar = { version = "6.3.0", default-features = false, features = ["tokio-runtime", "auth-oauth2", "flate2", "lz4", "snap", "zstd"], optional = true }
 rand = { version = "0.8.5", default-features = false, features = ["small_rng"] }
 rand_distr = { version = "0.4.3", default-features = false }
-rdkafka = { version = "0.35.0", default-features = false, features = ["tokio", "libz", "ssl", "zstd"], optional = true }
+rdkafka = { version = "0.35.0", default-features = false, features = ["curl-static", "tokio", "libz", "ssl", "zstd"], optional = true }
 redis = { version = "0.24.0", default-features = false, features = ["connection-manager", "tokio-comp", "tokio-native-tls-comp"], optional = true }
 regex = { version = "1.10.6", default-features = false, features = ["std", "perf"] }
 roaring = { version = "0.10.6", default-features = false, features = ["std"], optional = true }

diff --git a/LICENSE-3rdparty.csv b/LICENSE-3rdparty.csv
@@ -160,6 +160,7 @@ crypto-common,https://github.com/RustCrypto/traits,MIT OR Apache-2.0,RustCrypto
 crypto_secretbox,https://github.com/RustCrypto/nacl-compat/tree/master/crypto_secretbox,Apache-2.0 OR MIT,RustCrypto Developers
 csv,https://github.com/BurntSushi/rust-csv,Unlicense OR MIT,Andrew Gallant <[email protected]>
 ctr,https://github.com/RustCrypto/block-modes,MIT OR Apache-2.0,RustCrypto Developers
+curl-sys,https://github.com/alexcrichton/curl-rust,MIT,Alex Crichton <[email protected]>
 curve25519-dalek,https://github.com/dalek-cryptography/curve25519-dalek/tree/main/curve25519-dalek,BSD-3-Clause,"Isis Lovecruft <[email protected]>, Henry de Valence <[email protected]>"
 curve25519-dalek-derive,https://github.com/dalek-cryptography/curve25519-dalek,MIT OR Apache-2.0,The curve25519-dalek-derive Authors
 darling,https://github.com/TedDriggs/darling,MIT,Ted Driggs <[email protected]>

diff --git a/changelog.d/21103_kafka_sink_oidc_authentication.enhancement.md b/changelog.d/21103_kafka_sink_oidc_authentication.enhancement.md
@@ -0,0 +1,3 @@
+The `kafka` sink now  supports OIDC authentication through the exposed `librdkafka_options`.
+
+authors: zapdos26
-Original file line number
+Diff line change
@@ Expand Up / @@ -779,6 +779,7 @@ nullishness @@
     numbackends
     oahd
     oap
+    oidc
     OKD
     omfwd
     omitempty
@@ Expand Down @@
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1,3 @@
		The `kafka` sink now supports OIDC authentication through the exposed `librdkafka_options`.

		authors: zapdos26