File tree 2 files changed +7
-1
lines changed
docs/modules/spark-k8s/pages/usage-guide
2 files changed +7
-1
lines changed Original file line number Diff line number Diff line change @@ -18,6 +18,7 @@ All notable changes to this project will be documented in this file.
18
18
- Replace stackable-operator ` print_startup_string ` with ` tracing::info! ` with fields.
19
19
- BREAKING: Inject the vector aggregator address into the vector config using the env var ` VECTOR_AGGREGATOR_ADDRESS ` instead
20
20
of having the operator write it to the vector config ([ #551 ] ).
21
+ - Document that Spark Connect doesn't integrate with the history server ([ #559 ] )
21
22
22
23
### Fixed
23
24
@@ -28,6 +29,7 @@ All notable changes to this project will be documented in this file.
28
29
[ #551 ] : https://github.com/stackabletech/spark-k8s-operator/pull/551
29
30
[ #553 ] : https://github.com/stackabletech/spark-k8s-operator/pull/553
30
31
[ #554 ] : https://github.com/stackabletech/spark-k8s-operator/pull/554
32
+ [ #559 ] : https://github.com/stackabletech/spark-k8s-operator/pull/559
31
33
32
34
## [ 25.3.0] - 2025-03-21
33
35
Original file line number Diff line number Diff line change @@ -45,11 +45,15 @@ spec:
45
45
46
46
The example above adds a new endpoint for application metrics.
47
47
48
+ == Spark History Server
49
+
50
+ Unforunately integration with the Spark History Server is not supported yet.
51
+ The connect server seems to ignore the `spark.eventLog` properties while also prohibiting clients to set them programatically.
52
+
48
53
== Notable Omissions
49
54
50
55
The following features are not supported by the Stackable Spark operator yet
51
56
52
- * Integration with the Spark History Server.
53
57
* Authorization and authentication. Currently, anyone with access to the Spark Connect service can run jobs.
54
58
* Volumes and volume mounts can be added only with pod overrides.
55
59
* Job dependencies must be provisioned as custom images or via `--packages` or `--jars` arguments.
You can’t perform that action at this time.
0 commit comments