aws-glue-alpha: extra_jars parameter in PySparkEtlJob #33225
Labels
Comments
gontzalm
added
feature-request
|
Yes this should be simply expose the L1 to the L2 surface. We welcome the PRs. |
This was referenced Jan 30, 2025
This is not what L2s are for. They are opinionated constructs and exposing every L1 parameter defeats the purpose of creating interfaces as contracts and enforcing best practices. |
|
Comments on closed issues and PRs are hard for our team to see. |
1 similar comment
|
Comments on closed issues and PRs are hard for our team to see. |
yashkh-amzn
pushed a commit
to yashkh-amzn/aws-cdk
that referenced
this issue
Feb 21, 2025
…3238) ### Issue # (if applicable) Closes aws#33225. ### Reason for this change PySpark jobs with extra JAR dependencies cannot be defined with the new L2 constructs introduced in [v2.177.0](https://github.com/aws/aws-cdk/releases/tag/v2.177.0). ### Description of changes Add the `extraJars` parameter in the PySpark job L2 constructs. ### Checklist - [x] My code adheres to the [CONTRIBUTING GUIDE](https://github.com/aws/aws-cdk/blob/main/CONTRIBUTING.md) and [DESIGN GUIDELINES](https://github.com/aws/aws-cdk/blob/main/docs/DESIGN_GUIDELINES.md) ---- *By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license*
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Describe the feature
Include the
extra_jarsparameter in the newPySparkEtlJobL2 construct introduced in v2.177.0.Use Case
We need this parameter in order to use the spark-xml package JAR in our PySpark Glue jobs.
Proposed Solution
No response
Other Information
No response
Acknowledgements
CDK version used
v2.177.0
Environment details (OS name and version, etc.)
MacOS
The text was updated successfully, but these errors were encountered: