-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[dagster-databricks] Fix Cluster Drive Log Root Error when no extras provided for pipe #26592
[dagster-databricks] Fix Cluster Drive Log Root Error when no extras provided for pipe #26592
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
seems reasonable to me. Just want to get @danielgafni 's sign off in case there is an underlying issue here where extras
isn't getting set when we expect it to be set
In the meantime, @GBBBAS can you run |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Requesting changes to rerun make ruff
so that this doesn't get accidentally merged until then
@GBBBAS just a reminder to please run |
Done and pushed the commit |
Summary & Motivation
Addresses bug #26434 where an error is thrown for any Databricks Pipes where extras have not been provided for the pipe.
Update checks if extras is available in params first to prevent the bug from being thrown
How I Tested These Changes
Changelog