Skip to content

Commit

Permalink
[dagster-databricks] Fix Cluster Drive Log Root Error when no extras …
Browse files Browse the repository at this point in the history
…provided for pipe (#26592)

## Summary & Motivation
Addresses bug #26434 where an error is thrown for any Databricks Pipes
where extras have not been provided for the pipe.

Update checks if extras is available in params first to prevent the bug
from being thrown

## How I Tested These Changes

## Changelog

> Insert changelog entry or delete this section.
  • Loading branch information
GBBBAS authored Jan 9, 2025
1 parent 43560f7 commit b39de84
Showing 1 changed file with 3 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -475,7 +475,9 @@ def name(self) -> str:
# job has finished.
def _get_log_path(self, params: PipesParams) -> Optional[str]:
if self.log_path is None:
cluster_driver_log_root = params["extras"].get("cluster_driver_log_root")
cluster_driver_log_root = (
params["extras"].get("cluster_driver_log_root") if "extras" in params else None
)
if cluster_driver_log_root is None:
return None
try:
Expand Down

0 comments on commit b39de84

Please sign in to comment.