You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
No specific problem
Describe the solution you'd like
Right now koheesio's Databricks Autoloader implementation supports adding extra parameters through the options Field. Ideally we should make it possible to add these options through ExtraParamsMixin.
This would make it possible to call the class like this:
Is your feature request related to a problem? Please describe.
No specific problem
Describe the solution you'd like
Right now koheesio's Databricks Autoloader implementation supports adding extra parameters through the options Field. Ideally we should make it possible to add these options through ExtraParamsMixin.
This would make it possible to call the class like this:
In this example
extra_option_that_i_want_to_add
would be recognized as anExtraParams
field, and dynamically added to the get_options() property.Unit tests should not need to be changed for this to work.
Describe alternatives you've considered
N/A - ExtraParamsMixin is used in a lot of other places
Additional context
It might be worth looking if any other classes are not yet using ExtraParamsMixin and address them accordingly.
The text was updated successfully, but these errors were encountered: