v0.2.2
- Use watchdog timeout to catalog properties (#48). This pull request introduces a new
RemoveAfter
property for catalogs, which allows for marking them for skipping by the watchdog. This change addresses the current implementation gap, which does not explicitly indicate when catalogs are being used. The new property will specify the time from which objects can be purged. A corresponding fixturewatchdog_remove_after
has been added to the list of available fixtures, and themake_catalog
fixture has been updated to include this new property. Additionally, a timeout mechanism for catalogs has been implemented, which improves the system's efficiency and safety by marking catalogs as in use. A test for themake_catalog
function has been included to ensure that theRemoveAfter
entry is correctly added to the catalog properties. However, the specific call parameters for thecatalogs.create
method cannot be accurately determined in the test. - use tags instead of name suffix for queries (#47). This release introduces updates to the testing library for Databricks, enhancing the naming conventions for queries to improve readability and comprehension. The previous implementation used name suffixes, which have been replaced with watchdog query tags. The
watchdog_purge_suffix
fixture has been renamed towatchdog_remove_after
, and the newmake_query
fixture has been added to the documentation. In addition, themake_query
andcreate
functions now accept an optionaltags
argument, and the query name is generated with a unique identifier. Iftags
are provided, theRemoveAfter
tag is added. Theoriginal_query_tag
is no longer hardcoded in thecreate
function and has been removed. These changes improve the overall user experience and maintainability of the project.
Contributors: @ericvergnaud