CLI to Compare and Apply Configs, Base Datasource Feature Additions

[jaybythebay]

Overview

Adds functionality for updating datasources from config files. This will allow us to have less custom code in an AIrflow DAG (or any DAG) and use the cli to update changes based on a config

Changes

Changed

• Moved column_init to it's own function

New

• Add function to remove_empty_folders() from a datasource
• Add mock testing for the new remove_empty_folders function.
• Add new directory for testing outside of package. This conforms to the guidelines here https://docs.python-guide.org/writing/structure/#sample-repository

Open Questions

• Will color styling in printing make re-using these functions in something like Airflow easy?
• Why does column_init make list columns work even though I don't see the column tag added

Testing

Remove empty folders

Before

Cli Command

tableau_utilities --location local --file_path '/Users/jayrosenthal/code/tableau-utilities/development_test_files/has_empty_folder.tdsx' datasource --clean_folders

After

Mock tests passed

➜  pytest tests/test_datasource_remove_empty_folders.py -p no:warnings
=========================================================================================== test session starts ===========================================================================================
platform darwin -- Python 3.12.1, pytest-8.2.1, pluggy-1.5.0
rootdir: /Users/jayrosenthal/code/tableau-utilities
plugins: anyio-4.2.0
collected 3 items                                                                                                                                                                                         

tableau_utilities/test_tableau_file_objects.py ...                                                                                                                                                  [100%]

============================================================================================ 3 passed in 0.58s ============================================================================================
➜