Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Perform clean up - integrate with storage interface, remove custom I/O classes #477

Open
mcember opened this issue Jan 29, 2025 · 0 comments

Comments

@mcember
Copy link
Collaborator

mcember commented Jan 29, 2025

The goal of this ticket is to remove classes which are irrelevant/obsolete after the deltacat/rivulet metastore unification. Also - we should fully reconcile the code within rivulet which produces metafiles with storage/interface.py (and storage/main/impl.py implementation)

Acceptance Criteria:

  • All access of metastore files replaced with storage interface calls
  • Remove unecessary wrappers around metastore, like the DatasetMetastore class
  • Remove unecessary file IO classes/utilities like InputFile, OutputFile, FileStore, FileProvider
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant