Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Populate more fields in Deltacat metastore files (e.g. row count, content type) #476

Open
mcember opened this issue Jan 29, 2025 · 0 comments

Comments

@mcember
Copy link
Collaborator

mcember commented Jan 29, 2025

The Deltacat metastore format has a ton of fields which we do not populate for rivulet datasets / deltas / manifests. This metadata is useful/necessary for a variety of reasons

The goal of this ticket is to populate the fields which we can add easily add, and make child tickets if necessary to populate other fields that may require more work like rowCount

Acceptance criteria

  • Audit of fields in deltacat manifest/delta/stream/table version/table which we are not populating and may be able to populate
  • Make code changes to populate those fields, or make spinoff tickets if necessary
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant