Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement partitioned AwkwardArrays and a dask-awkward client #807

Open
danielballan opened this issue Oct 31, 2024 · 0 comments
Open

Implement partitioned AwkwardArrays and a dask-awkward client #807

danielballan opened this issue Oct 31, 2024 · 0 comments

Comments

@danielballan
Copy link
Member

Based on a quick reading of dask-awkward, AwkwardArrays are partitioned along the length of the AwkwardArray. This is simpler to describe that I naively expected. Similar to how Tiled describes DataFrame "partitions" (the 1-dimensional analogue of "chunks"), it can describe Awkward partitions.

  • Add npartitions to the AwkwardStructure, matching the term we use in TableStructure. Default is 1 for back-compat.
  • Add npartitions query parameter. It really ought to be required, but we can default for 1 for back-compat, at least temporarily.
  • Add a DaskAwkwardClient.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant