Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pass rows IDs instead of rows to parallel UDFs #381

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

dreadatour
Copy link
Contributor

TBD

@dreadatour dreadatour self-assigned this Sep 2, 2024
@dreadatour dreadatour marked this pull request as draft September 2, 2024 18:10
Copy link

cloudflare-workers-and-pages bot commented Sep 2, 2024

Deploying datachain-documentation with  Cloudflare Pages  Cloudflare Pages

Latest commit: 881a376
Status: ✅  Deploy successful!
Preview URL: https://7a91d86e.datachain-documentation.pages.dev
Branch Preview URL: https://parallel-execution-optimizat.datachain-documentation.pages.dev

View logs

Copy link

codecov bot commented Sep 2, 2024

Codecov Report

Attention: Patch coverage is 66.17647% with 23 lines in your changes missing coverage. Please review.

Please upload report for BASE (main@ee43fd1). Learn more about missing BASE report.

Files with missing lines Patch % Lines
src/datachain/query/utils.py 42.85% 10 Missing and 2 partials ⚠️
src/datachain/query/batch.py 64.70% 3 Missing and 3 partials ⚠️
src/datachain/query/dispatch.py 82.75% 4 Missing and 1 partial ⚠️
Additional details and impacted files
@@           Coverage Diff           @@
##             main     #381   +/-   ##
=======================================
  Coverage        ?   86.53%           
=======================================
  Files           ?       94           
  Lines           ?     9822           
  Branches        ?     2031           
=======================================
  Hits            ?     8499           
  Misses          ?      966           
  Partials        ?      357           
Flag Coverage Δ
datachain 86.46% <66.17%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@dreadatour dreadatour force-pushed the parallel-execution-optimizations branch 2 times, most recently from 094682c to 44b6d0e Compare September 5, 2024 01:32
@dreadatour dreadatour force-pushed the parallel-execution-optimizations branch from 04f1902 to ba7c790 Compare September 18, 2024 12:47
@dreadatour dreadatour force-pushed the parallel-execution-optimizations branch from ba7c790 to 881a376 Compare September 18, 2024 12:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant