Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better communicate expectations of data order/contiguousness #5975

Open
wants to merge 3 commits into
base: branch-24.08
Choose a base branch
from

Conversation

viclafargue
Copy link
Contributor

Will be answering #5929 and #5930.

@viclafargue viclafargue requested a review from a team as a code owner July 24, 2024 12:32
Copy link

copy-pr-bot bot commented Jul 24, 2024

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions github-actions bot added the Cython / Python Cython or Python issue label Jul 24, 2024
@viclafargue viclafargue changed the title Better communicate expectations of F/C contiguousness Better communicate expectations of data order/contiguousness Jul 24, 2024
@@ -1172,6 +1172,19 @@ def from_input(
if (
not fail_on_order and order != arr.order and order != "K"
) or make_copy:
if make_copy:
info(
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are other places where a copy can happen, specifically lines 1072, potentially 1104 (unless the dataframe is fully contiguous) and potentialy 1160, not sure if we need all of them but it would be good to cover most of the cases.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Regarding line 1072, the copy happens when the function is called with deepcopy=True, which means that a copy was required anyway. The user cannot do much about it. Do we want to log this as well?

Regarding line 1104, can the data in the dataframe be non-contiguous? Not very familiar into the ways to check for the internals of cuDF, but it might be something we want to check too. However again, the user cannot do much about this to avoid a copy.

Regarding line 1160, unless mistaken this section of code should be in charge of data type conversions. Do we want to log this too? But, then to be consistent we would have to double check that every data type conversions is being caught. Given the time left for release, it might be a bit short.

python/cuml/cuml/internals/array.py Outdated Show resolved Hide resolved
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Cython / Python Cython or Python issue
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants