Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow enabling CUDF_SPILL via an environment variable #1374

Open
ayushdg opened this issue Aug 13, 2024 · 0 comments
Open

Allow enabling CUDF_SPILL via an environment variable #1374

ayushdg opened this issue Aug 13, 2024 · 0 comments

Comments

@ayushdg
Copy link
Member

ayushdg commented Aug 13, 2024

Prior to #1362 cudf spilling could be enabled either via client.run(cudf.set_option) or via the CUDF_SPILL env variable. #1362 adds a flag to enable cudf spilling that makes the process a lot simpler but doesn't work in cases where users are trying to enable spilling via the CUDF_SPILL environment variable rather than using the flag.
This results in the workers being initialized without cudf spill by default ignoring the env variable and leading to errors downstream.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant