Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] No module named 'pandas.core.arrays._arrow_utils' when using dataporc rapids #12386

Closed
blis-teng opened this issue Dec 14, 2022 · 1 comment
Labels
bug Something isn't working

Comments

@blis-teng
Copy link

Describe the bug
I am trying to setup a dataproc cluster with GPU attached, to use cuml and cudf, I followed the instruction https://github.com/GoogleCloudDataproc/initialization-actions/blob/master/rapids/README.md
And able to setup the cluster, with nvidia driver successfully installed. But when I try

import cudf

It throws out the error

TypeError: C function cuda.ccudart.cudaStreamSynchronize has wrong signature (expected __pyx_t_4cuda_7ccudart_cudaError_t (__pyx_t_4cuda_7ccudart_cudaStream_t), got cudaError_t (cudaStream_t)

I follow the instruction here: https://docs.rapids.ai/notices/rsn0020/
But after the downgraded version, another error show up when import cudf which is

No module named 'pandas.core.arrays._arrow_utils'

Steps/Code to reproduce bug

  1. setup a GCP dataproc with the instruction.
  2. import cudf

Expected behavior
cudf successfully imported.

Environment overview (please complete the following information)

  • Environment location: [Bare-metal, Docker, Cloud(specify cloud provider)]
  • Method of cuDF install: [conda, Docker, or from source]
    • If method of install is [Docker], provide docker pull & docker run commands used

Environment details
Please run and paste the output of the cudf/print_env.sh script here, to gather any other relevant environment details

Additional context
Add any other context about the problem here.

@blis-teng blis-teng added Needs Triage Need team to review and classify bug Something isn't working labels Dec 14, 2022
@beckernick
Copy link
Member

beckernick commented Dec 19, 2022

Thanks for filing this issue. Let's consolidate discussion in GoogleCloudDataproc/initialization-actions#1039

Closing in favor of the GCP Dataproc issue.

@bdice bdice removed the Needs Triage Need team to review and classify label Mar 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants