Skip to content

Transition to Hermetic CUDA #8665

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 18 commits into
base: master
Choose a base branch
from
Draft

Transition to Hermetic CUDA #8665

wants to merge 18 commits into from

Conversation

ysiraichi
Copy link
Collaborator

@ysiraichi ysiraichi commented Feb 3, 2025

This PR transitions PyTorch/XLA to use OpenXLA Hermetic CUDA for compiling PyTorch/XLA CUDA plugin. Such a change is necessary since the non-hermetic CUDA compilation was flagged as deprecated.

In order to do that, the following changes were necessary:

  • Implement the changes in the Hermetic CUDA documentation
  • Change the default compiler to Clang
  • Fix some C++ undefined behavior present in {Tpu,Gpu}CustomCall constructors due to a use-after-move
  • Remove the anonymous namespace that wrapped MLIR passes that called mlir::TypeID::get<[PassName]>(), e.g. BuildStableHLOCompositePass in stablehlo_composite_helper.cc

@ysiraichi ysiraichi marked this pull request as ready for review February 3, 2025 16:40
@ysiraichi ysiraichi marked this pull request as draft February 3, 2025 16:40
@zpcore zpcore requested a review from vanbasten23 February 3, 2025 21:05
@ysiraichi ysiraichi force-pushed the ysiraichi/hermetic-cuda branch from 04cc3f2 to d8ab058 Compare February 5, 2025 19:32
@ysiraichi
Copy link
Collaborator Author

Update: builds were successful, but tests are failing

@lsy323 lsy323 mentioned this pull request Feb 12, 2025
@ysiraichi ysiraichi force-pushed the ysiraichi/hermetic-cuda branch 2 times, most recently from 4d3a6d0 to ed49b54 Compare February 18, 2025 12:19
@ysiraichi

This comment was marked as outdated.

@ysiraichi ysiraichi force-pushed the ysiraichi/hermetic-cuda branch from 1b2b32e to 321bb36 Compare April 18, 2025 19:35
@miladm
Copy link
Collaborator

miladm commented Apr 29, 2025

can we add a description and value prop for this bug @ysiraichi?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants