Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

upgrade setuptools and wheel if you found "torch module not found" when installing #2554

Open
MiladInk opened this issue Dec 23, 2024 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@MiladInk
Copy link

I encountered an issue while installing sglang. After upgrading pip (pip install --upgrade pip), I ran:

pip install "sglang[all]" --find-links https://flashinfer.ai/whl/cu121/torch2.4/flashinfer/

But it failed with the error:
ModuleNotFoundError: No module named 'torch'.

I found on the Flash Attention GitHub that running this solved the issue:

python -m pip install --upgrade pip wheel setuptools

It worked for me, so sharing in case someone faces the same problem! I don't know what the exact reason is though as the error itself was pretty strange.

@zhaochenyang20
Copy link
Collaborator

Thanks. We think this may related to the version conflicts between torch, sglang and vllm. @zhyncs

@zhaochenyang20 zhaochenyang20 self-assigned this Dec 23, 2024
@zhaochenyang20 zhaochenyang20 added the bug Something isn't working label Dec 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants