You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It worked for me, so sharing in case someone faces the same problem! I don't know what the exact reason is though as the error itself was pretty strange.
The text was updated successfully, but these errors were encountered:
I encountered an issue while installing
sglang
. After upgrading pip (pip install --upgrade pip
), I ran:pip install "sglang[all]" --find-links https://flashinfer.ai/whl/cu121/torch2.4/flashinfer/
But it failed with the error:
ModuleNotFoundError: No module named 'torch'
.I found on the Flash Attention GitHub that running this solved the issue:
It worked for me, so sharing in case someone faces the same problem! I don't know what the exact reason is though as the error itself was pretty strange.
The text was updated successfully, but these errors were encountered: