[Question] No module named 'tvm'

[realcarlos]

❓ General Questions

python3 build.py --hf-path=ethzanalytics/RedPajama-INCITE-Chat-3B-v1-GPTQ-4bit-128g
Traceback (most recent call last):
File "/Users/xxx/mlc-llm/build.py", line 8, in
import tvm
ModuleNotFoundError: No module named 'tvm'

and I have already installed tvm by:

python3 -m pip install tvm

[sudeepag]

Could you remove tvm and try to install it using pip install -I mlc_ai_nightly -f https://mlc.ai/wheels?

[junrushao]

Please refer to this doc for TVM installation: https://mlc.ai/mlc-llm/docs/install/tvm.html

[IgnacioTechie]

Same error here.

Per the instructions I run to confirm tvm install:

python -c "import tvm; print(tvm.file)"
/home/nacho/.local/lib/python3.11/site-packages/tvm/init.py

python -c "import tvm; print(tvm._ffi.base._LIB)"
<CDLL '/home/nacho/.local/lib/python3.11/site-packages/tvm/libtvm.so', handle 5574d7b12920 at 0x7f5101cd6150>

Then:

mlc_llm_build --help

Traceback (most recent call last):
File "/home/nacho/.local/bin/mlc_llm_build", line 5, in
from mlc_llm.build import main
File "/home/nacho/.local/pipx/venvs/mlc-llm/lib/python3.11/site-packages/mlc_llm/init.py", line 1, in
from . import dispatch
File "/home/nacho/.local/pipx/venvs/mlc-llm/lib/python3.11/site-packages/mlc_llm/dispatch/init.py", line 1, in
from .dispatch_tir_operator import DispatchTIROperator
File "/home/nacho/.local/pipx/venvs/mlc-llm/lib/python3.11/site-packages/mlc_llm/dispatch/dispatch_tir_operator.py", line 2, in
import tvm
ModuleNotFoundError: No module named 'tvm'

[Matthieu-Tinycoaching]

Hello,

Same error here: mlc-ai/notebooks#24

[IgnacioTechie]

This worked for me:
pip install --pre mlc-ai-nightly -f https://mlc.ai/wheels

[EntropyGenerator]

Same issue when building mlc-ai from source. Solved by building tvm. (I have vulkan problem when using prebuild package.)

[ykz9527]

you can exec:
export PYTHONPATH=$PYTHONPATH:/your-path/mlc-llm/3rdparty/tvm/python/

[shanofrahman]

For me this works on Google Colab

!python3 -m pip install --pre -U mlc-ai-nightly -f https://mlc.ai/wheels