how to install from source

[SeekPoint]

(gh_FlexGen) r730ub20@r730ub20-M0:/llm_dev/FlexGen$ git remote -v
origin https://github.com/FMInference/FlexGen (fetch)
origin https://github.com/FMInference/FlexGen (push)
(gh_FlexGen) r730ub20@r730ub20-M0:/llm_dev/FlexGen$ pip install -e .
ERROR: File "setup.py" not found. Directory cannot be installed in editable mode: /home/r730ub20/llm_dev/FlexGen
(A "pyproject.toml" file was found, but editable mode currently requires a setup.py based build.)
(gh_FlexGen) r730ub20@r730ub20-M0:~/llm_dev/FlexGen$

[SeekPoint]

after I fake a setup.py

(gh_FlexGen) r730ub20@r730ub20-M0:/llm_dev/FlexGen$ pip install -e .
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Obtaining file:///home/r730ub20/llm_dev/FlexGen
Installing build dependencies ... done
Getting requirements to build wheel ... done
Installing backend dependencies ... done
Preparing wheel metadata ... error
ERROR: Command errored out with exit status 1:
command: /usr/bin/python3 /tmp/tmp06xly_hd prepare_metadata_for_build_wheel /tmp/tmpozbnb1uw
cwd: /home/r730ub20/llm_dev/FlexGen
Complete output (14 lines):
Traceback (most recent call last):
File "/tmp/tmp06xly_hd", line 280, in
main()
File "/tmp/tmp06xly_hd", line 263, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "/tmp/tmp06xly_hd", line 133, in prepare_metadata_for_build_wheel
return hook(metadata_directory, config_settings)
File "/tmp/pip-build-env-bruz6ip8/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 382, in prepare_metadata_for_build_wheel
self._bubble_up_info_directory(metadata_directory, ".egg-info")
File "/tmp/pip-build-env-bruz6ip8/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 353, in _bubble_up_info_directory
info_dir = self._find_info_directory(metadata_directory, suffix)
File "/tmp/pip-build-env-bruz6ip8/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 364, in _find_info_directory
assert len(candidates) == 1, f"Multiple {suffix} directories found"
AssertionError: Multiple .egg-info directories found
----------------------------------------
ERROR: Command errored out with exit status 1: /usr/bin/python3 /tmp/tmp06xly_hd prepare_metadata_for_build_wheel /tmp/tmpozbnb1uw Check the logs for full command output.
(gh_FlexGen) r730ub20@r730ub20-M0:/llm_dev/FlexGen$

[tanzelin430]

Hi!I also run into this weird problem.Have you solved it?

[tanzelin430]

Hi, I have just solved the problem, try using pip install --upgrade pip to upgrade pip(>= 21.3).Then try again run pip install -e .
I recognize that you are interested in MLsys&model opt? Maybe we could make a friend~

[SeekPoint]

still failed

(gh_FlexGen) ub2004@ub2004-B85M-A0:~/llm_dev/FlexGen$ pip install -e .
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Obtaining file:///home/ub2004/llm_dev/FlexGen
Installing build dependencies ... done
Checking if build backend supports build_editable ... done
Getting requirements to build editable ... done
Installing backend dependencies ... done
Preparing editable metadata (pyproject.toml) ... error
error: subprocess-exited-with-error

× Preparing editable metadata (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [16 lines of output]
Traceback (most recent call last):
File "/home/ub2004/anaconda3/envs/gh_FlexGen/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in
main()
File "/home/ub2004/anaconda3/envs/gh_FlexGen/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "/home/ub2004/anaconda3/envs/gh_FlexGen/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 181, in prepare_metadata_for_build_editable
return hook(metadata_directory, config_settings)
File "/tmp/pip-build-env-cze06jep/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 454, in prepare_metadata_for_build_editable
return self.prepare_metadata_for_build_wheel(
File "/tmp/pip-build-env-cze06jep/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 382, in prepare_metadata_for_build_wheel
self._bubble_up_info_directory(metadata_directory, ".egg-info")
File "/tmp/pip-build-env-cze06jep/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 353, in _bubble_up_info_directory
info_dir = self._find_info_directory(metadata_directory, suffix)
File "/tmp/pip-build-env-cze06jep/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 364, in _find_info_directory
assert len(candidates) == 1, f"Multiple {suffix} directories found"
AssertionError: Multiple .egg-info directories found
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
(gh_FlexGen) ub2004@ub2004-B85M-A0:~/llm_dev/FlexGen$