Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PowerShell scripts is trying to install non-existing model #18

Open
Jeidoz opened this issue Sep 9, 2023 · 0 comments
Open

PowerShell scripts is trying to install non-existing model #18

Jeidoz opened this issue Sep 9, 2023 · 0 comments

Comments

@Jeidoz
Copy link

Jeidoz commented Sep 9, 2023

I have been used installation script (env, web-ui, wizard 13b model): iex (irm wizardlm.tc.ht)

On the step of downloading models, after choosing it "downloads" momently. (Actually, no model has been added into "models" folder). In the created launch bat file, I have noticed model named "ausboss-WizardLM-13B-Uncensored-4bit-128g". I have manually download model by WebUI (https://huggingface.co/WizardLM/WizardLM-13B-V1.2) and modify launch bat file to use it:

@rem setup installer env
cd text-generation-webui
python server.py --model WizardLM_WizardLM-13B-V1.2 --chat --model_type llama --wbits 4 --groupsize 128

Also, I have noticed that on step where you choose models to download and chose several times same model, it may "redownload" and assign instanced to same number (I had 2 points with number 3 for 13b model).

I don't know what part of PS script and how it manages model downloading (and which links are valid), therefore I am creating (and asking) to update PS script with actual models/links.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant