Skip to content

Commit

Permalink
remove revision from yml
Browse files Browse the repository at this point in the history
fix for updated yml format
make sure to copy dict before popping things so we can reuse them later
copy hub config dict too
  • Loading branch information
winglian committed May 17, 2023
1 parent dc8c932 commit a6bc28e
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
1 change: 0 additions & 1 deletion config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,6 @@
hub:
repo_id: TheBloke/stable-vicuna-13B-GGML
filename: stable-vicuna-13B.ggml.q5_1.bin
# revision: v1.1.0
llama_cpp:
n_ctx: 2048
n_gpu_layers: 40 # llama 13b has 40 layers
Expand Down
5 changes: 3 additions & 2 deletions tabbed.py
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,8 @@
config = yaml.load(f, Loader=yaml.Loader)
while True:
try:
hub_config = config["hub"]
load_config = config.copy()
hub_config = load_config["hub"].copy()
repo_id = hub_config.pop("repo_id")
filename = hub_config.pop("filename")
fp = hf_hub_download(
Expand Down Expand Up @@ -90,7 +91,7 @@ def generate_text_instruct(input_text):
with gr.Column():
gr.Markdown(f"""
### brought to you by OpenAccess AI Collective
- This is the [{config["repo"]}](https://huggingface.co/{config["repo"]}) model file [{config["file"]}](https://huggingface.co/{config["repo"]}/blob/main/{config["file"]})
- This is the [{config["hub"]["repo_id"]}](https://huggingface.co/{config["hub"]["repo_id"]}) model file [{config["hub"]["filename"]}](https://huggingface.co/{config["hub"]["repo_id"]}/blob/main/{config["hub"]["filename"]})
- This Space uses GGML with GPU support, so it can quickly run larger models on smaller GPUs & VRAM.
- This is running on a smaller, shared GPU, so it may take a few seconds to respond.
- [Duplicate the Space](https://huggingface.co/spaces/openaccess-ai-collective/ggml-ui?duplicate=true) to skip the queue and run in a private space or to use your own GGML models.
Expand Down

0 comments on commit a6bc28e

Please sign in to comment.