Skip to content

Commit

Permalink
Minor fix
Browse files Browse the repository at this point in the history
  • Loading branch information
hahuyhoang411 committed Nov 17, 2023
1 parent a132c44 commit 3e50804
Show file tree
Hide file tree
Showing 3 changed files with 10 additions and 10 deletions.
4 changes: 2 additions & 2 deletions docs/docs/examples/llm.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ First, you'll need to download the chatbot model.
- Once you've selected a model, download it using a command like the one below. Replace `<llama_model_path>` with the path of your chosen model.


```zsh title="Downloading Zephyr 7B Model"
```bash title="Downloading Zephyr 7B Model"
wget https://huggingface.co/TheBloke/zephyr-7B-beta-GGUF/resolve/main/zephyr-7b-beta.Q5_K_M.gguf?download=true
```

Expand All @@ -37,7 +37,7 @@ Now, you'll set up the model in your application.
- Modify the model path in app.py to point to your downloaded model.
- Update the configuration parameters as necessary.

```zsh title="Example Configuration" {2}
```bash title="Example Configuration" {2}
dat = {
"llama_model_path": "nitro/interface/models/zephyr-7b-beta.Q5_K_M.gguf",
"ctx_len": 2048,
Expand Down
2 changes: 1 addition & 1 deletion docs/docs/features/prompt.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ To illustrate, let's create a "Pirate assistant":
### Prompt Configuration

```bash title="Prompt Configuration" {7,8,9}
```bash title="Prompt Configuration" {6,7,8}
curl http://localhost:3928/inferences/llamacpp/loadmodel \
-H 'Content-Type: application/json' \
-d '{
Expand Down
14 changes: 7 additions & 7 deletions docs/sidebars.js
Original file line number Diff line number Diff line change
Expand Up @@ -51,13 +51,13 @@ const sidebars = {
collapsed: false,
items: ["examples/llm"],
},
{
type: "category",
label: "Specification",
collapsible: false,
collapsed: false,
items: [{ type: "doc", id: "new/architecture", label: "Architecture" }],
},
// {
// type: "category",
// label: "Specification",
// collapsible: false,
// collapsed: false,
// items: [{ type: "doc", id: "new/architecture", label: "Architecture" }],
// },
],

apiSidebar: [
Expand Down

0 comments on commit 3e50804

Please sign in to comment.