Skip to content

Commit

Permalink
Fix Elia example
Browse files Browse the repository at this point in the history
Actually upstream should be changed to use different model, but for
the sake of getting it to work right now...
  • Loading branch information
richiejp committed Apr 17, 2024
1 parent 842dc0a commit 90ed775
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions examples/elia-tui.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ spec:
uri: "l3utterfly/phi-2-layla-v1-chatml-gguf"
# The LocalAI model description. Note that the model is called gpt-4-turbo because Elia has the models hardcoded at the time of writting
engineConfigFile: |
name: gpt-4-turbo
name: gpt-4-1106-preview
mmap: true
parameters:
model: huggingface://l3utterfly/phi-2-layla-v1-chatml-gguf/phi-2-layla-v1-chatml-Q8_0.gguf
Expand All @@ -30,7 +30,7 @@ spec:
- <dummy32000>
usage: |
curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
"model": "gpt-4-turbo",
"model": "gpt-4-1106-preview",
"messages": [{"role": "user", "content": "How are you doing?", "temperature": 0.1}]
}'
---
Expand Down

0 comments on commit 90ed775

Please sign in to comment.