Docs for can_stream: false

simonw · Nov 6, 2024 · b8b1374 · b8b1374
1 parent fe58ea0
commit b8b1374
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/docs/other-models.md b/docs/other-models.md
@@ -45,6 +45,8 @@ You can set `api_key_name` to the name of a key stored using the {ref}`api-keys`
 
 Add `completion: true` if the model is a completion model that uses a `/completion` as opposed to a `/completion/chat` endpoint.
 
+If a model does not support streaming, add `can_stream: false` to disable the streaming option.
+
 Having configured the model like this, run `llm models` to check that it installed correctly. You can then run prompts against it like so:
 
 ```bash