Note to upgrade JAI for use of vllm

srdas · Feb 6, 2025 · 8f25544 · 8f25544
1 parent f072c66
commit 8f25544
Showing 1 changed file with 5 additions and 0 deletions.
diff --git a/docs/source/users/vllm.md b/docs/source/users/vllm.md
@@ -4,6 +4,11 @@
 
 `vLLM` is a fast and easy-to-use library for LLM inference and serving. The [vLLM website](https://docs.vllm.ai/en/latest/) explains installation and usage.
 
+:::{note}
+To use `vLLM` via `OpenRouter` as described below you will need to upgrade to `jupyter-ai >= 2.29.1`.
+:::
+
+
 Depending on your hardware set up you will install `vLLM` using these [instructions](https://docs.vllm.ai/en/latest/getting_started/installation/index.html). It is best to install it in a dedicated python environment.
 
 Once it is installed you may start serving any model with the command: