From 97ba418d0cf3c2d54a6d9b0eedab9dea3691b116 Mon Sep 17 00:00:00 2001 From: Trevor Royer Date: Fri, 13 Dec 2024 07:47:36 -0700 Subject: [PATCH] update testing section with some notes --- content/modules/ROOT/pages/02-vllm.adoc | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/content/modules/ROOT/pages/02-vllm.adoc b/content/modules/ROOT/pages/02-vllm.adoc index dc2c707..87dfe47 100644 --- a/content/modules/ROOT/pages/02-vllm.adoc +++ b/content/modules/ROOT/pages/02-vllm.adoc @@ -81,4 +81,12 @@ spec: == Testing vLLM Endpoints +The vLLM instance may take a while to pull the model image and load it. Feel free to move onto the next section and come back to test the endpoint once the vLLM instance is up and running. + +=== Testing vLLM Endpoint with a Notebook (Optional) + # Instructions for testing vLLM endpoint via a notebook image + +=== Testing vLLM Endpoint + +# Instructions for chatting with the model using a basic non-rag assistant.