Skip to content

Commit

Permalink
update testing section with some notes
Browse files Browse the repository at this point in the history
  • Loading branch information
strangiato committed Dec 13, 2024
1 parent 22008f1 commit 97ba418
Showing 1 changed file with 8 additions and 0 deletions.
8 changes: 8 additions & 0 deletions content/modules/ROOT/pages/02-vllm.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -81,4 +81,12 @@ spec:

== Testing vLLM Endpoints

The vLLM instance may take a while to pull the model image and load it. Feel free to move onto the next section and come back to test the endpoint once the vLLM instance is up and running.

=== Testing vLLM Endpoint with a Notebook (Optional)

# Instructions for testing vLLM endpoint via a notebook image

=== Testing vLLM Endpoint

# Instructions for chatting with the model using a basic non-rag assistant.

0 comments on commit 97ba418

Please sign in to comment.