Skip to content

Commit

Permalink
cleanup markdown
Browse files Browse the repository at this point in the history
  • Loading branch information
strangiato committed Dec 18, 2024
1 parent b0face6 commit ba6606f
Showing 1 changed file with 4 additions and 3 deletions.
7 changes: 4 additions & 3 deletions content/modules/ROOT/pages/02-vllm.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ image::02-deploy-models.png[Deploy Models]
. Enter the following information

+
[source,properties]
[source,yaml]
----
Model deployment name: vllm
Serving runtime: vLLM ServingRuntime for KServe
Expand All @@ -54,7 +54,7 @@ image::02-model-options.png[Model Options]
. In the `Source model location` section, choose the option to `Create connection`. Enter the following information:

+
[source,properties]
[source,yaml]
----
Connection type: URI - v1
Connection name: granite-3-0-8b-instruct
Expand All @@ -72,7 +72,8 @@ You can find the original image https://github.com/redhat-ai-services/modelcar-c
Additionally, the source for building these ModelCar images can be found on https://github.com/redhat-ai-services/modelcar-catalog/[GitHub].
====

+[TIP]
+
[TIP]
====
A copy of the image has already been pulled onto the GPU node to help speed up deploying the model, but deploying LLMs can take quite some time.
Expand Down

0 comments on commit ba6606f

Please sign in to comment.