Skip to content

Commit

Permalink
Deployed 9dd4b13 with mkdocs-material v9.5.44 and HTML post-processing
Browse files Browse the repository at this point in the history
  • Loading branch information
actions-user committed Nov 15, 2024
1 parent ede88f5 commit c172825
Show file tree
Hide file tree
Showing 3 changed files with 5 additions and 5 deletions.
2 changes: 1 addition & 1 deletion search/search_index.json

Large diffs are not rendered by default.

Binary file modified sitemap.xml.gz
Binary file not shown.
8 changes: 4 additions & 4 deletions tensorrt_llm.html
Original file line number Diff line number Diff line change
Expand Up @@ -874,8 +874,8 @@ <h2 id="building-tensorrt-llm-engine-for-llama">
<pre><span></span><code>jetson-containers<span class="w"> </span>run<span class="w"> </span><span class="se">\</span>
<span class="w"> </span>-e<span class="w"> </span><span class="nv">HUGGINGFACE_TOKEN</span><span class="o">=</span>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<span class="w"> </span><span class="se">\</span>
<span class="w"> </span>-e<span class="w"> </span><span class="nv">FORCE_BUILD</span><span class="o">=</span>on<span class="w"> </span><span class="se">\</span>
<span class="w"> </span>cu126/tensorrt_llm:0.12-r36.4.0<span class="w"> </span><span class="se">\</span>
<span class="w"> </span>/opt/TensorRT-LLM/llama.sh
<span class="w"> </span>dustynv/tensorrt_llm:0.12-r36.4.0<span class="w"> </span><span class="se">\</span>
<span class="w"> </span>/opt/TensorRT-LLM/llama.sh
</code></pre>
</div>
<p>
Expand All @@ -900,7 +900,7 @@ <h2 id="openai-api-endpoint">
</p>
<div class="highlight">
<pre><span></span><code>jetson-containers run \
cu126/tensorrt_llm:0.12-r36.4.0 \
dustynv/tensorrt_llm:0.12-r36.4.0 \
python3 /opt/TensorRT-LLM/examples/apps/openai_server.py \
/data/models/tensorrt_llm/Llama-2-7b-chat-hf-gptq
</code></pre>
Expand Down Expand Up @@ -939,7 +939,7 @@ <h2 id="openai-api-endpoint">
<div class="highlight">
<pre><span></span><code>jetson-containers run \
--workdir /opt/TensorRT-LLM/examples/apps \
cu126/tensorrt_llm:0.12-r36.4.0 \
dustynv/tensorrt_llm:0.12-r36.4.0 \
python3 openai_client.py --prompt "Where is New York?" --api chat
</code></pre>
</div>
Expand Down

0 comments on commit c172825

Please sign in to comment.