Skip to content
CI - sharktank perplexity short

[shortfin_apps/llm] Add locks to protect trie nodes, node reference counts, and the trie structure itself from race conditions #1124

Sign in to view logs

[shortfin_apps/llm] Add locks to protect trie nodes, node reference counts, and the trie structure itself from race conditions

[shortfin_apps/llm] Add locks to protect trie nodes, node reference counts, and the trie structure itself from race conditions #1124

Run time

Learn about OS pricing on GitHub Actions
Job Run time
IREE Perplexity (3.11, llama-mi300x-3)
43s
43s