Skip to content
Optimum TPU / Test TGI on TPU

Add static KV cache and test on Gemma-2B #17

Sign in to view logs

Add static KV cache and test on Gemma-2B

Add static KV cache and test on Gemma-2B #17

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Run TGI tests
4m 41s
4m 41s