Skip to content

Pull requests: deepinfra/text-generation-inference

New pull request New
6 Open 4 Closed
6 Open 4 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Tgi router latency metrics
#10 opened Dec 15, 2023 by pathorn Loading…
Add support for Mistral
#9 opened Dec 7, 2023 by pathorn Loading…
1
Update flash attention to version v2.3.6
#8 opened Dec 1, 2023 by pathorn Loading…
Expose raw logit weights to the API if request_logits=true
#7 opened Nov 28, 2023 by pathorn Loading…
4
Print stats about the KV Cache
#6 opened Oct 10, 2023 by NikolaBorisov Loading…
Update deps
#5 opened Oct 7, 2023 by NikolaBorisov Loading…
ProTip! Type g i on any issue or pull request to go back to the issue listing page.