Skip to content

Unexpected throughput test result of llama-7b on A100 40G #275

Unanswered
yingjie1011 asked this question in Q&A
Discussion options

You must be logged in to vote

Replies: 5 comments 8 replies

Comment options

You must be logged in to vote
7 replies
@WoosukKwon
Comment options

@andreapiso
Comment options

@gesanqiu
Comment options

@zhuohan123
Comment options

@andreapiso
Comment options

Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
1 reply
@renfeier
Comment options

Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
8 participants