Skip to content

Commit

Permalink
fa decode example fp16/int4kv (#492)
Browse files Browse the repository at this point in the history 
* Add FA decode example (fp16 and int4 kv data types)
  • Loading branch information
@scxiao
scxiao authored Mar 12, 2024
1 parent 6c51f12 commit 2d501e4
Showing 1 changed file with 819 additions and 0 deletions.
Loading

0 comments on commit 2d501e4

Please sign in to comment.