Replies: 1 comment
-
The GPTQ and EXL2 formats are different. So GPTQ needs its own GEMM kernel. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
It seems both are q gemm... What is the difference?
Beta Was this translation helpful? Give feedback.
All reactions