Code

[WIP] Port to ROCm/HIP#178

Code

Open

fxzjshm wants to merge 5 commits intokvcache-ai:mainkvcache-ai/ktransformers:mainfrom fxzjshm:hipfxzjshm/ktransformers:hipCopy head branch name to clipboard

+398-9

Commits

Commits on Feb 12, 2025

• Add compat layer from llama.cpp

  Show description for 21fca5a
  fxzjshm

  committed
  21fca5a

  Copy full SHA for 21fca5a

• Don't add CUDA version to version in case not for CUDA

  Show description for 4cda454
  fxzjshm

  committed
  4cda454

  Copy full SHA for 4cda454

• gptq_marlin: temporarily disable on AMD ROCm

  Show description for ae76a72
  fxzjshm

  committed
  ae76a72

  Copy full SHA for ae76a72

• Fix symbol lookup

  Show description for 38e5dbc
  fxzjshm

  committed
  38e5dbc

  Copy full SHA for 38e5dbc

• Correctly import compat layer from llama.cpp

  Show description for c1f13a6
  fxzjshm

  committed
  c1f13a6

  Copy full SHA for c1f13a6