Skip to content

v2.6.3-cktile
Compare
Choose a tag to compare
@github-actions github-actions released this 17 Sep 18:52
v2.6.3-cktile
e2182cc
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

We send the PR to upstream in this PR

  1. Update the ROCm backend (CK), so I modify how to call ck due to changing of CK api.
  2. Improve backward performance by updating the CK (1)
  3. Implement mha_fwd_kvcache().
  4. Change of compile flag to support ROCm6.2
  5. Change bf16 rounding to RTN (round to nearest)
Assets 86
Loading