Skip to content

Commit

Permalink
更新kuiper大模型推理模块
Browse files Browse the repository at this point in the history
  • Loading branch information
@zjhellofss
zjhellofss committed Sep 5, 2024
1 parent 1c9fcbb commit 6ab59cf
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion demos/kuiper_llama
Submodule kuiper_llama updated 31 files
+51 −3 CMakeLists.txt
+24 −0 cmake/CPM.cmake
+2 −2 demo/main.cpp
+ − imgs/me.jpg
+ − imgs/qa.jpg
+14 −0 kuiper/include/base/alloc.h
+3 −0 kuiper/include/base/base.h
+4 −1 kuiper/include/model/llama2.h
+4 −1 kuiper/include/model/model.h
+6 −0 kuiper/include/op/embedding.h
+0 −1 kuiper/source/base/alloc.cpp
+36 −8 kuiper/source/model/llama2.cpp
+19 −6 kuiper/source/op/kernels/cpu/rope_kernel.cpp
+6 −3 kuiper/source/op/kernels/cpu/rope_kernel.h
+4 −6 kuiper/source/op/kernels/cpu/scale_sum_kernel.cpp
+39 −29 kuiper/source/op/kernels/cuda/matmul_kernel.cu
+5 −15 kuiper/source/op/kernels/cuda/rmsnorm_kernel.cu
+44 −12 kuiper/source/op/kernels/cuda/rope_kernel.cu
+6 −3 kuiper/source/op/kernels/cuda/rope_kernel.cuh
+7 −6 kuiper/source/op/kernels/cuda/swiglu_kernel.cu
+2 −1 kuiper/source/op/kernels/kernels_interface.h
+1 −1 kuiper/source/op/layer.cpp
+6 −1 kuiper/source/op/rope.cpp
+11 −5 readme.md
+106 −347 test/test_op/test_cu_matmul.cpp
+135 −135 test/test_op/test_cu_rope.cpp
+33 −33 test/test_op/test_cu_scale.cpp
+109 −0 test/test_op/test_load.cpp
+ − tmp/test.bin
+26 −0 tools/config.json
+343 −0 tools/model.py

0 comments on commit 6ab59cf

Please sign in to comment.