Skip to content

Issues: airockchip/rknn-llm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

119 Open 88 Closed
119 Open 88 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

rkllm_run_async 无效
#208 opened Mar 4, 2025 by skiptomylou86
rk-llm 能否开放更底层的原子操作，方便动态量化调用
#205 opened Mar 2, 2025 by TaurusOasis
关于rknn以及rkllm的区分
#204 opened Mar 2, 2025 by wenbindu
1
参考rkllm_multimodel_demo转换MiniCPM-V-2_6 失败，请支持
#203 opened Feb 28, 2025 by bestlee666
支持协同调度机制
#202 opened Feb 28, 2025 by icode
MiniCPM-V-2_6转换的问题
#201 opened Feb 28, 2025 by OutBreak-hui
rk3588 上使用npu去推理，cpu被强制使用了后四核。
#200 opened Feb 28, 2025 by dttlgotv
有没有8G的DDR的RK3588跑测DeepSeek-7B的相关资料
#199 opened Feb 28, 2025 by 3103570984
1
【rk3588】glm-4v-9b无法转换rkllm，请支持
#198 opened Feb 27, 2025 by bestlee666
1
【rk3588】Qwen2.5-VL-7B-Instruct 不能导出rkllm，请尽快支持
#197 opened Feb 27, 2025 by bestlee666
1
VLM模型的视觉rknn加载不了，failed to malloc npu memory, size: 1427746880
#195 opened Feb 26, 2025 by meiliu-c
5
llama3-8B Seems slow and never end with new examples
#192 opened Feb 25, 2025 by openedev
能否添加自定义算子？
#189 opened Feb 25, 2025 by wohaiaini
3
你好能否提供一下librkllmrt.so动态库的源码或者提供一下OpenHarmony平台的librkllmrt.so
#188 opened Feb 24, 2025 by yy438563755
2
使用DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm进行推理时，选择第一个例子之后，一直报matmul run failed
#187 opened Feb 24, 2025 by pxrgod
3
W4A16 in rk3588s
#186 opened Feb 24, 2025 by ha-seungwon
2
RK3588安装rkllm-toolkit
#185 opened Feb 21, 2025 by wowotou958
1
能否实现兼容openai的API接口，方便调用
#184 opened Feb 21, 2025 by maxminx
1
ggml_calloc: failed to allocate 0.00 MB :0: fatal error when running DeepSeek on RK3676
#183 opened Feb 20, 2025 by AIWintermuteAI
1
Get device properities failed
#180 opened Feb 18, 2025 by HewelXX
1
Model conversion failed
#179 opened Feb 18, 2025 by Plwy
2
Qwen2.5-vl模型是否适配？
#178 opened Feb 17, 2025 by meijie-jesse
3
RK3588 Detian如何使用web端工具去访问DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm模型
#176 opened Feb 17, 2025 by 3103570984
5
在RK3576上，使用examples/DeepSeek-R1-Distill-Qwen-1.5B_Demo/deploy源码编译得到的llm_demo运行时报错：Bus error
#175 opened Feb 15, 2025 by sunbeam1019
1
在RK3588上执行./llm models/Qwen2-VL-2B-Instruct.rkllm 128 512报错
#174 opened Feb 14, 2025 by YiRanNie
1
ProTip! Exclude everything labeled bug with -label:bug.