Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Android:转换.mnn后运行,实际结果偏离未转换前的预期 #3157

Open
creazyDong opened this issue Jan 8, 2025 · 1 comment
Open
Labels
question Further information is requested

Comments

@creazyDong
Copy link

利用llmexport.py --test 验证模型效果是预期的,利用python llmexport.py --export mnn导出为.mnn后,运行发现如果不设置-DMNN_LOW_MEMORY=true程序就会闪退,设置了DMNN_LOW_MEMORY=true -DMNN_ARM82=false实际生成结果并不是预期的,完全偏离预期但是响应速率很快

@creazyDong creazyDong changed the title 转换.mnn后运行,实际结果偏离未转换前的预期 Android:转换.mnn后运行,实际结果偏离未转换前的预期 Jan 8, 2025
@jxt1234 jxt1234 added the question Further information is requested label Jan 9, 2025
@jxt1234
Copy link
Collaborator

jxt1234 commented Jan 9, 2025

运行 llm 相关代码时参考这里面编译:
https://mnn-docs.readthedocs.io/en/latest/transformers/llm.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants