We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
利用llmexport.py --test 验证模型效果是预期的,利用python llmexport.py --export mnn导出为.mnn后,运行发现如果不设置-DMNN_LOW_MEMORY=true程序就会闪退,设置了DMNN_LOW_MEMORY=true -DMNN_ARM82=false实际生成结果并不是预期的,完全偏离预期但是响应速率很快
The text was updated successfully, but these errors were encountered:
运行 llm 相关代码时参考这里面编译: https://mnn-docs.readthedocs.io/en/latest/transformers/llm.html
Sorry, something went wrong.
No branches or pull requests
利用llmexport.py --test 验证模型效果是预期的,利用python llmexport.py --export mnn导出为.mnn后,运行发现如果不设置-DMNN_LOW_MEMORY=true程序就会闪退,设置了DMNN_LOW_MEMORY=true -DMNN_ARM82=false实际生成结果并不是预期的,完全偏离预期但是响应速率很快
The text was updated successfully, but these errors were encountered: