Question about BGE models and merging to GGUF or GGML #194
Unanswered
leighgable
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello! MNN looks incredible! @wangzhaode
I have a question. I saw a comment in this thread over on the llama.cpp repo about converting bge-large-zh to c++. Could you tell me how you went about that? Did you use a llama.cpp convert script? I am trying to convert a fine-tuned version off HuggingFace into a gguf format, but it's not recognizing the model architecture...
Beta Was this translation helpful? Give feedback.
All reactions