Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Issue]: create_final_entities error when i use ollama embedding model #504

Closed
sysullf opened this issue Jul 11, 2024 · 1 comment
Closed

Comments

@sysullf
Copy link

sysullf commented Jul 11, 2024

Describe the issue

In order to switch the LLM and embedding modules in Graphrag to the local version, I deployed the ollama service and then configured the Graphrag configuration file according to the requirements https://github.com/TheAiSingularity/graphrag-local-ollama Make modifications, and finally an error occurs in the 'creat_final_dentities' step.
After reading the source code, it was found that Graphrag relies on OpenAI's Python API, which does not support the embedding of ollama.
Do you have any plans to support ollama as a model for LLM and embedding in the future?
thank you.

Steps to reproduce

No response

GraphRAG Config Used

No response

Logs and screenshots

No response

Additional Information

  • GraphRAG Version:
  • Operating System:
  • Python Version:
  • Related Issues:
@sysullf sysullf added the triage Default label assignment, indicates new issue needs reviewed by a maintainer label Jul 11, 2024
@sysullf sysullf changed the title [Issue]: <title> create_final_entities when i use ollama embedding model [Issue]: <title> create_final_entities error when i use ollama embedding model Jul 11, 2024
@AlonsoGuevara AlonsoGuevara added oss_llm and removed triage Default label assignment, indicates new issue needs reviewed by a maintainer labels Jul 11, 2024
@AlonsoGuevara
Copy link
Contributor

Hi! We are centralizing other LLM discussions in these threads:
Other LLM/Api bases: #339,
Ollama: #345
Local embeddings: #370

Kindly appreciate if you can bring your question to those threads for community support.
I'll resolve this issue so we can keep the focus on those threads.

@AlonsoGuevara AlonsoGuevara changed the title [Issue]: <title> create_final_entities error when i use ollama embedding model [Issue]: create_final_entities error when i use ollama embedding model Jul 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants