Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] For a real world application #35

Open
Ashes47 opened this issue Sep 10, 2024 · 5 comments
Open

[Feature Request] For a real world application #35

Ashes47 opened this issue Sep 10, 2024 · 5 comments

Comments

@Ashes47
Copy link

Ashes47 commented Sep 10, 2024

Must have for real world application:

  1. To actually use this in any application we must be able to generate multiple independent Knowledge Graph for RAG for diffirent users this will be a must have for actual use. I didn't find any support to do so today happy to help if i can.

    1.a) we probably should also have some mechanism to keep adding data to a specific knowledge graph for when it can make many.

  2. I am really happy to see Neo4j or your roadmap as that would be a very practical integration as real world uses cases would probably use that. It also makes visualisation easier.

Good to have:

  1. Sciphi Triplex would be a sick addition which is already on your roadmap.

  2. Can we use Structured Output from OpenAI to ensure the response follows are data models and we don't have to retry multiple times. (saves cost and latency)

Thank you :)

@Ashes47 Ashes47 changed the title [Feature Request] Multiple Knowledge Graphs and Structured Outputs and Neo4j [Feature Request] For a real world application Sep 10, 2024
@gusye1234
Copy link
Owner

To actually use this in any application we must be able to generate multiple independent Knowledge Graph for RAG for diffirent users this will be a must have for actual use. I didn't find any support to do so today happy to help if i can help

For sure, I'm planning to open up a new project for this. Not sure this direction is necessary for nano-graphrag, since the primary purpose of this project is to offer a easy to learn/hack graphrag, not a big got-it-all project.
But yeah, if you're interested in this, we should definitely talk about it, multi-user RAG is exciting and under-explored I think!

Sciphi Triplex would be a sick addition which is already on your roadmap.

Yeah... After playing around with Triplex, I don't think it will be integrated any time soon. Because the entities and relationship it extracts lack semantic information too much. Below is an example of Triplex output:

[1] PERSON: Elon Musk

However, in current process of GraphRAG, we're expecting something like:

Elon Reeve Musk, born June 28, 1971, is a businessman and investor known for his ...

Can we use Structured Output from OpenAI

For sure, but right now gpt-4o has never failed to follow the instructions to output JSON

@Ashes47
Copy link
Author

Ashes47 commented Sep 11, 2024

But yeah, if you're interested in this, we should definitely talk about it, multi-user RAG is exciting and under-explored I think!

Yeah i am happy to put something on your calendar if that works with you and happy to contribute.
My painpoint with microsoft's graph RAG is it's not really a plug and play solution and the cost is too high.

I'm planning to open up a new project for this.

This would be very cool!!

For sure, but right now gpt-4o has never failed to follow the instructions to output JSON

I have been in situation where i had to implement a retry logic because it did fail. Structured output just keeps us from wondering if this could ever happen.

@gusye1234
Copy link
Owner

I have been in situation where i had to implement a retry logic because it did fail. Structured output just keeps us from wondering if this could ever happen.

Got it. Will add strict mode later

Yeah i am happy to put something on your calendar if that works with you and happy to contribute.

Cool, maybe you can join our discord server and we can talk about this in details?

@alexandergirardet
Copy link

Hey how can I join the discord server to contribute?

@rangehow
Copy link
Contributor

rangehow commented Oct 3, 2024

  1. Can we use Structured Output from OpenAI to ensure the response follows are data models and we don't have to retry multiple times. (saves cost and latency)

The "retry" mentioned here refers to which part? As far as I know, there is no retry behavior triggered in the project due to JSON parsing failure.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants