Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I am not getting responses related to my data. #1954

Open
Ahmetay882 opened this issue Sep 4, 2024 · 4 comments
Open

I am not getting responses related to my data. #1954

Ahmetay882 opened this issue Sep 4, 2024 · 4 comments

Comments

@Ahmetay882
Copy link

Please provide us with the following information:

This issue is for a: (mark with an x)

- [ ] bug report -> please search issues before submitting
- [ ] feature request
- [x] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

I want to create a financial ChatGPT assistant that can help my clients with finance-related topics. I am using this repository, but I have encountered some issues. My problems are:

1.) Even though I have uploaded my Excel file to this repository, when I ask questions related to my data, I receive an error saying that the information cannot be found in the provided file, even though it exists in the Excel table. Could you help me understand why this is happening?

2.) I want the assistant to prioritize using the data from my Excel table for finance-related questions. If the information is not available in my table, I would like it to fall back on GPT-4’s own data, but only for financial topics. How can I set this up?

I would greatly appreciate any help or guidance on these issues. Below, I am sharing a sample from a part of my Excel table.

excell


Thanks! We'll be in touch soon.

@pamelafox
Copy link
Collaborator

Have you gone through our guide already about debugging answer quality?

https://github.com/Azure-Samples/azure-search-openai-demo/blob/main/docs/customization.md#improving-answer-quality

That should help you pinpoint whether the issue is the retrieval, the LLM step, or the data formatting from the ingestion step.

As for #2), I suggest saying that in the system prompt. You can tell it that it's also allowed to use information that it already knows, if it can't find the answer in the sources.

@Ahmetay882
Copy link
Author

Hello Pamela,

Thank you for answering my question.

I have solved my second issue, and I appreciate your help.

Regarding my first issue, I have looked at the steps, but I think the problem is caused by not being able to read the Excel file I uploaded. This issue does not occur when I upload a PDF document. Do you have any ideas about this?

@bp3000bp
Copy link

@Ahmetay882 in my experience llms don't work as well with tabular data. I've had to write scripts to turn excel files into pdfs with text, and it works much better after being converted to text. unfortunately.

@Ahmetay882
Copy link
Author

@bp3000bp Hello, can you give me an example of how you did it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants