Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error running example locally using Ollama #50

Closed
NanaXiong00 opened this issue Apr 17, 2024 · 2 comments
Closed

Error running example locally using Ollama #50

NanaXiong00 opened this issue Apr 17, 2024 · 2 comments
Labels
bug Something isn't working question Further information is requested

Comments

@NanaXiong00
Copy link

Describe the issue:
Using Ollama to run the example locally, opening the web http://localhost:8000 chat fails with the following error:
image
image

Repro Steps:

  1. Run command git clone https://github.com/Azure-Samples/serverless-chat-langchainjs.git
  2. Install and run Ollama
  3. Run command ollama pull mistral and ollama pull all-minilm:l6-v2
  4. Run command npm install
  5. Run command npm start
  6. Run command npm run upload:docs
  7. Open the URL http://localhost:8000

Environments:

  • azd version: azd version 1.8.0 (commit 8246323c2472148288be4b3cbc3c424bd046b985)
  • os: windows

Expected behavior:
Open the URL http://localhost:8000 in the browser and successfully start chatting with the bot

@sinedied for notification.

@sinedied
Copy link
Contributor

@NanaXiong00 Thanks for the report! could you check that Ollama is working correctly? I frequently have to restart it manually because of updates. You can check if it works by running the command:

ollama run mistral

If the model starts and you can chat with it, it should be good. If not, try restarting Ollama.

From the logs, it also seems that you tried testing the chat before the document where ingested (running npm run upload:docs). Seems like the ingestion worked, did you try again the chat after that?

@sinedied sinedied added bug Something isn't working question Further information is requested labels Apr 19, 2024
@NanaXiong00
Copy link
Author

Follow the above reply and test again. The problem cannot be reproduced, so I closed it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants