-
Notifications
You must be signed in to change notification settings - Fork 5.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug]: ollama not wroking #3960
Comments
Can please you try this: open the app on localhost:3000, and enter in Settings the model, API key, and base URL? Does it work to see the |
https://www.logpasta.com/paste/99927887-c724-425d-9ae5-07580bc64e13 |
I think the docker problem is the main issue there, but first, please also try to simplify the command a bit, and pull the 0.9 tag instead of
About the docker issue: can you try to check if docker networking is working? Could start by restarting Docker and checking if it's up to date. That error doesn't seem related to openhands, but docker installation or configuration, I would say. |
It works for me when I add Commands I used to get it working:
|
thanks but im not using ollama anymore, could you check this one out tho #4586 (comment) |
when I add |
This is not working for me.
or
But when I try your command I get this:
|
This is basic docker networking configuration. ollama serve # from the docs, no modifications required
docker run -it --rm --pull=always \
-e SANDBOX_RUNTIME_CONTAINER_IMAGE=docker.all-hands.dev/all-hands-ai/runtime:0.13-nikolaik \
-v /var/run/docker.sock:/var/run/docker.sock \
-p 3000:3000 \
-e LOG_ALL_EVENTS=true \
--add-host host.docker.internal:host-gateway \
--name openhands-app \
docker.all-hands.dev/all-hands-ai/openhands:0.13 Now open the UI and configure your provider using Works fine for me! |
You are AMAZING! Thanks for helping me get this figured out, I got it working on my PC. A bit slow but hey at least it's free! Thanks a bunch :) |
That's great. I've queued this in my todo list and see in incorporating it. Thank you @skylarmb!!! |
@skylarmb should this type of Advanced usage be documented then, since the network configs are mostly trivial? (and yes, that includes adding custom Ollama models like Qwen and Phi that are usually not in the default selector) |
You may want to check this out: https://docs.all-hands.dev/modules/usage/llms/local-llms |
This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. |
This issue was closed because it has been stalled for over 30 days with no activity. |
Is there an existing issue for the same bug?
Describe the bug
when i start openhands with ollama it just doesnt work
Current OpenHands version
Installation and Configuration
Model and Agent
model: deepseek-coder-v2:latest
Operating System
linux chachyos
Reproduction Steps
i dont know how to reproduce on other installs
Logs, Errors, Screenshots, and Additional Context
https://discord.com/channels/1222935860639563850/1281641914210455643
The text was updated successfully, but these errors were encountered: