Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mistral ollama function calling not supported warning #4

Open
rajp152k opened this issue Dec 19, 2024 · 5 comments
Open

Mistral ollama function calling not supported warning #4

rajp152k opened this issue Dec 19, 2024 · 5 comments

Comments

@rajp152k
Copy link

rajp152k commented Dec 19, 2024

my config is using the filesystem mcp server distributed officially via their github:

{
  "mcpServers": {
    "filesystem": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-filesystem",
        "/tmp"
      ]
    }
  }
}

the interaction is as follows (I entered /tools and /servers)

 ~/source/prac/MCP/mcp-golang  base  130 ❯ mcphost ollama --model mistral --config ./mcphost-config.json
2024/12/19 18:41:13 INFO Initializing server... name=filesystem

Warning: Model mistral does not support function calling. Tools will be disabled.


    Tools are currently disabled for this model.




      # filesystem

      Command npx

      Arguments -y @modelcontextprotocol/server-filesystem /tmp


┃ Enter your prompt (Type /help for commands, Ctrl+C to quit)
┃
┃
┃
┃
┃
┃

alt+enter / ctrl+j new line • ctrl+e open editor • enter submit

the model being mistral:7b https://ollama.com/library/mistral:7b

@BindingOx
Copy link

did you find a good model?

@ade1963
Copy link

ade1963 commented Dec 30, 2024

Try granite3.1-dense

D:>mcphost -m ollama:granite3.1-dense:2b-instruct-q5_K_M

2024/12/30 08:03:51 INFO Model loaded provider=ollama model=granite3.1-dense:2b-instruct-q5_K_M
2024/12/30 08:03:51 INFO Initializing server... name=date
2024/12/30 08:03:51 INFO Server connected name=date
2024/12/30 08:03:51 INFO Tools loaded server=date count=1

You: What is date today?

Assistant:

2024/12/30 08:04:12 INFO 🔧 Using tool name=date__get_current_date

Assistant:

The current date is 2024-12-30.

@rajp152k
Copy link
Author

rajp152k commented Dec 31, 2024

still facing the same issue

do you have your ollama configured a particular way? I'm using it as is..

@rajp152k
Copy link
Author

I tried a similar tool https://github.com/chrishayuk/mcp-cli with ollama:llama3.2 and it works

image

Not sure what I might be missing with mcp-host

@ade1963
Copy link

ade1963 commented Jan 1, 2025

still facing the same issue

do you have your ollama configured a particular way? I'm using it as is..

Just installed current ollama release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants