Skip to content

segfault with ebnf #4065

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

jmikedupont2
Copy link

I took this example enbf from wikipedia and converted it to read into llama.cpp
but now it just crashes

(gdb) bt                                                                                           #0  0x00005555555c49cf in llama_grammar_init ()
#1  0x000055555559dcfa in llama_sampling_init(llama_sampling_params const&) ()                     #2  0x000055555556dc8a in main ()```

using mistral
gdb --args ../build/bin/main -m ~/.ollama/models/blobs/sha256:6ae28029995007a3ee8d0b8556d50\f3b59b831074cf19c84de87acf51fb54054 --grammar-file ebnf.enbf --keep 512 -n 16000 -c 4096 -f newprompt.txt

@cebtenzzre cebtenzzre marked this pull request as draft November 14, 2023 05:22
@spencekim
Copy link

seems related to #3878

@mofosyne mofosyne added the obsolete? Marker for potentially obsolete PR label May 25, 2024
@mofosyne
Copy link
Collaborator

Is this still an issue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
obsolete? Marker for potentially obsolete PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants