Discussions

• 1 You must be logged in to vote

  🙏

  RuntimeError: Bad Response to AzureGuidance Request (404 Not Found)

  shandilyabh asked Oct 5, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  how to add arbiatry remote model?

  oedemis started Sep 18, 2024 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  Will multiple sequences be supported for LLamaCpp backend?

  alfie-nsugh started Sep 13, 2024 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is there a way to limit generation length in select?

  afg1 asked Sep 11, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  Raw BNF grammars instead of Guidance grammar DSL

  lemontheme asked May 3, 2024 in Q&A · Unanswered

  

  

  

  

  9
• 2 You must be logged in to vote

  🙏

  Cannot use Guidance with AZURE - ConstraintException

  doomgrave asked Dec 22, 2023 in Q&A · Unanswered

  

  

  

  

  9
• 4 You must be logged in to vote

  🙏

  Using models locally via Ollama.ai

  JanMP asked Aug 20, 2023 in Q&A · Unanswered

  

  

  

  

  7
• 1 You must be logged in to vote

  🙏

  Supported transformers models?

  jammiguelyfish asked Aug 9, 2024 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  💬

  I have an issue when loading a Qwen chat model with LlamaCpp

  Abdechakour-Mc started Jun 21, 2024 in General

  

  

  

  

  3
• 1 You must be logged in to vote

  💬

  Language Restriction for LLM Outputs

  yileitu started Jul 13, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to use this with hugging face API?

  michael-newsrx asked Jun 27, 2024 in Q&A · Closed · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Does guidance need an API endpoint that supports streaming?

  afg1 asked Jun 24, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💡

  Enable chat completition/embeddings Openai Endpoint in Guidance Server

  doomgrave started Jun 23, 2024 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  Help needed using Select Object

  mbilalazeem asked Jun 19, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙌

  Terminal output color and streaming!

  dimondjik started May 22, 2024 in Show and tell

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Comparison between Guidance and AICI

  rudrOwO asked Jun 2, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Token healing?

  yonitjio asked Apr 11, 2024 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  What's going on under the hood?

  rudrOwO asked May 31, 2024 in Q&A · Unanswered

  

  

  3
• 2 You must be logged in to vote

  💡

  Why is there no support for top-p / top-k ?

  DanJbk started Jan 20, 2024 in Ideas

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  Is there support for mamba-based models, or am I doing something wrong?

  zvxayr asked May 1, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  TypeError with ModelStream Object in Python

  snowyday asked May 9, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  I keep getting <|eot_id|> or </s> in my outputs when using chat mode for llama-3-8b-instruct and mistral-7b-instruct.

  michael-newsrx asked Apr 30, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙌

  Guidance called from Chainlit

  snowyday started May 5, 2024 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  🙏

  Guaranteeing valid output syntax with API based models

  woolr asked Apr 4, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Can guidance be used on custom models or NVIDIA NEMO model ?

  tcourat asked Apr 5, 2024 in Q&A · Unanswered

  

  

  0