Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow changing the entire prompt #1018

Open
1 task done
poculeka opened this issue Feb 11, 2025 · 2 comments
Open
1 task done

Allow changing the entire prompt #1018

poculeka opened this issue Feb 11, 2025 · 2 comments

Comments

@poculeka
Copy link

poculeka commented Feb 11, 2025

Describe the feature you'd like

I would like to have a possibility to change default prompts (text, image, summarization) without recompiling the project.

Describe the benefits this would bring to existing Hoarder users

With this feature, users will be able to fully customize the prompts used to communicate with LLMs.

There are some open issues, where current prompts are tweaked to work better with users' local language models, but each model works differently - prompts which work perfectly with llama3.2 might not work with deepseek-r1 or qwen.

In my case, the default prompt didn't always return satisfying results, even when I created some tagging rules using Hoarder settings.

Can the goal of this request already be achieved via other means?

Yes, Hoarder can be rebuilt with custom prompt. It is very frustrating, though - in order to keep Hoarder version up to date, each new release must be rebuilt with prompt changes.

Have you searched for an existing open/closed issue?

  • I have searched for existing issues and none cover my fundamental request

Additional context

My suggestion would be to allow prompts customization through .env variables. This way the default prompts can be kept in the codebase and they could be updated on demand without rebuilding the application / container. Such approach would also be consistent with other inference configuration options - for example OpenAI / Ollama URLs, which are also global for the whole Hoarder instance.

I already have some code which implements these changes, I can open a PR if such solution is acceptable.

@kamtschatka
Copy link
Contributor

i am also running into issues, because the prompt contains things you might want to override.

  • Aim for 3-5 tags.
    3-5 tags is usually quite excessive, I would prefer 3 at max

@MohamedBassem
Copy link
Collaborator

Please have a look at my comment here: #1029 (comment)
This is intentionally restricted. I'm wiling to add more flexibility to customize pre-packaged rules, but I'm not planning to give up the control on the prompt structure itself to allow me to evolve it in the future.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants