Enhancement: Add tags for "silent thinking"

[jars08]

When Claude 3.5 Sonnet released, they used something where they let the model reason step by step in tags. These are invisible to the user, but they give the model the opportunity to "think" silently or to reason in a lot of steps and only give the user the correct answer without the complete reasoning in small steps. For advanced prompting techniques (which are practically feasible with the prompt library, thank you for that) this could be very useful.
So my suggestion is to have tags and everything in between the tags will be hidden from the user.

Im not good at coding myself so I probably can't help a lot with implementing this, but do you think this could be worth pursuing or would it be too much work for the benefit it brings?

Example made with ChatGPT 4o

SYSTEM PROMPT:

You are a highly intelligent AI capable of silent thinking. You can use the ... tags to process information internally before delivering your final response. The text within the tags will not be shown to the user, but will help you form a better answer.

For example, when asked a complex question, you can consider multiple angles, recall relevant information, and deliberate internally using the tags.

Guidelines:

1. First, assess the user's query and identify any complex aspects that require deeper thought.
2. Use the ... tags to handle your silent processing. Include all relevant internal considerations, evaluations, and calculations within these tags.
3. After completing your internal deliberation within the tags, provide a well-considered and coherent response to the user.

PROMPT:

Should i start cleaning my stairs from the top or the bottom?

ANSWER:

<librechat-thinking>
    1. Cleaning the stairs involves dealing with dust, dirt, and possibly spills.
    2. Consider how gravity and the nature of cleaning tasks (sweeping, mopping) affect the process.
    3. Cleaning from the top down generally prevents dirt from falling onto already-cleaned areas.
    4. This method is often more efficient as debris moves downward due to gravity.
    5. Provide a clear, reasoned explanation for the recommendation.
    </librechat-thinking>

It's generally more efficient to start cleaning your stairs from the top and work your way down. This way, any dust, dirt, or debris you sweep or wipe away will naturally fall to the steps below that you haven't cleaned yet, ensuring you don't have to clean the same steps multiple times. This approach makes the cleaning process more efficient and effective.

[danny-avila]

Early on, this was called an "agent scratchpad" or "self-reflection." These are behaviors possible in an agentic system, which I'm currently building for LibreChat.

While I may not be implementing the exact request here, things like this will be possible with any model that supports function/tool calling, which includes Claude-3.5.

[jars08]

Thank you for your reply, I didn't know that. I'm looking forward to your new agentic system! Thank you for all your work.

[danny-avila]

Ah I see, here’s a relevant discussion to this: #3521 (comment)