Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Token&cost counters #54

Open
FreedomCoder-dev opened this issue Dec 30, 2024 · 1 comment
Open

[Feature Request] Token&cost counters #54

FreedomCoder-dev opened this issue Dec 30, 2024 · 1 comment
Labels

Comments

@FreedomCoder-dev
Copy link

Reference Issues

No response

Summary

Is an everyday LLMs user, I would like to be aware of token usage/cost stats for each chat and globally for all accounts (e.g. for last week or just today).
There might be a section in settings to add token/cost counter for chats/API services/globally, also we may convert tokens to cost directly, so currency settings can also be great

Basic Example

I use some costly models sometimes and wanna be in control of my spendings.
Some APIs, e.g. OpenRouter API, allow to load cost details automatically, that can be useful.

Drawbacks

No response

Unresolved questions

No response

@FreedomCoder-dev
Copy link
Author

In #50 we may start caching token cost details in advance

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant