A Web UI to check for tokens and character count of palm api

[ichandan2151]

Description of the feature request:

A web ui where a user can come and input his text to check for tokens and character.

What problem are you trying to solve with this feature?

This would help the user to check his character count. In fine tuning a model in maker suite the output should be less than 5000 character. This way the user can open the webapp and past his output o check for characters.

Any other information you'd like to share?

https://platform.openai.com/tokenizer
U can check this for reference. Something like this for palm api would be fantastic.

[markmcd]

Cool idea - ideally we would host something on the site, but it would also be helpful to have a Glitch project or similar that does this (it could go in /examples/palm/glitch or similar)

[omkharche8]

Is it solved yet????
I can do this
As on 20/5/24 there is still no straight forward method of solving it

[AmineAouragh]

Hey everyone, is there any built solution or not yet? I am thinking about building a separate web app just to test this and would like to share it in here later just to show how it could work and then we will discuss how to integrate it to Gemini if nobody has done this yet.

Also I just found out today that PaLM was decommissioned months ago

"As of August 15, 2024, the PaLM API is decommissioned, meaning that you can't use a PaLM model in a prompt, tune a new PaLM model, or run inference on PaLM-tuned models." source: Palm API deprecation