Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request]: Hugging Face Embedding Server #32

Open
tazarov opened this issue Dec 19, 2023 · 0 comments
Open

[Feature Request]: Hugging Face Embedding Server #32

tazarov opened this issue Dec 19, 2023 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@tazarov
Copy link
Contributor

tazarov commented Dec 19, 2023

Describe the problem

As a user I want to be able to have custom embedding function server based on HuggingFace Embedding Inference server - https://github.com/huggingface/text-embeddings-inference

Describe the proposed solution

A simple replicaset that can scale the the huggingface EF server with initial CPU support only

Alternatives considered

N/A

Importance

would make my life easier

Additional Information

No response

@tazarov tazarov added the enhancement New feature or request label Dec 19, 2023
@tazarov tazarov self-assigned this Dec 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant