Embeddings return 404 error

[RuofengX]

ollama-rs/src/generation/embeddings/mod.rs

Line 17 in 56d7ec2

let url = format!("{}api/embed", self.url_str());

Seems like ollama has change the url endpoint to /api/embeddings.

ollama version: 0.1.44

[boydjohnson]

https://github.com/ollama/ollama/blob/main/docs/api.md#generate-embeddings The current main on Ollama shows api/embed as the endpoint.

A blog post from April 2024 says api/embeddings but the current docs say api/embed.

I just did a local test and you appear to be right. I just did a local test and for llama2:latest they both returned 200s but behaved differently.

[boydjohnson]

From the Ollama go api client:

// Embed generates embeddings from a model.
func (c *Client) Embed(ctx context.Context, req *EmbedRequest) (*EmbedResponse, error) {
        var resp EmbedResponse
        if err := c.do(ctx, http.MethodPost, "/api/embed", req, &resp); err != nil {
                return nil, err
        }
        return &resp, nil
}

// Embeddings generates an embedding from a model.
func (c *Client) Embeddings(ctx context.Context, req *EmbeddingRequest) (*EmbeddingResponse, error) {
        var resp EmbeddingResponse
        if err := c.do(ctx, http.MethodPost, "/api/embeddings", req, &resp); err != nil {
                return nil, err
        }
        return &resp, nil
}

They are both valid api endpoints.

[boydjohnson]

ollama/ollama#7490 (comment)
says
/api/embeddings is deprecated, use /api/embed. The reason the returned embedding is empty is because /api/embeddings uses prompt not input for the text to process.