Skip to content
@LlamaEdge

LlamaEdge

The easiest, smallest and fastest local LLM runtime and API server. Creating cross-platform LLM agents and web services in Rust.

Pinned Loading

  1. LlamaEdge LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 1k 87

  2. rag-api-server rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    Rust 23 7

  3. workshops workshops Public

    8 1

  4. docs docs Public

    JavaScript 3 5

Repositories

Showing 10 of 17 repositories
  • LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/LlamaEdge’s past year of commit activity
    Rust 1,017 Apache-2.0 87 4 (1 issue needs help) 1 Updated Oct 1, 2024
  • rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    LlamaEdge/rag-api-server’s past year of commit activity
    Rust 23 Apache-2.0 7 9 2 Updated Oct 1, 2024
  • sd-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/sd-api-server’s past year of commit activity
    Rust 7 2 2 0 Updated Sep 29, 2024
  • whisper-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/whisper-api-server’s past year of commit activity
    Rust 6 2 0 0 Updated Sep 26, 2024
  • tts-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/tts-api-server’s past year of commit activity
    Rust 0 0 0 0 Updated Sep 26, 2024
  • llama-gateway Public
    LlamaEdge/llama-gateway’s past year of commit activity
    Rust 0 0 0 0 Updated Sep 23, 2024
  • www Public

    Public website

    LlamaEdge/www’s past year of commit activity
    HTML 0 3 0 0 Updated Sep 23, 2024
  • docs Public
    LlamaEdge/docs’s past year of commit activity
    JavaScript 3 Apache-2.0 5 0 2 Updated Sep 23, 2024
  • search-api-server Public

    An extended version of the LlamaEdge API Server with web search. In development.

    LlamaEdge/search-api-server’s past year of commit activity
    Rust 2 0 4 0 Updated Sep 10, 2024
  • llamaedge-query-server Public

    An optional query server for the LlamaEdge search enabled rag-api-server.

    LlamaEdge/llamaedge-query-server’s past year of commit activity
    Rust 0 0 0 0 Updated Aug 29, 2024
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Most used topics

Loading…