Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.

🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫

🦜🔗 Build context-aware reasoning applications

LangChain for Go, the easiest way to write LLM-based programs in Go

Go SDK for Google Generative AI

NVIDIA device plugin for Kubernetes

NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes

Pinecone.io Golang Client

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

Giving Kubernetes Superpowers to everyone

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…

fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.

The official Go library for the OpenAI API

DeepSeek LLM: Let there be answers

DeepSeek Coder: Let the Code Write Itself

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Helm chart for Ollama on Kubernetes

LLM inference in C/C++

Pipelines: Versatile, UI-Agnostic OpenAI-Compatible Plugin Framework

Docker compose setup for Ollama and Open WebUI

AI on the command line

LlamaIndex is the leading framework for building LLM-powered agents over your data.

Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! 🦥

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

Automatic SRE Superpowers within your Kubernetes cluster

Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.