Skip to content

The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.

License

Notifications You must be signed in to change notification settings

Agenta-AI/agenta

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Shows the logo of agenta

Collaborate on prompts, evaluate, and deploy LLM applications with confidence

The open-source LLM developer platform for prompt-engineering, evaluation, human feedback, and deployment of complex LLM apps.

MIT license. Doc PRs welcome Contributors Last Commit Commits per month PyPI - Downloads





Glamour Shot



Quick Start β€’ Features β€’ Documentation β€’ Enterprise β€’ Roadmap β€’ Join Our Slack β€’ Contributing


⭐️ Why Agenta?

Agenta is an end-to-end LLM developer platform. It provides the tools for prompt engineering and management, βš–οΈ evaluation, human annotation, and πŸš€ deployment. All without imposing any restrictions on your choice of framework, library, or model.

Agenta allows developers and product teams to collaborate in building production-grade LLM-powered applications in less time.

With Agenta, you can:

Works with any LLM app workflow

Agenta enables prompt engineering and evaluation on any LLM app architecture:

  • Chain of prompts
  • RAG
  • Agents

It works with any framework such as Langchain, LlamaIndex and any LLM provider (openAI, Cohere, Mistral).

Quick Start

Features

Playground Evaluation
Compare and version prompts for any LLM app, from single prompt to agents.
playground_1024_30.07.2023.mp4
Define test sets, then evaluate manually or programmatically your different variants.
new_eval_demo.mp4
Human annotation Deployment
Use Human annotator to A/B test and score your LLM apps.
Screenshot 2024-01-28 at 12 57 46
When you are ready, deploy your LLM applications as APIs in one click.

Enterprise Support

Contact us here for enterprise support and early access to agenta self-managed enterprise with Kubernetes support.

Book us

Disabling Anonymized Tracking

By default, Agenta automatically reports anonymized basic usage statistics. This helps us understand how Agenta is used and track its overall usage and growth. This data does not include any sensitive information.

To disable anonymized telemetry, follow these steps:

  • For web: Set TELEMETRY_TRACKING_ENABLED to false in your agenta-web/.env file.
  • For CLI: Set telemetry_tracking_enabled to false in your ~/.agenta/config.toml file.

After making this change, restart Agenta Compose.

⭐️ Join Our Team

Contributing

We warmly welcome contributions to Agenta. Feel free to submit issues, fork the repository, and send pull requests.

We are usually hanging in our Slack. Feel free to join our Slack and ask us anything

Check out our Contributing Guide for more information.

Contributors ✨

All Contributors

Thanks goes to these wonderful people (emoji key):

Sameh Methnani
Sameh Methnani

πŸ’» πŸ“–
Suad Suljovic
Suad Suljovic

πŸ’» 🎨 πŸ§‘β€πŸ« πŸ‘€
burtenshaw
burtenshaw

πŸ’»
Abram
Abram

πŸ’» πŸ“–
Israel Abebe
Israel Abebe

πŸ› 🎨 πŸ’»
Master X
Master X

πŸ’»
corinthian
corinthian

πŸ’» 🎨
Pavle Janjusevic
Pavle Janjusevic

πŸš‡
Kaosi Ezealigo
Kaosi Ezealigo

πŸ› πŸ’»
Alberto Nunes
Alberto Nunes

πŸ›
Maaz Bin Khawar
Maaz Bin Khawar

πŸ’» πŸ‘€ πŸ§‘β€πŸ«
Nehemiah Onyekachukwu Emmanuel
Nehemiah Onyekachukwu Emmanuel

πŸ’» πŸ’‘ πŸ“–
Philip Okiokio
Philip Okiokio

πŸ“–
Abhinav Pandey
Abhinav Pandey

πŸ’»
Ramchandra Warang
Ramchandra Warang

πŸ’» πŸ›
Biswarghya Biswas
Biswarghya Biswas

πŸ’»
Uddeepta Raaj Kashyap
Uddeepta Raaj Kashyap

πŸ’»
Nayeem Abdullah
Nayeem Abdullah

πŸ’»
Kang Suhyun
Kang Suhyun

πŸ’»
Yoon
Yoon

πŸ’»
Kirthi Bagrecha Jain
Kirthi Bagrecha Jain

πŸ’»
Navdeep
Navdeep

πŸ’»
Rhythm Sharma
Rhythm Sharma

πŸ’»
Osinachi Chukwujama
Osinachi Chukwujama

πŸ’»
θŽ«ε°”η΄’
θŽ«ε°”η΄’

πŸ“–
Agunbiade Adedeji
Agunbiade Adedeji

πŸ’»
Emmanuel Oloyede
Emmanuel Oloyede

πŸ’» πŸ“–
Dhaneshwarguiyan
Dhaneshwarguiyan

πŸ’»
Priyanshu Prajapati
Priyanshu Prajapati

πŸ“–
Raviteja
Raviteja

πŸ’»
Arijit
Arijit

πŸ’»
Yachika9925
Yachika9925

πŸ“–
Aldrin
Aldrin

⚠️
seungduk.kim.2304
seungduk.kim.2304

πŸ’»
Andrei Dragomir
Andrei Dragomir

πŸ’»
diego
diego

πŸ’»
brockWith
brockWith

πŸ’»
Dennis Zelada
Dennis Zelada

πŸ’»
Romain Brucker
Romain Brucker

πŸ’»
Heon Heo
Heon Heo

πŸ’»
Drew Reisner
Drew Reisner

πŸ’»
Ikko Eltociear Ashimine
Ikko Eltociear Ashimine

πŸ“–
Vishal Vanpariya
Vishal Vanpariya

πŸ’»
Youcef Boumar
Youcef Boumar

πŸ“–
LucasTrg
LucasTrg

πŸ’» πŸ›
Ashraf Chowdury
Ashraf Chowdury

πŸ› πŸ’»
jp-agenta
jp-agenta

πŸ’» πŸ›
Mr Unhappy
Mr Unhappy

πŸ› πŸš‡

This project follows the all-contributors specification. Contributions of any kind are welcome!

Attribution: Testing icons created by Freepik - Flaticon