Kafka-REST-Confluent-k8s

Provides a RESTful interface to a Kafka cluster by Confluent running inside a Kubernetes cluster.

By default version 3.1 of the REST API is used to be compliant with the Kafka Bigtop charm. Full API overview can be found here.

Usage

juju deploy ./kafka-rest-confluent-k8s kafka-rest
juju add-relation kafka-rest kafka
juju add-relation kafka-rest kubernetes-deployer

# Reverse proxy
juju add-relation kafka-rest nginx-api-gateway

# Add / remove rest instances
juju config kafka-rest "pods=3"
# Or configure the autoscaler
juju config kafka-rest "autoscale=2,5"

Caveats

• This charm should only be used for producing data to Kafka. Creating consumers will return a wrong baseline url and require sticky sessions if #pods > 1.
• Autoscale will trigger at 50% CPU utilization. The pod itself requests 1000m CPU.

Authors

This software was created in the IBCN research group of Ghent University in Belgium. This software is used in Tengu, a project that aims to make experimenting with data frameworks and tools as easy as possible.

• Sander Borny [email protected]