This is a small sbt program that fetches some data from a kafka topic and with the help of spark streams , it streams the data to another kafka topic applying the various transformations in between.
- Zookeeper and kafka should be running
- Create the topics 'inputTopic' and 'outputTopic'
- Run the SimpleDStreamExample.scala class.
- Run the SendDataToKakfa.scala class.
- Consume from the 'outputTopic' to ensure that the data is being streamed.