Application to provide realtime alerts for crime for all registered users using email or SMS. Provide analytics on historical and realtime ingested data of all crimes comparing with other socio-economic factors.
- Stream Crime Data from Control Centers to KAFKA (IBM BLUEMIX MESSAGE HUB)
- Use Apace Spark to stream Data from KAFKA and store in HDFS
- Perform Analytics using Spark
- Provide Email and SMS alerts for violent crimes
- Stream Crime Data to KAFKA (IBM BLUEMIX MESSAGE HUB) from Control Centers.
- Read Stream's of Data in real-time from Kafka using Apache Spark Streaming (using scala as programming language).
- Store data to Hadoop Distributed File System (HDFS) for ETL processing and perform analytics.
- Filter violent crimes and store in Amazon RDS for NodeJS web app to send alerts to all registered users in interested area.
- Web application reads from RDS and sends out alerts to users in realtime.
Kafka/Producer - To stream data into Kafka topics.
NodeJS_Application - Web application to send alerts and register user's. Website URL: http://ec2-34-216-77-34.us-west-2.compute.amazonaws.com:3019/
SparkStreaming - Spark/Scala application for realtime streaming and performing analytics.