Twitter Crawler AWS

This project is part of the course Introduction to Cloud Computing at OTH Regensburg.

Objective: Create a Twitter Crawler on AWS that finds and downloads images from Twitter given a hashtag. These images will then be displayed on a website.

The crawler should interact with multiple AWS Services and the crawling/downloading process should happen on multiple instances simultaneously.

Used Services:

• EC2
• DynamoDB
• S3
• SQS
• Auto Scaling
• Cloudwatch

Modules:

• Twitter Crawler (Java)
• Image Downloader (Java)
• Front End (NodeJS)

Possible Next steps:

• Use Lambda Function for Twitter Crawler
• Use Amplify for Website