Skip to content

Latest commit

 

History

History
50 lines (34 loc) · 3.15 KB

README.md

File metadata and controls

50 lines (34 loc) · 3.15 KB

Cloud Introduction and Storage

The following repo contains excercises related to the 2024-2025 Cloud introduction and storage modules of the Big Data & Cloud Master at EDEM

The folders are structured as follows:

cloud-intro

  • local_cloud: Use of VirtualBox to simulate locally IaaS and PaaS solutions so that the students get familiar with the fundamental concepts of different service models
  • end2end: an end2end excercise to practice in class the use of a full architecture with different components that simulate what they can find in the cloud

Google Cloud Platform

gcp_setup

  • README.md: Instructions to create a GCP account and create a Compute Engine instance
  • excercise_1: Excercise to deploy part of the end2end architecture in GCP

gcp_sql

  • excercise_postgresql: Excercise to deploy a PostgreSQL instance in GCP, create tables and insert data using Mockaroo
  • excercise_alloy_db: Excercise to deploy an AlloyDB instance in GCP, and compare it with the performance of PostgreSQL by running some queries
  • excercise_e2e: Excercise to deploy an end2end architecture in GCP, using Cloud SQL, PubSub and Compute Engine instances

gcp_datawarehouse

  • excercise_bigquery: Excercise to try the basic functionalities of BigQuery
  • excercise_end2end: Excercise to deploy an end2end architecture in GCP, using Cloud SQL, PubSub, Compute Engine instances and BigQuery

gcp_datalake

  • excercise_gcs: Excercise to create a bucket and check its functionality as a object storage container used as a data_lake
  • excercise_end2end: Excercise to deploy an end2end architecture in GCP, using Cloud SQL, PubSub, Compute Engine instances, BigQuery and GCS

gcp_nosql

  • excercise_stocks: Excercise to use BigTable to store and query stock data
  • excercise_iot: Excercise to use an IoT application with Raspberry Pi and BigTable to query temperature data in real time.

Amazon Web Services

aws_setup

  • README.md: Instructions to create an AWS account and create an EC2 instance
  • end2end: Excercise to practice python and Cloud Products in AWS

aws_sql

  • excercise: Excercise to deploy a RDS instance in AWS, create tables and insert data

aws_datalakehouse

  • excercise: Excercise to practice the use of Apache Iceberg with AWS Glue and Athena

aws_nosql

  • excercise_1: Excercise to practice the use of DynamoDB with Python
  • excercise_2: Excercise to practice the use of DynamoDB with Python with a more complex example