Google Cloud Function - Python

These scripts extract data from a source location (FTP server or MySQL DB) and pushes that data to a Bigquery data-warehouse.

• Note that the imported libraries need to be in a seperate file called "requirements.txt"
• Your application secrets should not be in the code but should be in a secret manager ideally.

These scripts are referenced in these articles:

• Building a pipeline from an FTP server to BigQuery and
• Building a pipeline from a MySQL DB to BigQuery