Google Cloud Storage Integration

[deanhannigan]

Description

Adding Google Cloud Storage support to Budibase.

Query, create and manage buckets in your Google Cloud Storage and allow users to upload new media via Budibase.

Query Types

• Create Bucket

  • Bucket Name - the name of your new bucket. You will be notified if the bucket name is not unique
  • Location - http://g.co/cloud/storage/docs/locations#location-mr
  • Storage Class - https://cloud.google.com/storage/docs/storage-classes
  • Public (Optional) - this will provide completely unauthenticated access to the bucket. Ensure that this is the desired outcome.

• Delete File By Key

  • Bucket Name - the name of the target bucket.
  • Delete - the key of the file to be deleted. You can hard code this or use a binding to build a dynamic delete in your application

• Read Bucket

  • List all available media in your bucket and integrate them into your applications.
  • Bucket Name - the name of the target bucket.

Authorization

The integration currently supports Service Account authorization by JSON token; the contents of which are used to configure the datasource. The following fields are required from the token.

• Project Id
• Private Key
• Client Email - the service user email.

Privileges granted to the service can be managed in the Google Cloud Console.

Addresses:

• Add Google Cloud Storage File Upload #8939

Screenshots

The Google Cloud Storage File Upload component is now available in the components list.

The Upload File to GoogleCloud button action

Feature branch env

Feature Branch Link

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 17.94872% with 32 lines in your changes are missing coverage. Please review.

Project coverage is 67.42%. Comparing base (c2a82bb) to head (a43591e).
Report is 2665 commits behind head on master.

❗ Current head a43591e differs from pull request most recent head c0177aa. Consider uploading reports for the commit c0177aa to get more accurate results

Files	Patch %	Lines
packages/server/src/integrations/googlecloud.ts	15.38%	22 Missing ⚠️
...ackages/server/src/api/controllers/static/index.ts	16.66%	9 Missing and 1 partial ⚠️

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@            Coverage Diff             @@
##           master   #12267      +/-   ##
==========================================
- Coverage   67.52%   67.42%   -0.10%     
==========================================
  Files         505      506       +1     
  Lines       20170    20206      +36     
  Branches     4176     4178       +2     
==========================================
+ Hits        13619    13624       +5     
- Misses       6056     6086      +30     
- Partials      495      496       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[samwho]

I know this isn't quite ready for merging yet but I'm doing a sweep of all PRs and thought I'd take a look. Hope that's okay.

[melohagan]

It looks good, however I feel like we should try and reduce the duplicate code, actions and components, because Azure Storage can also be added: #12530

[deanhannigan]

It looks good, however I feel like we should try and reduce the duplicate code, actions and components, because Azure Storage can also be added: #12530

I replaced the duplicated UI/UX with a common StoreUpload component. Both S3 and GCS use it with a type parameter to discern which cloud storage endpoint is being targeted

[shogunpurple]

@deanhannigan can we move this to draft if it's not ready for review/merge?