Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create specific table csv dumps in Google Drive #2387

Open
atalyaalon opened this issue May 10, 2023 · 0 comments
Open

Create specific table csv dumps in Google Drive #2387

atalyaalon opened this issue May 10, 2023 · 0 comments
Assignees
Milestone

Comments

@atalyaalon
Copy link
Collaborator

atalyaalon commented May 10, 2023

By now we created dumps locally and sent them to relevant stakeholders (e.g Dror Reshef)
We want to write these csv tables to a google drive repo that these stakeholders will have access (We can discuss if you want to change it from google drive to a different tool, we do prefer controlling who has access).
This can be done as a part of cbs import from s3, as the last stage (the relevant command:
python3 main.py process cbs --source s3

Relevant reference (I assume you might find a neater way to do so):

When using docker locally these are the actioned performed:

mkdir csv_tables
chmod 777 csv_tables
psql anyway anyway
copy markers_hebrew to '/csv_tables/markers_hebrew.csv' delimiter ',' CSV HEADER; copy involved_hebrew to '/csv_tables/involved_hebrew.csv' delimiter ',' CSV HEADER; copy vehicles_hebrew to '/csv_tables/vehicles_hebrew.csv' delimiter ',' CSV HEADER; copy involved_markers_hebrew to '/csv_tables/involved_markers_hebrew.csv' delimiter ',' CSV HEADER; copy vehicles_markers_hebrew to '/csv_tables/vehicles_markers_hebrew.csv' delimiter ',' CSV HEADER;```

And outside the docker shell:
`docker cp db:/csv_tables .`
@atalyaalon atalyaalon changed the title Create s3 specific table dumps Create specific table csv dumps in Google Drive May 10, 2023
@atalyaalon atalyaalon added this to the v.0.17.0 milestone Oct 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants