Skip to content

SteveScott/db-safegraph

This branch is 1 commit ahead of, 358 commits behind MODA-NYC/db-safegraph:master.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

e6a9ceb · Aug 31, 2021
Aug 31, 2021
Oct 23, 2020
Apr 6, 2021
Dec 17, 2020
Oct 21, 2020
Dec 16, 2020
Aug 20, 2020
Oct 5, 2020
Dec 14, 2020
Oct 9, 2020
Oct 9, 2020
Oct 20, 2020

Repository files navigation

db-safegraph

Note:

  • if you are a programatic user, checkout our sample notebooks under examples. Open In Colab
  • If you are a desktop user and prefer to access data through a desktop GUI app, please check out cyber duck

Instructions

  1. Install dependencies
pip3 install -r requirements.txt
  1. Install cli autocomplete
./sg --install-completion
  1. Run a recipes (when you hit TAB there should be a list of available recipe names, autocomplete is availble here)
./sg run [TAB]

Note: type ./sg --help to get a list of available comamnds

Usage: sg [OPTIONS] COMMAND [ARGS]...

Options:
  --install-completion  Install completion for the current shell.
  --show-completion     Show completion for the current shell, to copy it or
                        customize the installation.

  --help                Show this message and exit.

Commands:
  run    Running an Athena recipe in the ./recipes folder
  setup  Install minio and set up the accounts we need
  sync   Syncing a safegraph data source, under the ./_sync folder

Resources

About

SafeGraph ETL

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 74.4%
  • Shell 24.8%
  • Dockerfile 0.8%