-
Notifications
You must be signed in to change notification settings - Fork 0
Home
Here you will find some great information about the data found in the 211Dashboard Project's database and some of the configuration details for the project's data pipeline. This project was a joint effort by the St. Louis Regional Data Alliance (RDA) and Daugherty Business Solutions. The project was designed in the wake of the COVID-19 pandemic with the intention to inform the public and government officials about the health and vulnerability of our St. Louis and Missouri communities. It is our hope that this project encourages organizations to share additional data resources so that we can begin to truly understand the impacts of COVID-19 (and other disasters) so that we may better serve our communities. We also encourage other cities/states to utilize the tools and code described in this repository to recreate similar efforts for their home communities.
Currently, there are 5 main sources of data:
- COVID-19 data
- This data is taken from the covid_daily_viz project (maintained by RDA member and Saint Louis University faculty Chris Prener).
- Unemployment data (both weekly claims and monthly statistics)
- United Way 2-1-1 call data
- Community Conditions (i.e. Census) data
- Community Funding data
The wiki pages in this repo primarily describe 1) the airflow pipeline development/configuration 2) the data/database. If you are interested in learning about the airflow pipeline and how to potentially add new DAGs/tasks, visit the following wiki pages for more information:
If you are interested in learning more about the database design, the data load methodology, or the actual data that makes up this project, see the following wiki pages:
The simple architecture diagram below gives a very general overview of the 211Dashboard project. Originally, the 2-1-1 data from the United Way was to be included in the 211Dashboard database; however, United Way did not want the data leaving their servers. So as of 6/25/2020 we are planning to connect the end product (the Tableau dashboard) to both data sources: the PostgreSQL 211Dashboard database and the MySQL United Way 2-1-1 database. This repository contains the code to configure the input/output data flow with Airflow and to build the 211Dashboard database. The next step is to use what this repository creates to create the public-facing dashboard in Tableau.