Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NTD Modeling – Mart – Remaining Tables in Dataset #3405

Open
charlie-costanzo opened this issue Jul 23, 2024 · 3 comments
Open

NTD Modeling – Mart – Remaining Tables in Dataset #3405

charlie-costanzo opened this issue Jul 23, 2024 · 3 comments
Assignees
Labels
data-pipeline-ingestion-and-modeling Ingesting, parsing and modeling data. Evan Siroky is product owner.

Comments

@charlie-costanzo
Copy link
Member

charlie-costanzo commented Jul 23, 2024

User story / feature request

Part of #3401

As a data engineer, I would like to make mart tables for the NTD dataset incorporating the remaining tables that have been made available as part of this epic, and extending the work found in warehouse/models/mart/ntd (found below).

To do this, I will need to hold more interviews with stakeholders and understand business needs to develop mart tables (aside from mart_ntd.dim_annual_ntd_agency_service which has already been identified as a need by analysts, and documented in #3396 listed below).

Building upon the work completed in #3345

Existing patterns:

Acceptance Criteria

I can successfully access the data for the following tables in the warehouse as mart tables:

Notes


@evansiroky evansiroky added the data-pipeline-ingestion-and-modeling Ingesting, parsing and modeling data. Evan Siroky is product owner. label Sep 19, 2024
@ohrite ohrite added this to the National Transit Database milestone Sep 20, 2024
erikamov added a commit that referenced this issue Oct 8, 2024
…l records from federal, state, and local funding source tables.

[#3405]
@erikamov
Copy link
Contributor

erikamov commented Oct 8, 2024

Creating new table dim_annual_ntd_funding_source based on conversation with @tiffanychu90 on slack: 3405-new-ntd-tables

erikamov added a commit that referenced this issue Oct 9, 2024
…l records from federal, state, and local funding source tables.

[#3405]
@ohrite ohrite removed this from the National Transit Database milestone Oct 9, 2024
erikamov added a commit that referenced this issue Oct 9, 2024
…l records from federal, state, and local funding source tables.

[#3405]
erikamov added a commit that referenced this issue Oct 9, 2024
…l records from federal, state, and local funding source tables.

[#3405]
erikamov added a commit that referenced this issue Oct 9, 2024
…l records from federal, state, and local funding source tables.

[#3405]
erikamov added a commit that referenced this issue Oct 9, 2024
…l records from federal, state, and local funding source tables.

[#3405]
@erikamov
Copy link
Contributor

dim_annual_ntd_funding_source successfully created.

@erikamov
Copy link
Contributor

Working on #3396 according with Slack conversation with @tiffanychu90 :

  • Table naming pattern: [dim/fct][time grain: annual/monthly][grain: agency/agency_mode]_[some other descriptor]
  • 3396 is referencing the changes to...stg_ntd_annual_data 2022 service_by_mode_and_time_period
    dim_annual_ntd_agency_service -> renamed in mart_ntd with a name like dim_annual_agency_mode_timeofday_service.
    The dim_annual_agency_service name would belong to the stg_ntd_annual_data_2022_service_by_agncy entry in the pdf.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
data-pipeline-ingestion-and-modeling Ingesting, parsing and modeling data. Evan Siroky is product owner.
Projects
None yet
Development

No branches or pull requests

4 participants