Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor geospatial dedupe #190

Merged
merged 11 commits into from
Sep 11, 2023
Merged

Refactor geospatial dedupe #190

merged 11 commits into from
Sep 11, 2023

Commits on Sep 1, 2023

  1. WIP moving join-with-deduplication into a macro.

    @ian-r-rose
    ian-r-rose committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    719ae0e View commit details
    Browse the repository at this point in the history

  2. Nested CTEs are apparently allowed!

    @ian-r-rose
    ian-r-rose committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    8eb9c31 View commit details
    Browse the repository at this point in the history

  3. Use macro with places again.

    @ian-r-rose
    ian-r-rose committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    1c77c29 View commit details
    Browse the repository at this point in the history

  4. Add customizable prefix to temporary CTEs so it can be used more than 

    once
    @ian-r-rose
    ian-r-rose committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    c48cfb7 View commit details
    Browse the repository at this point in the history

  5. Refactor to include places and blocks in the same enriched model

    @ian-r-rose
    ian-r-rose committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    e8e0374 View commit details
    Browse the repository at this point in the history

  6. Clean up formatting, documentation

    @ian-r-rose
    ian-r-rose committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    378b84c View commit details
    Browse the repository at this point in the history

  7. Inner join for blocks model to remove footprints that are outside of 

    California (there are ~20k that are in OR, NV, AZ, or Mexico)
    @ian-r-rose
    ian-r-rose committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    aa2795a View commit details
    Browse the repository at this point in the history

  8. Rename model to reflect that it is no longer just blocks

    @ian-r-rose
    ian-r-rose committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    c084eeb View commit details
    Browse the repository at this point in the history

  9. Update name to reflect that it's not just blocks

    @ian-r-rose
    ian-r-rose committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    609d710 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. Be less clever with jinja, explicitly list column names

    @ian-r-rose
    ian-r-rose committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    d982dd2 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2023

  1. Guard against nulls in max_by so that we don't accidentally null out … 

    …all of our columns in the deduplication step.
    @ian-r-rose
    ian-r-rose committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    fca5d58 View commit details
    Browse the repository at this point in the history