Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pull request made in error, sorry! #1134

Commits on Nov 19, 2022

  1. Adding in additional support for iceberg v2 tables

    Found a way to identify iceberg tables given that spark returns
    an error when trying to execute "SHOW TABLE EXTENDED..."  See
    https://issues.apache.org/jira/browse/SPARK-33393
    
    Instead of show table extended a "DESCRIBE EXTENDED" is
    performed to retrieve the provider information.  This allows
    for identification of iceberg through an is_iceberg member
    variable.
    
    Allow for multiple join conditions to allow for mutliple columns to
    make a row distinct
    
    Use is_iceberg everywhere handling iceberg tables differs from other
    sources of data.
    dparent1 authored and cccs-jc committed Nov 19, 2022
    Configuration menu
    Copy the full SHA
    9d88e83 View commit details
    Browse the repository at this point in the history
  2. Setting _schema rather than replacing it

    [CT-276] Apache Iceberg Support dbt-labs#294
    
    The _schema variable was used for non-iceberg tables but was being
    overridden by work for iceberg v2 tables.  I've made it so the iceberg
    condition will set _schema rather than blanket changing the schema for
    all providers.
    dparent1 authored and cccs-jc committed Nov 19, 2022
    Configuration menu
    Copy the full SHA
    3d6d5bd View commit details
    Browse the repository at this point in the history
  3. Renaming macro and method name

    On second look I wasn't happy with my name choices for macro name and
    method, hopefully what I have now makes more sense.
    
    [CT-276] Apache Iceberg Support dbt-labs#294
    dparent1 authored and cccs-jc committed Nov 19, 2022
    Configuration menu
    Copy the full SHA
    b3bc8a4 View commit details
    Browse the repository at this point in the history
  4. Adding changelog entry.

    dparent1 authored and cccs-jc committed Nov 19, 2022
    Configuration menu
    Copy the full SHA
    cb3a1a7 View commit details
    Browse the repository at this point in the history
  5. Removing the is_iceberg check it is not needed

    Upon further investigation this check is not needed since
    self.database will not be set.
    dparent1 authored and cccs-jc committed Nov 19, 2022
    Configuration menu
    Copy the full SHA
    b8d3aa0 View commit details
    Browse the repository at this point in the history
  6. added iceberg test cases

    cccs-jc committed Nov 19, 2022
    Configuration menu
    Copy the full SHA
    fab6c96 View commit details
    Browse the repository at this point in the history
  7. re-added Dan's fix taken out in rebase operation

    cccs-jc committed Nov 19, 2022
    Configuration menu
    Copy the full SHA
    7a764ca View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2022

  1. added tblproperties support and test

    cccs-jc committed Nov 20, 2022
    Configuration menu
    Copy the full SHA
    67e71d4 View commit details
    Browse the repository at this point in the history
  2. iceberg tblproperties test

    cccs-jc committed Nov 20, 2022
    Configuration menu
    Copy the full SHA
    028890f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    973191f View commit details
    Browse the repository at this point in the history
  4. hook to create session and register python UDF

    cccs-jc committed Nov 20, 2022
    Configuration menu
    Copy the full SHA
    2067c94 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2022

  1. support for custom pyspark views

    cccs-jc committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    6308ae0 View commit details
    Browse the repository at this point in the history
  2. depend on dbt-core 1.3.0 for now

    cccs-jc committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    2464ccb View commit details
    Browse the repository at this point in the history
  3. initial pipeline

    cccs-nik committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    f322c03 View commit details
    Browse the repository at this point in the history
  4. shell script not python

    cccs-nik committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    3b6d626 View commit details
    Browse the repository at this point in the history
  5. pip install correct pkgs

    cccs-nik committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    e7df002 View commit details
    Browse the repository at this point in the history
  6. adding missing display names

    cccs-nik committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    4354db7 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2022

  1. publishing to nexus

    cccs-nik committed Nov 22, 2022
    Configuration menu
    Copy the full SHA
    5fbb168 View commit details
    Browse the repository at this point in the history
  2. cauldron pool

    cccs-nik committed Nov 22, 2022
    Configuration menu
    Copy the full SHA
    ffea5dd View commit details
    Browse the repository at this point in the history
  3. python 3.8

    cccs-nik committed Nov 22, 2022
    Configuration menu
    Copy the full SHA
    3981eaf View commit details
    Browse the repository at this point in the history
  4. python for second job

    cccs-nik committed Nov 22, 2022
    Configuration menu
    Copy the full SHA
    cc96981 View commit details
    Browse the repository at this point in the history

Commits on Nov 25, 2022

  1. bug fix

    cccs-jc committed Nov 25, 2022
    Configuration menu
    Copy the full SHA
    2588982 View commit details
    Browse the repository at this point in the history
  2. bumped version

    cccs-jc committed Nov 25, 2022
    Configuration menu
    Copy the full SHA
    9d348e3 View commit details
    Browse the repository at this point in the history
  3. remove check for multiple database

    cccs-jc committed Nov 25, 2022
    Configuration menu
    Copy the full SHA
    0207f0c View commit details
    Browse the repository at this point in the history
  4. Merge pull request #8 from dparent1/feature/pipeline

    Feature/pipeline
    cccs-jc authored Nov 25, 2022
    Configuration menu
    Copy the full SHA
    6a0ae71 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2023

  1. added missing iceberg check

    cccs-jc committed Jan 11, 2023
    Configuration menu
    Copy the full SHA
    1abbb28 View commit details
    Browse the repository at this point in the history
  2. bumped version

    cccs-jc committed Jan 11, 2023
    Configuration menu
    Copy the full SHA
    26908e0 View commit details
    Browse the repository at this point in the history
  3. Merge pull request dbt-labs#13 from dparent1/feature/pipeline

    added missing iceberg check
    cccs-jc authored Jan 11, 2023
    Configuration menu
    Copy the full SHA
    804ab03 View commit details
    Browse the repository at this point in the history

Commits on Jan 20, 2023

  1. Fix for datahub recipe

    _get_columns_for_catalog was not returning right info
    cccs-jc committed Jan 20, 2023
    Configuration menu
    Copy the full SHA
    3b62715 View commit details
    Browse the repository at this point in the history
  2. Merge pull request dbt-labs#14 from dparent1/feature/pipeline

    Fix for datahub recipe
    cccs-jc authored Jan 20, 2023
    Configuration menu
    Copy the full SHA
    999d3d0 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2023

  1. temporary fix for iceberg table discovery

    it's too slow to issue a describe table for every table in a schema
    cccs-jc committed Jan 30, 2023
    Configuration menu
    Copy the full SHA
    f432695 View commit details
    Browse the repository at this point in the history
  2. Merge pull request dbt-labs#15 from dparent1/feature/pipeline

    temporary fix for iceberg table discovery
    cccs-jc authored Jan 30, 2023
    Configuration menu
    Copy the full SHA
    64c78a4 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2023

  1. Configuration menu
    Copy the full SHA
    df25656 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Configuration menu
    Copy the full SHA
    1c3d63b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6a648d7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a5898ec View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    fe6ed4e View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    28b1275 View commit details
    Browse the repository at this point in the history
  6. Bad venv directory

    cccs-seb committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    d12e189 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    ff77f35 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Missing lib

    cccs-seb committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    e27e95d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ab7aed6 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    df2207a View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. Configuration menu
    Copy the full SHA
    db90b1e View commit details
    Browse the repository at this point in the history
  2. Missing pyspark requirement

    cccs-seb committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    3e72f75 View commit details
    Browse the repository at this point in the history
  3. Merge pull request #5 from CybercentreCanada/cccs/1.3.0-change-pipeline

    Cccs/1.3.0 change pipeline
    cccs-seb authored Jun 19, 2024
    Configuration menu
    Copy the full SHA
    09b71b7 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. Configuration menu
    Copy the full SHA
    8f0c2a3 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. Merge pull request #4 from CybercentreCanada/cccs/1.3.0-python-models…

    …-yuyu
    
    Port over Yuyu's changes from 1.6.0 to 1.3.0
    cccs-seb authored Jul 19, 2024
    Configuration menu
    Copy the full SHA
    f0b9911 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. 1.4.7

    cccs-seb committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    eda284d View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Configuration menu
    Copy the full SHA
    c4679e7 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. 1.4.8 branch

    cccs-seb committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    a49dd6c View commit details
    Browse the repository at this point in the history
  2. Merge pull request #6 from LoudCloudCrowd/fix/adapter-handle-rest-outage

    Removes v1 table operations and allows throwing of exception when catalog return is bad
    cccs-seb authored Aug 22, 2024
    Configuration menu
    Copy the full SHA
    215ed92 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Configuration menu
    Copy the full SHA
    beac3a0 View commit details
    Browse the repository at this point in the history
  2. Cccs/main setuptools bugfix (#8)

    * Setuptools breaks on version 71+, force 70.1.0
    
    * Need to run dev requirements before main
    
    * Typo
    
    * Try setting version directly in pipeline file for now
    cccs-seb authored Aug 27, 2024
    Configuration menu
    Copy the full SHA
    48bd31e View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. Bump to 1.4.9 (#10)

    * Bump version to 1.4.9
    
    * Adds partitioning branch for Python dbt models (#9)
    
    ---------
    
    Co-authored-by: LoudCloudCrowd <[email protected]>
    cccs-seb and LoudCloudCrowd authored Oct 18, 2024
    Configuration menu
    Copy the full SHA
    b0113bd View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. Configuration menu
    Copy the full SHA
    c16084c View commit details
    Browse the repository at this point in the history