QA: Interoperability with dbt ecosystem

[amotl]

About

A few samples of dbt ecosystem items to check compatibility with, on the dbt package hub and beyond.

Integrations

• dbt-date
• dbt-spark
• stitch-utils
• dbt-utils
  The dbt package dbt-utils includes a few generic macros that can be (re)used across dbt projects. It will be nice to check if its set of integration tests can be invoked on CrateDB (partially) successfully.
• dbt-labs-experimental-features
• metricflow
  https://docs.getdbt.com/docs/build/about-metricflow
  (ex. dbt_metrics)
• dbt Mesh
• AutomateDV
• Singer Taps, see https://github.com/orgs/dbt-labs/repositories?q=tap-.
• Meltano: https://github.com/MeltanoLabs/tap-dbt

Demos

• rapid-onboarding-exemplar
• twelve-days-of-microbatch
• jaffle_shop is a fictional ecommerce store. This dbt project transforms raw data from an app database into a customers and orders model ready for analytics. It will be nice to check if the canonical dbt demo works well when using CrateDB as a warehouse.
• https://github.com/dbt-labs/snowflake_dbt_partner_demo
• https://github.com/amychen1776/mistyral-cat-cafe

Data Sources

• dbt_faker
• dbt-slack

Platforms

• Set up your dbt project with Databricks

Tools

• dbt-jsonschema
• dbt-jobs-as-code
• dbt-server

Articles

• https://medium.com/@danielpdwalker/handling-hard-deleted-data-from-source-5578e67f5a0c
• https://engineering.widen.com/blog/Dagster-+-Meltano/
  https://github.com/Widen/dagster-meltano-example