data-management-dbt.md

DBT

useful DBT utilities

validation

• https://github.com/dbt-labs/dbt-project-evaluator
• https://github.com/PicnicSupermarket/dbt-score

data testing

• normal testing
  • https://hub.getdbt.com/calogica/dbt_expectations/latest/
• anomaly detection
  • https://github.com/elementary-data/dbt-data-reliability
• pre-commit
  • https://github.com/dbt-checkpoint/dbt-checkpoint

CI/CD

• https://medium.com/inthepipeline/youre-running-dbt-in-ci-now-what-f24c6717b9de
• merge request templates
  • https://medium.com/inthepipeline/dbt-best-practices-in-action-at-cal-itps-data-infra-project-0d11adf5513d

SQL engine portability

• https://github.com/tobymao/sqlglot

multi-engine setups

• https://github.com/borjavb/dbt-iceberg-poc

schema changes

• https://www.getdbt.com/coalesce-2021/surviving-schema-changes-with-automation

DBT-cloud alternatives

• https://github.com/nicholasyager/dbt-loom
• https://dagster.io/
• dagster plus loom example https://github.com/cnolanminich/dbt-loom-example/tree/demo-with-dagster

data contracts

• https://github.com/bitol-io/open-data-contract-standard
• http://datacontract.com/
• https://docs.getdbt.com/docs/collaborate/govern/about-model-governance

contract implementations

• https://www.youtube.com/watch?v=bVKuLcqv0kI&t=9s