Skip to content

Commit

Permalink
add dbt contribution post
Browse files Browse the repository at this point in the history
  • Loading branch information
trouze committed Aug 4, 2023
1 parent aa3b715 commit df421e0
Show file tree
Hide file tree
Showing 2 changed files with 20 additions and 1 deletion.
2 changes: 1 addition & 1 deletion content/now.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ I currently live in Austin, TX.

### Work

I currently work for [Analytics8](https://www.analytics8.com) as a data management consultant. My role focuses on modernizing clients' data architectures, data modeling practices, and developer workflows. I am a certified professional in a number of technologies, including [dbt](https://www.getdbt.com/), [Google Cloud](https://cloud.google.com/), and [Databricks](https://www.databricks.com/). I have even made open-source contributions to the [dbt-core](https://github.com/dbt-labs/dbt-core) project!
I currently work for [Analytics8](https://www.analytics8.com) as a data management consultant. My role focuses on modernizing clients' data architectures, data modeling practices, and developer workflows. I am a certified professional in a number of technologies, including [dbt](https://www.getdbt.com/) (I'm an open-source contributor here!), [Google Cloud](https://cloud.google.com/), and [Databricks](https://www.databricks.com/). I have even made open-source contributions to the [dbt-core](https://github.com/dbt-labs/dbt-core) project!

### Education

Expand Down
19 changes: 19 additions & 0 deletions content/post/2023-08-3-first-dbt-core-contribution.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
---
title: "My First dbt-core Contribution!"
date: 2023-08-03 12:00:00
featured_image: '/images/prefect.jpeg'
excerpt: "Automating a data pipeline carrying Apple Health data: in this tutorial I'll show you the programming and DevOps tasks necessary to setup and run a Data Pipeline on Google Cloud Platform, orchestrated using Prefect and developed using their design principles."
---
I recently made my first `dbt-core` open-source contribution! This contribution adds `unmodified` and `old` [state selection](https://docs.getdbt.com/reference/node-selection/methods#the-state-method) methods to the dbt CLI. The main motivation is to make it easy to exclude late-binding views from our dbt job's DAG, reducing the runtime overhead. You can see some details that precipitated this contribution [here](https://github.com/dbt-labs/dbt-core/issues/7564).

You can watch a short demo on the contribution below:

<iframe width="766" height="431" src="https://www.youtube.com/embed/RB6CxbQQ_YM?si=UDomcCa34LDSMJw7" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>

To take it for a spin yourself, you might run a command that excludes the intersection of views and unchanged models from the DAG:

```bash
dbt run -s config.materialized:view,state:unmodified --state ./path/to/artifats
```

If you end up using this feature extension, I'd love to hear from you! When I worked on this, I did it entirely inspired by the late-binding view use-case, but I'd be curious to hear how you put it to use in your dbt jobs. As always, reach out to me via tyler [at] tylerrouze.com or comment below!

0 comments on commit df421e0

Please sign in to comment.