From 0c9a5f224a850d584b0d67adeeca58a7a94b9b27 Mon Sep 17 00:00:00 2001 From: rcg798 <5733407+rcg798@users.noreply.github.com> Date: Mon, 16 Dec 2024 10:05:42 -0800 Subject: [PATCH 1/6] Update job-scheduler.md Coming newly into the orchestration team, I am updating the initial description of the scheduler types to better align with how users may view the product today: 1. we refer to merge jobs as merge jobs (and it is an explicit category in the UI) so I think it would be useful to call out that term in the beginning, so people associate that type of job with its name and 2. another event-based job is job completion (another explicit category in the UI) and I couldn't tell how that fit into the initial description, so added that as well. Feel free to revise, just wanted to flag those two points! --- website/docs/docs/deploy/job-scheduler.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/website/docs/docs/deploy/job-scheduler.md b/website/docs/docs/deploy/job-scheduler.md index 7d45fddc3f6..fb351703624 100644 --- a/website/docs/docs/deploy/job-scheduler.md +++ b/website/docs/docs/deploy/job-scheduler.md @@ -11,7 +11,8 @@ The job scheduler is the backbone of running jobs in dbt Cloud, bringing power a The scheduler enables both cron-based and event-driven execution of dbt commands in the user’s data platform. Specifically, it handles: - Cron-based execution of dbt Cloud jobs that run on a predetermined cadence -- Event-driven execution of dbt Cloud CI jobs triggered by pull requests to the dbt repo +- Event-driven execution of dbt Cloud jobs that run based on the completion of another job +- Event-driven execution of dbt Cloud CI jobs triggered by pull requests to the dbt repo (e.g. "merge jobs") - Event-driven execution of dbt Cloud jobs triggered by API - Event-driven execution of dbt Cloud jobs manually triggered by a user to "Run Now" From 6b18573cadb772d466f1ae43c713e3fb38c2e800 Mon Sep 17 00:00:00 2001 From: Mirna Wong <89008547+mirnawong1@users.noreply.github.com> Date: Tue, 17 Dec 2024 11:24:10 +0000 Subject: [PATCH 2/6] Update website/docs/docs/deploy/job-scheduler.md --- website/docs/docs/deploy/job-scheduler.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/deploy/job-scheduler.md b/website/docs/docs/deploy/job-scheduler.md index fb351703624..e8a28bbfb27 100644 --- a/website/docs/docs/deploy/job-scheduler.md +++ b/website/docs/docs/deploy/job-scheduler.md @@ -11,7 +11,7 @@ The job scheduler is the backbone of running jobs in dbt Cloud, bringing power a The scheduler enables both cron-based and event-driven execution of dbt commands in the user’s data platform. Specifically, it handles: - Cron-based execution of dbt Cloud jobs that run on a predetermined cadence -- Event-driven execution of dbt Cloud jobs that run based on the completion of another job +- Event-driven execution of dbt Cloud jobs that [run based on the completion of another job ([trigger on job completion](/docs/deploy/deploy-jobs#trigger-on-job-completion)) - Event-driven execution of dbt Cloud CI jobs triggered by pull requests to the dbt repo (e.g. "merge jobs") - Event-driven execution of dbt Cloud jobs triggered by API - Event-driven execution of dbt Cloud jobs manually triggered by a user to "Run Now" From d079ab41aaf7ceb0b7cb7b925bdbb70ef13000d9 Mon Sep 17 00:00:00 2001 From: Mirna Wong <89008547+mirnawong1@users.noreply.github.com> Date: Tue, 17 Dec 2024 11:24:46 +0000 Subject: [PATCH 3/6] Update website/docs/docs/deploy/job-scheduler.md --- website/docs/docs/deploy/job-scheduler.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/deploy/job-scheduler.md b/website/docs/docs/deploy/job-scheduler.md index e8a28bbfb27..38a98d2f92e 100644 --- a/website/docs/docs/deploy/job-scheduler.md +++ b/website/docs/docs/deploy/job-scheduler.md @@ -12,7 +12,7 @@ The scheduler enables both cron-based and event-driven execution of dbt commands - Cron-based execution of dbt Cloud jobs that run on a predetermined cadence - Event-driven execution of dbt Cloud jobs that [run based on the completion of another job ([trigger on job completion](/docs/deploy/deploy-jobs#trigger-on-job-completion)) -- Event-driven execution of dbt Cloud CI jobs triggered by pull requests to the dbt repo (e.g. "merge jobs") +- Event-driven execution of dbt Cloud CI jobs triggered by pull requests to the dbt repo ([merge jobs](/docs/deploy/merge-jobs)) - Event-driven execution of dbt Cloud jobs triggered by API - Event-driven execution of dbt Cloud jobs manually triggered by a user to "Run Now" From f99d323aa52885f1c77b6c83655b4a37bc200596 Mon Sep 17 00:00:00 2001 From: Mirna Wong <89008547+mirnawong1@users.noreply.github.com> Date: Tue, 17 Dec 2024 11:24:59 +0000 Subject: [PATCH 4/6] Update website/docs/docs/deploy/job-scheduler.md --- website/docs/docs/deploy/job-scheduler.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/deploy/job-scheduler.md b/website/docs/docs/deploy/job-scheduler.md index 38a98d2f92e..f3f5706e93f 100644 --- a/website/docs/docs/deploy/job-scheduler.md +++ b/website/docs/docs/deploy/job-scheduler.md @@ -11,7 +11,7 @@ The job scheduler is the backbone of running jobs in dbt Cloud, bringing power a The scheduler enables both cron-based and event-driven execution of dbt commands in the user’s data platform. Specifically, it handles: - Cron-based execution of dbt Cloud jobs that run on a predetermined cadence -- Event-driven execution of dbt Cloud jobs that [run based on the completion of another job ([trigger on job completion](/docs/deploy/deploy-jobs#trigger-on-job-completion)) +- Event-driven execution of dbt Cloud jobs that run based on the completion of another job ([trigger on job completion](/docs/deploy/deploy-jobs#trigger-on-job-completion)) - Event-driven execution of dbt Cloud CI jobs triggered by pull requests to the dbt repo ([merge jobs](/docs/deploy/merge-jobs)) - Event-driven execution of dbt Cloud jobs triggered by API - Event-driven execution of dbt Cloud jobs manually triggered by a user to "Run Now" From 4f4bdb985ae8bfde3be0ba28482e87df9697b80b Mon Sep 17 00:00:00 2001 From: Mirna Wong <89008547+mirnawong1@users.noreply.github.com> Date: Tue, 17 Dec 2024 11:25:39 +0000 Subject: [PATCH 5/6] Update website/docs/docs/deploy/job-scheduler.md --- website/docs/docs/deploy/job-scheduler.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/deploy/job-scheduler.md b/website/docs/docs/deploy/job-scheduler.md index f3f5706e93f..1990832f7df 100644 --- a/website/docs/docs/deploy/job-scheduler.md +++ b/website/docs/docs/deploy/job-scheduler.md @@ -14,7 +14,7 @@ The scheduler enables both cron-based and event-driven execution of dbt commands - Event-driven execution of dbt Cloud jobs that run based on the completion of another job ([trigger on job completion](/docs/deploy/deploy-jobs#trigger-on-job-completion)) - Event-driven execution of dbt Cloud CI jobs triggered by pull requests to the dbt repo ([merge jobs](/docs/deploy/merge-jobs)) - Event-driven execution of dbt Cloud jobs triggered by API -- Event-driven execution of dbt Cloud jobs manually triggered by a user to "Run Now" +- Event-driven execution of dbt Cloud jobs manually triggered by a user to **Run now** The scheduler handles various tasks including queuing jobs, creating temporary environments to run the dbt commands required for those jobs, providing logs for debugging and remediation, and storing dbt artifacts for direct consumption/ingestion by the Discovery API. From 1a05a186e17f464fb36e88f4a6e63aac75e6967b Mon Sep 17 00:00:00 2001 From: Mirna Wong <89008547+mirnawong1@users.noreply.github.com> Date: Tue, 17 Dec 2024 11:36:01 +0000 Subject: [PATCH 6/6] Update website/docs/docs/deploy/job-scheduler.md --- website/docs/docs/deploy/job-scheduler.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/deploy/job-scheduler.md b/website/docs/docs/deploy/job-scheduler.md index 1990832f7df..c5d1886879b 100644 --- a/website/docs/docs/deploy/job-scheduler.md +++ b/website/docs/docs/deploy/job-scheduler.md @@ -12,7 +12,7 @@ The scheduler enables both cron-based and event-driven execution of dbt commands - Cron-based execution of dbt Cloud jobs that run on a predetermined cadence - Event-driven execution of dbt Cloud jobs that run based on the completion of another job ([trigger on job completion](/docs/deploy/deploy-jobs#trigger-on-job-completion)) -- Event-driven execution of dbt Cloud CI jobs triggered by pull requests to the dbt repo ([merge jobs](/docs/deploy/merge-jobs)) +- Event-driven execution of dbt Cloud CI jobs triggered when a pull request is merged to the branch ([merge jobs](/docs/deploy/merge-jobs)) - Event-driven execution of dbt Cloud jobs triggered by API - Event-driven execution of dbt Cloud jobs manually triggered by a user to **Run now**