DBT

[AkashSonu14]

Hi,
I want code for batch job executing and its triggers when the previous job is fails, in the integration of dbt cosmos and airflow

[dosubot]

I couldn't find specific information in the Cosmos documentation about handling task dependencies to trigger a job only when the previous one fails. However, in Apache Airflow, you can achieve this by using the TriggerRule class. You can set the trigger_rule parameter of a task to TriggerRule.ONE_FAILED to ensure it runs only if the previous task fails.

Here's a basic example of how you might set this up in an Airflow DAG:

from airflow import DAG
from airflow.operators.dummy import DummyOperator
from airflow.utils.dates import days_ago
from airflow.utils.trigger_rule import TriggerRule

with DAG(dag_id='example_dag', start_date=days_ago(1), schedule_interval='@daily') as dag:
    task_1 = DummyOperator(
        task_id='task_1',
    )

    task_2 = DummyOperator(
        task_id='task_2',
        trigger_rule=TriggerRule.ONE_FAILED,
    )

    task_1 >> task_2

In this example, task_2 will only execute if task_1 fails. You can apply similar logic to your dbt tasks within the Cosmos integration by setting the trigger_rule for the relevant tasks.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}

[pankajastro]

Hey @AkashSonu14. Could you please confirm if this request in not a duplicate of #1419

[AkashSonu14]

@pankajastro I can't understand what you are saying