You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
1.28.9
Client Version: v1.31.0
Kustomize Version: v5.4.2
Server Version: v1.28.9
WARNING: version difference between client (1.31) and server (1.28) exceeds the supported minor version skew of +/-1
When multiple DAG run is happening, sometimes the kwargs['param'] value are malfunctioned.
create Airflow DAG with Task Branch operator like below
pre_check = BranchPythonOperator(task_id='pre_validlate',
python_callable=pre_validate_fn).
graph is below:
init_report >> pre_check >> data_extraction >> end
pre_check >> remove_table
The function of branch operator, pre_validate_fn will decide which branch to follow, the code is below:
follow_branch = 'data_extraction'
if not kwargs['param']['delta']:
follow_branch = ['data_extraction', 'remove_table']
print(follow_branch)
return follow_branch
In we dont set detla, then it will remove as well as go for extraction
In our case, if our input parameter is passed wit 'delta' as True even in that case, the condition is followed.
When such malfunctioned execution happens, the task remove_table is shown success in UI and table also deleted in logic. But the respective task_id=remove_table logs folder is not created under the relevant run_id folder.
Relevant Logs
NA
Custom Helm Values
NA
The text was updated successfully, but these errors were encountered:
This issue has been automatically marked as stale because it has not had activity in 60 days.
It will be closed in 7 days if no further activity occurs.
Thank you for your contributions.
Issues never become stale if any of the following is true:
Checks
User-Community Airflow Helm Chart
.Chart Version
airflow-8.9.0
Kubernetes Version
Helm Version
Description
When multiple DAG run is happening, sometimes the kwargs['param'] value are malfunctioned.
create Airflow DAG with Task Branch operator like below
pre_check = BranchPythonOperator(task_id='pre_validlate',
python_callable=pre_validate_fn).
graph is below:
init_report >> pre_check >> data_extraction >> end
pre_check >> remove_table
The function of branch operator, pre_validate_fn will decide which branch to follow, the code is below:
follow_branch = 'data_extraction'
if not kwargs['param']['delta']:
follow_branch = ['data_extraction', 'remove_table']
print(follow_branch)
return follow_branch
In we dont set detla, then it will remove as well as go for extraction
In our case, if our input parameter is passed wit 'delta' as True even in that case, the condition is followed.
When such malfunctioned execution happens, the task remove_table is shown success in UI and table also deleted in logic. But the respective task_id=remove_table logs folder is not created under the relevant run_id folder.
Relevant Logs
Custom Helm Values
NA
The text was updated successfully, but these errors were encountered: