Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kubernetes Executor Pods unable to pull sql alchemy connection #20

Open
Altamash86 opened this issue Oct 16, 2021 · 0 comments
Open

Kubernetes Executor Pods unable to pull sql alchemy connection #20

Altamash86 opened this issue Oct 16, 2021 · 0 comments

Comments

@Altamash86
Copy link

I am converting customized airflow helm chart to use Kubernetes Executor instead of Celery Executor. I have tried multiple configuration for it work but somehow executor pods always tries to connect to default sql alchemy connection. pasting error.
scheduler and webserver able to connect to correct db using configuration variable AIRFLOW__CORE__SQL_ALCHEMY_CONN.

I have provided pod template yaml inside tag kubernetesPodTemplate.stringOverride in values.yaml

Error: (logs from executor pod)
Traceback (most recent call last):
File "/usr/local/bin/airflow", line 5, in
from airflow.main import main
File "/usr/local/lib/python3.8/site-packages/airflow/init.py", line 46, in
settings.initialize()
File "/usr/local/lib/python3.8/site-packages/airflow/settings.py", line 447, in initialize
configure_orm()
File "/usr/local/lib/python3.8/site-packages/airflow/settings.py", line 222, in configure_orm
engine = create_engine(SQL_ALCHEMY_CONN, connect_args=connect_args, **engine_args)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/init.py", line 525, in create_engine
return strategy.create(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/strategies.py", line 54, in create
u = url.make_url(name_or_url)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/url.py", line 229, in make_url
return _parse_rfc1738_args(name_or_url)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/url.py", line 290, in _parse_rfc1738_args
raise exc.ArgumentError(
sqlalchemy.exc.ArgumentError: Could not parse rfc1738 URL from string ''postgresql+psycopg2://airflow:airflow@postgres:5432/airflow''

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant