Skip to content
This repository has been archived by the owner on Oct 11, 2021. It is now read-only.

Airflow installation doesn’t work in the latest AMIs #46

Closed
villasv opened this issue Nov 12, 2018 · 1 comment
Closed

Airflow installation doesn’t work in the latest AMIs #46

villasv opened this issue Nov 12, 2018 · 1 comment
Labels
Milestone

Comments

@villasv
Copy link
Owner

villasv commented Nov 12, 2018

Reported by @tomfaulhaber, didn't reproduce yet.

Still need to decide on #34, because providing baked AMIs adds a lot more complexity to the template, although it greatly simplifies the actual resource creation during autoscaling.

But again, autoscaling is not the main feature of the stack anymore. The installation is not that expensive and as long as it consistently works on the newer official Amazon Linux AMIs it should be fine.

@villasv villasv added the bug label Nov 12, 2018
tomfaulhaber added a commit to tomfaulhaber/aws-airflow-stack that referenced this issue Nov 12, 2018
1. Parameterize the AMI so the template can be used in different regions (villasv#44)
2. Don't hardcode the region, use the one where the template is running (villasv#44)
3. Change the Airflow setup process so that it works on new AMIs (villasv#46)
4. Add the /efs filesystem to /etc/fstab so the system can be rebooted (villasv#45)
5. Change the name "SpotInstanceType" to "WorkerInstanceType" since we're not
using spot yet and we don't want to confuse users.
@villasv
Copy link
Owner Author

villasv commented Nov 13, 2018

It seems that the Amazon Linux pip won't concede an update:

pkg_resources.DistributionNotFound: The 'pip==9.0.3' distribution was not found and is required by the application

PR #48 indeed seems to fix it by leaving pip alone. Installing wheel is enough.

villasv added a commit that referenced this issue Nov 13, 2018
Parameterize the AMI so the template can be used in different regions (#44)
Don't hardcode the region, use the one where the template is running (#44)
Change the Airflow setup process so that it works on new AMIs (#46)
Add the /efs filesystem to /etc/fstab so the system can be rebooted (#45)
Change the name "SpotInstanceType" to "WorkerInstanceType" since we're not
    using spot yet and we don't want to confuse users.
@villasv villasv closed this as completed Nov 13, 2018
@villasv villasv added this to the Amazonic Art milestone Nov 22, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

1 participant