Install extra packages in the example project

[villasv]

A common requirement. Also relevant to show that #172 is not a reason to fork the project.

[villasv]

Tagging @ztyree42

[villasv]

Example project can be found here:

https://github.com/villasv/aws-airflow-stack/tree/master/examples/project

[ztyree42]

This is what I'm working from at present, I've added 3 components to attempt to install python dependencies onto the workers during autoscaling 1) This block to the appspec:

hooks: BeforeInstall: - location: scripts/install_dependencies.sh timeout: 300 runas: root

2) This install script:

#!/bin/bash pip3 install -r ../requirements.txt exit 0

3) This requirements file

pip-install-test==0.5

Unfortunately, I'm getting errors in the logs around the install_dependencies.sh script and I'm not sure why (this is my first exposure to cloudformation & codedeploy so I hope I'm overlooking something simple)

…

On Tue, Apr 28, 2020 at 9:11 AM Victor Villas ***@***.***> wrote: Example project can be found here: https://github.com/villasv/aws-airflow-stack/tree/master/examples/project — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#177 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AECDZPOTP3YHOJP4SSVLEYDRO352LANCNFSM4MSZSVLA> .

[villasv]

Your appspec loogs good, your requirements file too.

The one thing yours is different from what I have in the development branch (https://github.com/villasv/aws-airflow-stack/tree/develop/examples/project/airflow) is that you're providing a relative path to the requirements file.

Also, you might want to use AfterInstall instead of BeforeInstall to make sure the requirements file is already in place.

[ztyree42]

Omg, if this solves it I am going to be simultaneously super relived and infuriated (I think I tried every combination of paths I could reasonably think of except apparently this.)

…

On Tue, Apr 28, 2020 at 9:42 AM Victor Villas ***@***.***> wrote: Your appspec loogs good, your requirements file too. The one thing yours is different from what I have in the development branch ( https://github.com/villasv/aws-airflow-stack/tree/develop/examples/project/airflow) is that you're providing a relative path to the requirements file. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#177 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AECDZPPPIQJPBPDVRQVTVBLRO4BORANCNFSM4MSZSVLA> .