Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dev #648

Open
wants to merge 23 commits into
base: master
Choose a base branch
from
Open

Dev #648

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
0549ea7
changing to airflow 2.0.0
neylsoncrepalde Dec 19, 2020
be381af
fix worker connection to redis
neylsoncrepalde Dec 19, 2020
06ea878
rename docker-compose-CeleryExecutor.yml
neylsoncrepalde Dec 19, 2020
70a06d0
fix image names
neylsoncrepalde Dec 19, 2020
b7a3897
update to airflow 2.0.0 and Python 3.8
neylsoncrepalde Dec 19, 2020
22c2941
default webserver credentials
neylsoncrepalde Dec 19, 2020
6473088
leave the same volumes as puckels
neylsoncrepalde Dec 19, 2020
f4bb87d
my dags and neylson image
neylsoncrepalde Dec 20, 2020
a3ce36c
mount data local volume
neylsoncrepalde Dec 20, 2020
26b25b7
correct enade folder
neylsoncrepalde Dec 20, 2020
8d5a166
correct enade url
neylsoncrepalde Dec 20, 2020
2fe7ff5
change all image tags in readme to 2.0.0
neylsoncrepalde Dec 29, 2020
7a6874f
corrige dags 04 e 05
neylsoncrepalde Dec 30, 2020
7fc8c2f
corrige tag de imagem
neylsoncrepalde Dec 30, 2020
b5f11fd
corrige fonte de enade
neylsoncrepalde Dec 30, 2020
44ee88b
corrige horário de início
neylsoncrepalde Dec 30, 2020
405dd20
Create .gitkeep
neylsoncrepalde Dec 30, 2020
2fc6e5f
Merge pull request #1 from neylsoncrepalde/mydags
neylsoncrepalde Jan 30, 2021
aac10b1
add requirements to image
neylsoncrepalde Jan 31, 2021
cd66fd8
Merge branch 'mydags'
neylsoncrepalde Jan 31, 2021
aaec4ce
Merge branch 'master' of https://github.com/neylsoncrepalde/docker-ai…
neylsoncrepalde Jan 31, 2021
7f16784
Changed volume settings on celery and local executor docker-compose f…
Nov 30, 2021
9c720d9
added some deploy parameters to worker container
Nov 30, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .dockerignore
Original file line number Diff line number Diff line change
@@ -1 +1 @@
.git
.git
36 changes: 18 additions & 18 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
name: CI

on:
push:
branches:
- master
pull_request:
branches:
- master

jobs:
ci:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v1
- run: docker build -t "${PWD##*/}" .
- run: docker run "${PWD##*/}" python -V
- run: docker run "${PWD##*/}" version
name: CI
on:
push:
branches:
- master
pull_request:
branches:
- master
jobs:
ci:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v1
- run: docker build -t "${PWD##*/}" .
- run: docker run "${PWD##*/}" python -V
- run: docker run "${PWD##*/}" version
64 changes: 38 additions & 26 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,26 +1,38 @@
### Vim ###
[._]*.s[a-w][a-z]
[._]s[a-w][a-z]
*.un~
Session.vim
.netrwhist
*~

### SublimeText ###
# cache files for sublime text
*.tmlanguage.cache
*.tmPreferences.cache
*.stTheme.cache

# workspace files are user-specific
*.sublime-workspace

# project files should be checked into the repository, unless a significant
# proportion of contributors will probably not be using SublimeText
# *.sublime-project

# sftp configuration file
sftp-config.json

# Python
__pycache__
### Vim ###
[._]*.s[a-w][a-z]
[._]s[a-w][a-z]
*.un~
Session.vim
.netrwhist
*~

### SublimeText ###
# cache files for sublime text
*.tmlanguage.cache
*.tmPreferences.cache
*.stTheme.cache

# workspace files are user-specific
*.sublime-workspace

# project files should be checked into the repository, unless a significant
# proportion of contributors will probably not be using SublimeText
# *.sublime-project

# sftp configuration file
sftp-config.json

# Python
__pycache__

.vscode/

microdados_enade_2019*

igti_bootcamp*

treino02.py
treino03.py
treino04.py
treino05.py
tuto.py
5 changes: 3 additions & 2 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -4,15 +4,15 @@
# BUILD: docker build --rm -t puckel/docker-airflow .
# SOURCE: https://github.com/puckel/docker-airflow

FROM python:3.7-slim-buster
FROM python:3.8-slim-buster
LABEL maintainer="Puckel_"

# Never prompt the user for choices on installation/configuration of packages
ENV DEBIAN_FRONTEND noninteractive
ENV TERM linux

# Airflow
ARG AIRFLOW_VERSION=1.10.9
ARG AIRFLOW_VERSION=2.0.0
ARG AIRFLOW_USER_HOME=/usr/local/airflow
ARG AIRFLOW_DEPS=""
ARG PYTHON_DEPS=""
Expand Down Expand Up @@ -75,6 +75,7 @@ RUN set -ex \

COPY script/entrypoint.sh /entrypoint.sh
COPY config/airflow.cfg ${AIRFLOW_USER_HOME}/airflow.cfg
COPY requirements.txt ${AIRFLOW_USER_HOME}/requirements.txt

RUN chown -R airflow: ${AIRFLOW_USER_HOME}

Expand Down
Loading