Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merging in changes that Luke made to production. #50

Open
wants to merge 162 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
162 commits
Select commit Hold shift + click to select a range
25b6709
Merge pull request #47 from di2ag/master
GregHydeDartmouth Jun 26, 2022
6103455
Merge pull request #48 from di2ag/staging
GregHydeDartmouth Jun 26, 2022
d9bfff5
Merge branch 'master' into staging
veenhouse Aug 22, 2022
0e54270
Merge branch 'staging' into production
veenhouse Aug 22, 2022
f71849f
updating for aws
veenhouse Aug 22, 2022
f54a2f3
changing jenkins file to point to new docker file location
veenhouse Aug 22, 2022
6171822
fixing docker settings in jenkins
veenhouse Aug 22, 2022
f76018a
fixing jenkins
veenhouse Aug 22, 2022
7b17f0d
jenkins update
veenhouse Aug 22, 2022
4c9a511
updating docker file to point to new dirctory structure
veenhouse Aug 22, 2022
2c189f4
fixing location of gunicorn script
veenhouse Aug 22, 2022
228ce6f
removing old file references from deployment configuration
veenhouse Aug 22, 2022
0df6c98
cleaning up outdated file reference
veenhouse Aug 22, 2022
bdb4647
adding new local dev support
veenhouse Sep 1, 2022
33cc876
removing api command in compose file
veenhouse Sep 1, 2022
a219ddf
removing api command in compose file
veenhouse Sep 1, 2022
1c1e15e
Update README.md
GregHydeDartmouth Sep 7, 2022
dbed7b7
Update README.md
GregHydeDartmouth Oct 25, 2022
9cb0d66
fix: refactor chp ci pipeline
Jan 6, 2023
079eaf2
fix: modified image tag
Jan 6, 2023
e2bf308
fix: dockerfile path
Jan 6, 2023
9b33e4e
fix: dockerfile path
Jan 6, 2023
99fcc8c
fix: dockerfile path
Jan 6, 2023
1bd6bef
fix: build script
Jan 6, 2023
f286f38
fix: build script
Jan 6, 2023
ebb8859
fix: modified build script
Jan 6, 2023
ef79cba
fix: changed the secret script name
Jan 6, 2023
861d88a
fix: modified deploy.sh file
Jan 6, 2023
aa8aaf9
fix: modified deploy.sh file
Jan 6, 2023
7d0d313
fix: modified deploy.sh file
Jan 6, 2023
a5b6559
fix: modified deploy.sh script
Jan 7, 2023
e263fc4
fix: modified deploy.sh file
Jan 7, 2023
e7f8e0a
fix: modified docker build script
Jan 7, 2023
6b1fa35
fix: modified ingress rules
Jan 17, 2023
ed78f9a
fix: modified ingress rules
Jan 17, 2023
71d4b44
fix: modified ingress rules
Jan 17, 2023
669fb0c
fix: removed second docker login command
Jan 17, 2023
184b8f8
fix: changed target pot
Jan 17, 2023
f5f46f4
fix: changed target pot
Jan 17, 2023
03150b7
fix: changed target port
Jan 18, 2023
037631a
fix: changed target port
Jan 18, 2023
bd77954
fix added chp label
Jan 31, 2023
38f23bd
Merge pull request #51 from aojesanmi/adesina-chp
yakaboskic Feb 6, 2023
d1f3540
added some dev deployment scripts for local builds to dev machine. Al…
anonymous-271828 Mar 15, 2023
b335c86
Merge pull request #52 from di2ag/provenance_and_biolink_changes-ghyde
GregHydeDartmouth Mar 16, 2023
90efd61
Rework in progress.
anonymous-271828 Apr 18, 2023
3090bc8
Working App Admin portal with Zenodo file registation support.
anonymous-271828 Apr 18, 2023
466a4c2
Working trapi 1.4 verision with legacy trapi_model.
anonymous-271828 May 1, 2023
a7424af
Added secrets and functionality for django admin website.
anonymous-271828 May 2, 2023
f93b339
trapi-1.4 fixes
anonymous-271828 May 10, 2023
f72b418
Merge pull request #53 from di2ag/trapi-1.4-yakaboskic
GregHydeDartmouth May 11, 2023
6ea7e8b
Added initial gennifer integration with pidc and updated docker files.
anonymous-271828 May 23, 2023
e747aa3
meta_kg is working with pydantic reasoner, also implemented templatin…
anonymous-271828 May 25, 2023
dad6790
initial build with working templating. Removed all references to trap…
anonymous-271828 May 26, 2023
379a618
Reasonable working version using templating for the dispatcher. Will …
anonymous-271828 May 27, 2023
266fb77
Removed old pidc submodule.
anonymous-271828 May 27, 2023
173deca
added script to populate curie template for gene_spec app. Overall mu…
anonymous-271828 May 29, 2023
52a2a4c
Initial integration to be merged with production.
anonymous-271828 May 29, 2023
68bf980
Merged.
anonymous-271828 May 29, 2023
cd17ee1
Working API of gennifer integrated with pidc.
anonymous-271828 May 30, 2023
c850bc5
Updated to working gennifer API with PIDC support and working TRAPI i…
anonymous-271828 May 31, 2023
c1a5763
Added new model viewsets.
anonymous-271828 Jun 1, 2023
3470a43
Made necessary changes to helm deployment and chp settings. Probably …
anonymous-271828 Jun 1, 2023
b41d16c
Removed cp of chp_db fixture from Dockerfile as this can't be include…
anonymous-271828 Jun 2, 2023
bce52bd
Added in all files for static file server. Should probably just add a…
anonymous-271828 Jun 2, 2023
56acf09
feat: update Jenkinsfile for chp-api
bettyli037 Jun 6, 2023
9a676bb
feat: update Jenkinsfile for chp-api
bettyli037 Jun 6, 2023
949e128
feat: update Jenkinsfile for chp-api
bettyli037 Jun 6, 2023
0a2e608
feat: update deployment.yaml for secretKeyRef
bettyli037 Jun 7, 2023
429323b
feat: tmp change for Jenkinsfile and deploy.sh
bettyli037 Jun 7, 2023
96ce10c
feat: add Jenkinsfile
bettyli037 Jun 7, 2023
17bc2d0
feat: update deploy.sh and Jenkinsfile
bettyli037 Jun 7, 2023
1491aa7
feat: update Jenkinsfile
bettyli037 Jun 7, 2023
a5179a8
feat: update deploy.sh
bettyli037 Jun 7, 2023
b625d45
feat: update deployment.yaml
bettyli037 Jun 7, 2023
5d23d70
feat: update deploy.sh
bettyli037 Jun 7, 2023
b230113
feat: update helm chart for chp-api
bettyli037 Jun 8, 2023
5552c2e
feat: update Jenkinsfile
bettyli037 Jun 8, 2023
acdb4d3
feat: update deploy.sh
bettyli037 Jun 8, 2023
5ad4745
feat: update templates/deployment.yaml
bettyli037 Jun 8, 2023
23583ea
feat: update secret.yaml
bettyli037 Jun 8, 2023
91163f7
Updated deployment script and compose files for AWS deployment.
anonymous-271828 Jun 12, 2023
c58cb1b
Merged
anonymous-271828 Jun 12, 2023
e8af8a8
feat: update deployment.yaml
bettyli037 Jun 15, 2023
7945aaa
Merge branch 'di2ag:production' into production
bettyli037 Jun 15, 2023
4e93123
Saving work.
yakaboskic Jun 22, 2023
8386326
Added static files mount volume and changed mount points.
yakaboskic Jun 22, 2023
fdf8f0a
Merge pull request #54 from bettyli037/production
GregHydeDartmouth Jun 22, 2023
6b4f081
Update deployment.yaml
yakaboskic Jun 23, 2023
0fffcfe
Update deployment.yaml
yakaboskic Jun 23, 2023
02f5f44
feat: update Jenkinsfile
bettyli037 Jun 23, 2023
41805bf
Merge branch 'production' into production-yakaboskic
yakaboskic Jun 23, 2023
d317b68
Merge pull request #55 from di2ag/production-yakaboskic
yakaboskic Jun 23, 2023
3e7246f
Merge pull request #56 from bettyli037/production
yakaboskic Jun 23, 2023
6df12e4
feat: update deployment.yaml
bettyli037 Jun 23, 2023
b7e7fcf
Update deployment.yaml
yakaboskic Jun 23, 2023
1c7a0b9
feat: update Jenkinsfile
bettyli037 Jun 23, 2023
a6e417d
feat: update Jenkinsfile
bettyli037 Jun 23, 2023
89602b3
feat: update deployment.yaml
bettyli037 Jun 26, 2023
011fee7
feat: update deployment.yaml
bettyli037 Jun 26, 2023
d1d2eab
feat: update deployment.yaml
bettyli037 Jun 26, 2023
98e6283
Added oauth2 and shifted gennifer models around.
yakaboskic Jun 26, 2023
2ddb13d
Merged with current production that has AWS fixes.
anonymous-271828 Jun 26, 2023
69094c2
feat: update deployment.yaml
bettyli037 Jun 26, 2023
a2bd971
Fixed bug in settings.
anonymous-271828 Jun 26, 2023
7c093f9
feat: update the mountPath for chp-api container
bettyli037 Jun 27, 2023
ef3f140
Added CSRF trusted origins to deployment and settings.
yakaboskic Jun 27, 2023
003c05b
Updated docker compose.
yakaboskic Jun 27, 2023
61be809
Update from dev machine.
anonymous-271828 Jun 27, 2023
747830c
feat: update Jenkinsfile
bettyli037 Jun 27, 2023
b6d194a
Merge branch 'production' into production
yakaboskic Jun 28, 2023
2b6a48b
Merge pull request #57 from bettyli037/production
yakaboskic Jun 28, 2023
e2faeac
Merge branch 'production' of github.com:di2ag/chp_api into production
yakaboskic Jun 28, 2023
df20564
feat: update values.yaml
bettyli037 Jun 28, 2023
e67d5db
Nextjs application support.
anonymous-271828 Jul 4, 2023
ca17256
Merge branch 'production' into yakaboskic-gennifer_integration
anonymous-271828 Jul 4, 2023
b71ccd4
Updated settings and user models.
anonymous-271828 Jul 6, 2023
f29acc9
Added Hyperparameters and updated Task.
anonymous-271828 Jul 10, 2023
934aabd
All five algorithms work as expected.
anonymous-271828 Jul 28, 2023
9080aa7
Updating submodule commit.
di2ag-org Jul 28, 2023
e810439
push local changes for transfer
di2ag-org Sep 7, 2023
a5a4f71
permisions for push to transfer
di2ag-org Sep 7, 2023
7fc34a5
feat: update deployment.yaml with container resource definition
bettyli037 Sep 20, 2023
1a79069
feat: update chp_api resources
bettyli037 Sep 20, 2023
42ad68e
feat: helm chart version is updated to 0.1.1
bettyli037 Sep 20, 2023
20ac077
feat: restore debug value
bettyli037 Sep 20, 2023
5ea10e4
Saving work.
di2ag-org Sep 21, 2023
ff36056
Merge pull request #59 from bettyli037/resources
GregHydeDartmouth Sep 21, 2023
c2e44b8
Updated gennifer commit.
di2ag-org Oct 18, 2023
dd0159c
Updated pydantic version to install until reasoner-pydantic is fixed.
yakaboskic Oct 19, 2023
af9f342
Added Tolerations to managed-app
akadapa Nov 15, 2023
196438b
Merge pull request #60 from akadapa/OM-10439-chpapi
GregHydeDartmouth Nov 15, 2023
9f02fbc
updates to gennifer and reverting gene_spec branch back to master
di2ag-org Dec 6, 2023
e31ad1b
changes for new gene_spec data and models
di2ag-org Dec 7, 2023
eb4da3f
updated for open telemetry, trapi 1.5 and biolink 4.2.0
di2ag-org Apr 23, 2024
c106ac5
merged conflicts
di2ag-org Apr 23, 2024
39f21e5
Merge pull request #61 from di2ag/yakaboskic-opentelemetry
yakaboskic Apr 23, 2024
727f2a0
temp solution for CI build to find requirements
di2ag-org Apr 30, 2024
cd49eaf
Update Jenkinsfile with the Docker build path
pahmadi8740 Apr 30, 2024
ca5e066
Merge pull request #64 from pahmadi8740/patch-1
GregHydeDartmouth Apr 30, 2024
6458ae9
Update values.yaml with new affinity
pahmadi8740 May 3, 2024
d2e3ff1
Merge pull request #65 from pahmadi8740/patch-2
yakaboskic May 3, 2024
71e5d6c
Update Jenkinsfile
akadapa May 7, 2024
ddde7a8
Merge pull request #68 from akadapa/patch-1
yakaboskic May 7, 2024
de4a9c5
Update Jenkinsfile
yakaboskic May 7, 2024
e7d3920
Update Jenkinsfile
yakaboskic May 7, 2024
4da6e17
fixed a few bugs with the trapi 1.5 deployment
di2ag-org May 8, 2024
9240166
Merge branch 'production' of github.com:di2ag/chp_api into production
di2ag-org May 8, 2024
ac6c98a
set Dockerfile to run migrations in the event there are any migration…
di2ag-org May 9, 2024
82439be
Update values.yaml
akadapa May 15, 2024
02c7340
Merge pull request #69 from akadapa/patch-2
GregHydeDartmouth May 15, 2024
e9b7c59
updated values
GregHydeDartmouth May 15, 2024
349170c
Update values.yaml
akadapa May 15, 2024
0f848b6
Merge pull request #70 from akadapa/patch-3
GregHydeDartmouth May 15, 2024
22828ba
Update Dockerfile
GregHydeDartmouth May 16, 2024
3cfb83e
reverting explicit settings link. Should not be needed
di2ag-org Jun 6, 2024
e90072a
Update urls.py
GregHydeDartmouth Aug 6, 2024
f669baf
Update README.md
GregHydeDartmouth Sep 11, 2024
e4a73b5
Merge pull request #80 from di2ag/update_docs
GregHydeDartmouth Sep 12, 2024
1f3d4af
Update README.md
GregHydeDartmouth Sep 12, 2024
9c49194
Update README.md
GregHydeDartmouth Sep 12, 2024
fed8758
Update README.md
GregHydeDartmouth Sep 12, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 6 additions & 6 deletions .devcontainer/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,14 +1,14 @@
# See here for image contents: https://github.com/microsoft/vscode-dev-containers/tree/v0.245.0/containers/python-3/.devcontainer/base.Dockerfile

# [Choice] Python version (use -bullseye variants on local arm64/Apple Silicon): 3, 3.10, 3.9, 3.8, 3.7, 3.6, 3-bullseye, 3.10-bullseye, 3.9-bullseye, 3.8-bullseye, 3.7-bullseye, 3.6-bullseye, 3-buster, 3.10-buster, 3.9-buster, 3.8-buster, 3.7-buster, 3.6-buster
ARG VARIANT="3.10-bullseye"
ARG VARIANT=3-bullseye
FROM mcr.microsoft.com/vscode/devcontainers/python:0-${VARIANT}

ENV PYTHONUNBUFFERED 1

# [Choice] Node.js version: none, lts/*, 16, 14, 12, 10
ARG NODE_VERSION="none"
RUN if [ "${NODE_VERSION}" != "none" ]; then su vscode -c "umask 0002 && . /usr/local/share/nvm/nvm.sh && nvm install ${NODE_VERSION} 2>&1"; fi

# [Optional] If your pip requirements rarely change, uncomment this section to add them to the image.
# [Optional] If your requirements rarely change, uncomment this section to add them to the image.
# COPY requirements.txt /tmp/pip-tmp/
# RUN pip3 --disable-pip-version-check --no-cache-dir install -r /tmp/pip-tmp/requirements.txt \
# && rm -rf /tmp/pip-tmp
Expand All @@ -17,5 +17,5 @@ RUN if [ "${NODE_VERSION}" != "none" ]; then su vscode -c "umask 0002 && . /usr/
# RUN apt-get update && export DEBIAN_FRONTEND=noninteractive \
# && apt-get -y install --no-install-recommends <your-package-list-here>

# [Optional] Uncomment this line to install global node packages.
# RUN su vscode -c "source /usr/local/share/nvm/nvm.sh && npm install -g <your-package-here>" 2>&1


28 changes: 11 additions & 17 deletions .devcontainer/devcontainer.json
Original file line number Diff line number Diff line change
@@ -1,19 +1,11 @@
// For format details, see https://aka.ms/devcontainer.json. For config options, see the README at:
// https://github.com/microsoft/vscode-dev-containers/tree/v0.245.0/containers/python-3
// https://github.com/microsoft/vscode-dev-containers/tree/v0.245.0/containers/python-3-postgres
// Update the VARIANT arg in docker-compose.yml to pick a Python version
{
"name": "Python 3",
"build": {
"dockerfile": "Dockerfile",
"context": "..",
"args": {
// Update 'VARIANT' to pick a Python version: 3, 3.10, 3.9, 3.8, 3.7, 3.6
// Append -bullseye or -buster to pin to an OS version.
// Use -bullseye variants on local on arm64/Apple Silicon.
"VARIANT": "3.8",
// Options
"NODE_VERSION": "lts/*"
}
},
"name": "Python 3 & PostgreSQL",
"dockerComposeFile": "docker-compose.yml",
"service": "app",
"workspaceFolder": "/workspace",

// Configure tool-specific properties.
"customizations": {
Expand All @@ -32,7 +24,8 @@
"python.linting.mypyPath": "/usr/local/py-utils/bin/mypy",
"python.linting.pycodestylePath": "/usr/local/py-utils/bin/pycodestyle",
"python.linting.pydocstylePath": "/usr/local/py-utils/bin/pydocstyle",
"python.linting.pylintPath": "/usr/local/py-utils/bin/pylint"
"python.linting.pylintPath": "/usr/local/py-utils/bin/pylint",
"python.testing.pytestPath": "/usr/local/py-utils/bin/pytest"
},

// Add the IDs of extensions you want installed when the container is created.
Expand All @@ -44,10 +37,11 @@
},

// Use 'forwardPorts' to make a list of ports inside the container available locally.
// "forwardPorts": [],
// This can be used to network with other containers or the host.
// "forwardPorts": [5000, 5432],

// Use 'postCreateCommand' to run commands after the container is created.
// "postCreateCommand": "pip3 install --user -r requirements.txt",
// "postCreateCommand": "pip install --user -r requirements.txt",

// Comment out to connect as root instead. More info: https://aka.ms/vscode-remote/containers/non-root.
"remoteUser": "vscode",
Expand Down
46 changes: 46 additions & 0 deletions .devcontainer/docker-compose.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
version: '3.8'

services:
app:
container_name: dev-env
build:
context: ..
dockerfile: .devcontainer/Dockerfile
args:
# Update 'VARIANT' to pick a version of Python: 3, 3.10, 3.9, 3.8, 3.7, 3.6
# Append -bullseye or -buster to pin to an OS version.
# Use -bullseye variants on local arm64/Apple Silicon.
VARIANT: "3.8"
# Optional Node.js version to install
NODE_VERSION: "lts/*"

volumes:
- ..:/workspace:cached

# Overrides default command so things don't shut down after the process ends.
command: sleep infinity

# Runs app on the same network as the database container, allows "forwardPorts" in devcontainer.json function.
network_mode: service:db
# Uncomment the next line to use a non-root user for all processes.
# user: vscode

env_file:
- ../.dev.env

# Use "forwardPorts" in **devcontainer.json** to forward an app port locally.
# (Adding the "ports" property to this file will not forward from a Codespace.)

db:
image: postgres:latest
container_name: dev-db
restart: unless-stopped
volumes:
- postgresql:/var/lib/postgresql/data
env_file:
- ../.dev-db.env
# Add "forwardPorts": ["5432"] to **devcontainer.json** to forward PostgreSQL locally.
# (Adding the "ports" property to this file will not forward from a Codespace.

volumes:
postgresql:
9 changes: 0 additions & 9 deletions .env.dev

This file was deleted.

11 changes: 0 additions & 11 deletions .env.prod

This file was deleted.

3 changes: 0 additions & 3 deletions .env.prod.db

This file was deleted.

11 changes: 0 additions & 11 deletions .env.stage

This file was deleted.

3 changes: 0 additions & 3 deletions .env.stage.db

This file was deleted.

9 changes: 7 additions & 2 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,6 +1,10 @@
# env files for development
.dev-db.env
.dev.env

# data files for development
chp.sql
chp_db_fixture.json.gz
#deployment-script
deployment-script

#SSH Keys
id_rsa*
Expand Down Expand Up @@ -134,3 +138,4 @@ dmypy.json

# Pyre type checker
.pyre/
/Dockerfile.dev-db
3 changes: 3 additions & 0 deletions .gitmodules
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
[submodule "gennifer"]
path = gennifer
url = [email protected]:di2ag/gennifer.git
1 change: 1 addition & 0 deletions .vscode/settings.json
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
{
"python.analysis.typeCheckingMode": "off",
"workbench.editor.enablePreview": false,
"python.defaultInterpreterPath": "${workspaceFolder}/.venv/bin/python"
}
104 changes: 0 additions & 104 deletions Dockerfile.dev

This file was deleted.

Loading