IDR 0.4.4 merge branch

[manics]

This will be split into separate PRs.

• --depends-on Use bundler and Gemfile{.lock} to freeze dependency versions ome/ansible-role-jekyll-build#9

--on-hold
--exclude

Main changes:

• /shared scratch space in jupyterhub notebooks
• Moved jekyll source dir to /srv/www/src/ and added initial config to support Add IDR version string to footer idr.openmicroscopy.org#24
• Prometheus monitoring for postgres
• Bumped Postgres ansible role to 3.0.0-m2, updated variables, enabled restricted option (omero-readonly requires TEMPORARY table privs).
• Experimental: Ensure journald logs are kept after reboot, need to check for disk usage and/or log rotation
• Bumped to Kubernetes 1.7.4 (may contain deployment bugs which require deleting instead of updating a deployment when the config is changed)
• Enabled anonymous grafana account for interactive viewing (can view over ssh tunnel without login, not safe for public proxying due to lack of protection for backend data: Make grafana views more accessible #49)
• Experimental: proxy rendered pngs of grafana dashboards with 60 second cache, e.g. http://example.org/grafana/idr-vertical (accepts size query parameters, need to check whether there are limits, hangs with invalid dashboard names).

[manics]

This has been split into the following PRs:

• Docker/kubernetes host deployment (IDR-0.4.4) #55
• Add playbooks for archiving old prod IDR (IDR-0.4.4) #56
• Add experimental-omero-fpbioimage.yml playbook (IDR-0.4.4) #57
• More grafana dashboards. Enable anonymous access (IDR-0.4.4) #58
• Major refactoring of Jupyterhub (IDR-0.4.4) #59
• Pin version of flannel playbook in roles/kubernetes (IDR-0.4.4) #60
• Remove nfs group creation (IDR-0.4.4) #61
• Bump requirements (IDR-0.4.4) #62
• Bump OMERO, update PG config (IDR-0.4.4) #63
• Ensure journald logs are maintained after a reboot (IDR-0.4.4) #64
• Prometheus updates (IDR-0.4.4) #65
• Update about page, link to grafana images (IDR-0.4.4) #66
• Update scripts for latest deployment structure (IDR-0.4.4) #67

[sbesson]

Most open PRs targeted at IDR 0.4.4 have been integrated. Is this merge branch still necessary?

[jburel]

Are the new files in this PR needed to be added to master?

• ansible/experimental-omero-web-addons.yml (replacement for fp-bioimage)
• ansible/grafana-dashboards/idr-postgresql.json

What about the changes in ansible/idr-09-monitoring.yml and ansible/management-grafana.yml
Do they need to be included?

[manics]

Thanks for checking, I've rebased this and added the remaining commits to:

• Grafana improvements (IDR-0.4.4) #69
• Add more experimental web apps (IDR-0.4.4) #70

[jburel]

General question: how do we know that there are not other commits used for deployment that have been forgotten?

[manics]

Same as before, diff master against this branch?

[jburel]

The question is more: do we have other ways to validate that the diff?
At the moment, there is none (which is fine) Trying to get my head around everything

[sbesson]

Looking at https://github.com/manics/deployment/compare/idr-0-4-4...snoopycrimecop:master/merge/trigger?expand=1 is the extra iviewer section expected?

[manics]

Isn't that in #70 ?

[sbesson]

👍 GitHub branch comparison API has limitations when comparing differences between 2 integrations branchess but a manual git diff shows the two branches have no differences.

[sbesson]

All PRs have now been integrated into master. Closing this.