Skip to content

Latest commit

 

History

History
83 lines (52 loc) · 4.66 KB

README.md

File metadata and controls

83 lines (52 loc) · 4.66 KB
Raw

Example Notebook Servers

🛑️️ These server images are provided as examples only and are supported on a best-effort basis. Contributions are greatly appreciated.

Overview

In this folder, we have tried to make an extendable image structure which you can easily augment with additional tools and packages.

flow-chart of kubeflow notebook server images

The following images are considered 'base' images, which you can extend:

Name Description
./base the common base for all other images
./jupyter the base JupyterLab image
./codeserver the base code-server (Visual Studio Code) image
./rstudio the base RStudio image

Important points about the images:

  • they make use of the s6-overlay init system
  • they all run as the non-root jovyan user

How do I extend these images?

⚠️ any changes made by users after spawning a Kubeflow notebook will only last the lifetime of the pod, unless they are installed into a PVC-backed directory

Adding conda/pip packages

Extend one of the base images and install any pip or conda packages your Kubeflow Notebook users are likely to need.

As a guide, look at jupyter-pytorch-full.cpu for a pip install ... example, and the rstudio-tidyverse for conda install ....

WARNING: a common cause of errors is users running pip install --user ..., causing the home-directory (which is backed by a PVC) to contain a different or incompatible version of a package contained in /opt/conda/...

Adding apt-get packages

Extend one of the base images and install any apt-get packages your Kubeflow Notebook users are likely to need.

WARNING: ensure you swap to root in the Dockerfile before running apt-get, and swap back to jovyan after.

Adding container startup scripts

Some use-cases might require custom scripts to run during the startup of the Notebook Server container, or advanced users might want to add additional services that run inside the container (for example, an Apache or NGINX web server). To make this easy, we use the s6-overlay.

The s6-overlay differs from other init systems, such as the popular tini. While tini was created to handle a single process running in a container as PID 1, the s6-overlay is built to manage multiple processes and allows the creator of the image to determine which process failures should silently restart, and which should cause the container to exit.

Custom startup scripts:

Scripts that need to run during the startup of the container can be placed in /etc/cont-init.d/, and are executed in ascending alphanumeric order.

An example of a startup script can be found in ./rstudio/s6/cont-init.d/02-rstudio-env-fix. This script uses the with-contenv helper so that environment variables (passed to container) are available in the script. The purpose of this script is to snapshot any KUBERNETES_* environment variables into the Renviron.site at pod startup, as without these variables kubectl does not work.

Custom service scripts:

Extra services to be monitored by s6-overlay should be placed in their own folder under /etc/services.d/ containing a script called run and optionally a finishing script finish.

An example of a service can be found in jupyter/s6/services.d/jupyterlab which is used to start JupyterLab itself. For more information about the run and finish scripts, please see the s6-overlay documentation.

WARNING: our example images run s6-overlay as $NB_USER not root, meaning any files or scripts related to s6-overlay should be owned by the $NB_USER user

There may be cases when you need to run a service as root. To do this, you can change the Dockerfile to have USER root at the end, and then use s6-setuidgid to run the user-facing services as $NB_USER.

For example, here is a run script for code-server:

#!/usr/bin/with-contenv bash

export SHELL='/bin/bash'
exec s6-setuidgid $NB_USER \
     /usr/local/bin/code-server \
     --bind-addr 0.0.0.0:8888 \
     --disable-telemetry \
     --auth none