Skip to content

Latest commit

 

History

History
255 lines (227 loc) · 12.3 KB

README.md

File metadata and controls

255 lines (227 loc) · 12.3 KB

Running with Docker

Building an image

Building a server image

$ cd ./docker
$ docker build -t <name>:<tag> server

Docker compose

You can start a MAGE server by using docker-compose to start services defined in MAGE's Compose file.

The first time you run MAGE with docker, execute the following steps from the directory where you cloned the MAGE Git repoistory.

$ cd ./docker
$ docker-compose up -d # build the service images, then create and start the service containers for the first time

With all the default settings, you should then be able to browse to http://localhost:4242 to interact with the MAGE web app.

Interacting with the containers

NOTE: All of the following docker-compose commands described below assume you are operating from the docker directory.

After the initial up command, you can use docker-compose stop and docker-compose start to stop and start the service containers.

You can use docker-compose ps to see the state of the MAGE service containers.

$ docker-compose ps
        Name                      Command               State             Ports
-----------------------------------------------------------------------------------------
docker_mage-db_1       docker-entrypoint.sh mongo ...   Up       0.0.0.0:27017->27017/tcp
docker_mage-server_1   node ./app.js                    Up       0.0.0.0:4242->4242/tcp

You can use docker-compose logs <service> to display console logging for a service.

$ docker-compose logs mage-server
mage-server_1  | 2018-04-26T23:30:30.684Z - info: Starting MAGE Server ...
mage-server_1  | 2018-04-26T23:30:31.403Z - info: setting up provision uid
mage-server_1  | (node:1) DeprecationWarning: Mongoose: mpromise (mongoose's default promise library) is deprecated, plug in your own promise library instead: http://mongoosejs.com/docs/promises.html
mage-server_1  | 2018-04-26T23:30:31.861Z - info: Using '/var/lib/mage/attachments' as base directory for feature attachments.
mage-server_1  | 2018-04-26T23:30:31.861Z - info: Using '/var/lib/mage/icons' as base directory for MAGE icons.
# etc., etc.

While the service containers are up, you can interact with them using docker-compose exec to run commands in the container. For example, to get an interactive shell session in the MongoDB container, run

$ docker-compose exec mage-db bash
root@df8b00beafa2:/# ps -ef
UID        PID  PPID  C STIME TTY          TIME CMD
mongodb      1     0  0 07:16 ?        00:03:47 mongod --dbpath /data/mage --logpath /var/log
root        67     0  0 22:37 pts/0    00:00:00 bash
root        73    67  0 22:37 pts/0    00:00:00 ps -ef
root@df8b00beafa2:/# mongo # interact directly with the running MAGE database # do some ill-advised things directly to the database
MongoDB shell version v3.6.3
connecting to: mongodb://127.0.0.1:27017
MongoDB server version: 3.6.3
Welcome to the MongoDB shell.
For interactive help, type "help".
For more comprehensive documentation, see
	http://docs.mongodb.org/
Questions? Try the support group
	http://groups.google.com/group/mongodb-user
Server has startup warnings:
2018-04-25T17:06:06.133+0000 I CONTROL  [initandlisten]
2018-04-25T17:06:06.133+0000 I CONTROL  [initandlisten] ** WARNING: Access control is not enabled for the database.
2018-04-25T17:06:06.133+0000 I CONTROL  [initandlisten] **          Read and write access to data and configuration is unrestricted.
2018-04-25T17:06:06.133+0000 I CONTROL  [initandlisten]
> use magedb
switched to db magedb
> show collections
cappedlocations
counters
devices
events
layers
locations
logins
migrations
roles
settings
tokens
users
>

Details

App Services

The MAGE Server Docker app consists of three service containers: the MongoDB database, the MAGE Node.js app, and the optional nginx TLS reverse proxy.

MongoDB

The MongoDB image is the official MongoDB image available from Docker Hub. The Compose file builds that image unmodified, but uses a custom command to launch MongoDB with specific settings. The Compose file runs MongoDB as the service mage-db.

MAGE Server

The Compose file references a custom, local Dockerfile based on the official Node.js image to build the MAGE server image. At build time, the MAGE server Dockerfile downloads an archive of the MAGE server code from Github. This defaults to some (hopefully) recent release version of the MAGE server, e.g., 6.0.1. The Dockerfile accepts an argument, MAGE_VERSION, which you can specify to docker-compose like

MAGE_VERSION=develop docker-compose build

to build with whatever version of MAGE server you wish. Github should accept any valid, uniquely identifiable refspec in the download URL the Docker file uses, so you could use a branch name, tag name, or commit hash. By way of the

image: "mage-server:${MAGE_VERSION:-6.0.1}"

entry the Compose file tells Docker to tag the mage-server image with value of MAGE_VERSION.

Be aware that every different value you specify for MAGE_VERSION to docker-compose build, Docker will build a separate mage-server image because changing that value modifies the build stage that downloads the MAGE server baseline. For example after running

$ MAGE_VERSION=6.0.1 docker-compose build
# ... Docker build output
$ MAGE_VERSION=develop docker-compose build
# ... Docker build output

then listing your Docker images ...

$ docker images
REPOSITORY          TAG                 IMAGE ID            CREATED             SIZE
mage-server         6.0.1               877f79a739b7        8 minutes ago       949MB
mage-server         develop             75a73b7b7c3e        2 days ago          961MB
node                8.11.1              4635bc7d130c        3 weeks ago         673MB
mongo               3.6-jessie          5b1317f8158f        6 weeks ago         366MB

... note you now have two mage-server images with different version tags, both occupying over 900MB, and both connecting to the same MongoDB instance. In some cases you may actually want to do this, to test an upgrade, for example. Remember you can always remove images you don't need.

$ docker rmi mage-server:develop

Another consequence of building the images using the MAGE_VERSION=xxx docker-compose build syntax is that you must then supply the same MAGE_VERSION=xxx value when you run the subsequent docker-compose up -d command. Otherwise, docker-compose will rebuild the mage-server image with the version the Compose file defines if it differs from the one you specified on the command line, and run a container with that version instead.

HTTPS/TLS Reverse Proxy

Then mage-web-proxy service is optional when developing and running on localhost, but highly recommended when running MAGE Server on publicly accessible servers. The service in docker-compose.yml uses the official nginx docker image with an appropriate configuration. This is an example of setting up a reverse proxy in front of the Node server to enforce HTTPS/TLS connections to the server. Of course, you could use any reverse proxy you see fit, such as Apache HTTP Server or an AWS Application Load Balancer. To run your MAGE server behind the TLS reverse proxy, peform the following modifications to docker-compose.yml.

  1. Comment the ports block for the mage-server service to disallow connections directly to the Node.js server.
  2. Uncomment the block with the mage-web-proxy service key.

For testing in a development environment, you can create a self-signed server certificate for nginx to use. The following OpenSSL command, run from the directory of this README, will create a self-signed server certificate and private key in the web directory that should allow the MAGE mobile app to connect to nginx. Replace the values of the SUBJ_* variables at the beginning of the command with your own values.

SUBJ_C="XX" \
SUBJ_ST="State" \
SUBJ_L="Locality" \
SUBJ_O="Organization" \
SUBJ_OU="Organizational_Unit" \
SUBJ_CN="HOST_NAME_OR_IP"; \
openssl req -new -nodes -x509 -newkey rsa:4096 -sha256 -days 1095 \
-out web/mage-web.crt -keyout web/mage-web.key \
-config <(cat /etc/ssl/openssl.cnf <(printf "[mage]\n  \
subjectAltName=DNS:$SUBJ_CN\n  \
basicConstraints=CA:true")) \
-subj "/C=$SUBJ_C/ST=$SUBJ_ST/L=$SUBJ_L/O=$SUBJ_O/OU=$SUBJ_OU/CN=$SUBJ_CN" \
-extensions mage; \
unset SUBJ_C SUBJ_ST SUBJ_L SUBJ_O SUBJ_OU SUBJ_CN

The preceding command creates web/mage-web.crt and web/mage-web.key, which the nginx configuration file references. The <(...) operator is Unix process substitution and allows treating the enclosed command output as a file. The subjectAltName and basicConstraints arguments are necessary to install the public certificate, mage-web.crt, as a trusted authority on a mobile device.

IMPORTANT If you intend to connect to your reverse proxy from a mobile device or simulator/emulator running the MAGE mobile app, make sure that the value of the SUBJ_CN variable matches the IP address of your MAGE Server host on your network, or the resolvable host name of the host. TLS connections will not succeed if Common Name and Subject Alternative Name fields in the public certificate do not match the host name.

When running with the reverse proxy and default port settings in the Compose file, your server will be available at https://localhost:5443. If you are connecting from a mobile device on the same network.

Bind Mounts

The Compose file uses bind mounts for the MongoDB database directory, database log path, and MAGE server resources. By default, the source paths of those bind mounts are database/data, database/log, and server/resources, respectively. You can change the source paths according to your environment and needs.

With these bind mounts, the MAGE server will retain its data on your host file system in directories you can explore and manage yourself. For example, this setup allows you to mount a directory into the MAGE server container from a FUSE-based file system, which might provide extra functionality like encryption or remote mounting transparently to the Docker container and MAGE application. If you don't have any requirements of that sort, you can modify the Compose file to use Docker-managed volumes instead of bind mounts.

Ports

The only port the Compose file exposes to the host by default is 4242 on the mage-server service to allow HTTP connections from your host web browser to the MAGE server running in the Docker container. In a production environment, you could add another service in the Compose file to run an nginx or httpd reverse proxy with TLS or other security measures in front of the MAGE Server Node application. In that case you would remove the

ports:
  - 4242:4242

lines from the Compose file under the mage-server service entry. You would then most likely add the mapping

ports:
  - 443:443

to the reverse proxy's service definition.

You can also allow connections from your host to the MongoDB database container by uncommenting the ports block of the mage-db service. You would then be able to connect directly to the MongoDB database using the mongo client on your host machine to examine or modify the database contents.

Environment Settings

You can configure the MAGE server Docker app using environment variables. The Compose file does this by necessity to configure the MongoDB URL for the MAGE server.

environment:
    MAGE_MONGO_URL: mongodb://mage-db:27017/magedb