Skip to content
forked from ivotron/sc16

The System Research Lab's SuperComputing '16 Paper

Notifications You must be signed in to change notification settings

carlosmalt/sc16

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

70 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SC16: Experiments and Results

This repository has our experiments for our SuperComputing '16 submission.

Install

These experiments were run on CloudLab. We have a 6-node Centos7.1 baremetal setup, so you can instantiate a cluster from our GassyFS Profile. Select the Clemson cluster, since these nodes have infiniband. On all nodes:

  1. Setup passwordless SSH and sudo

  2. Install Docker and setup infiniband. For Centos7.1, you can use:

$ cd experiments; ./bootstrap.sh

Quickstart

  1. Start experiment master (i.e., a container with Ansible):

    $ cd experiments; ./emaster.sh
  2. Choose an experiment and setup the cluster inventory:

    [EXPERIMENT_MASTER] cd multi-node
    [EXPERIMENT_MASTER] vim inventory/*
  3. Start the experiment!

    [EXPERIMENT_MASTER] ./run.sh
    

Results and Logs

Inside the experiment directory there is a results and logs directory. These will be overwritten everytime you run an experiment... so you should try to commit the results along with the entire experiment directory before running a new job. This gives you a history of different experiments and helps us understand how small tweaks affect results.

Troubleshooting

Check to make sure everything installed smoothly:

# Should return unlimited
$ ulimit -l

# Should show no running images
$ docker ps 

EOF

About

The System Research Lab's SuperComputing '16 Paper

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 93.5%
  • Shell 6.5%