Skip to content

bigdatacesga/scheduler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

36 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CESGA Big Data Infrastructure

Custom Mesos Framework - Docker Executor Launcher

This project implements a full mesos framework that is able to receive offers from a mesos master and launch instances (by running the docker-executor project) with specified resources.

A REST API is provided.

Test instance execution with:

curl -X POST http://mesos_framework.service.int.cesga.es:5000/bigdata/mesos_framework/v1/instance -d '{"instance_dn": "/instances/jenes/mpi/1.0/1"}' -H "Content-type: application/json"

Get the queued instances with:

curl http://mesos_framework.service.int.cesga.es:5000/bigdata/mesos_framework/v1/instances

Installing dependencies

pip install -r requirements.txt
cd lib/<OS-version>
pip install mesos.interface-0.28.1-py2-none-any.whl \
            mesos.native-0.28.1-cp27-none-linux_x86_64.whl \
            mesos-0.28.1-py2-none-any.whl

Mesos executor

The mesos executor must be distrubuted to the mesos slaves at placed at:

/usr/local/mesos/bin/bigdata-executor.py