Skip to content

Latest commit

 

History

History
319 lines (260 loc) · 11.3 KB

README.md

File metadata and controls

319 lines (260 loc) · 11.3 KB
Raw

Development Docker Image

This image can be used to get started with the vpp-agent Go code. It contains:

  • The development environment with all libs & dependencies required to build both the VPP itself and the VPP Agent
  • A pre-built vpp ready to be used
  • A pre-built VPP Agent

Getting an Image from Dockerhub

For a quick start with the Development image, you can use pre-built Development docker images that contain pre-built VPP Agent, VPP, and tools, the Ligato and VPP source code, Git, and build tools for both the VPP Agent and VPP. The pre-built Development docker images are available from Dockerhub, or you can just type:

docker pull ligato/dev-vpp-agent

Then you can start the downloaded Development image as described here.

Building Locally

To build the docker image on your local machine, type:

./build.sh

This will build dev_vpp_agent image with default parameters:

  • vpp-agent - latest commit number from the cloned repo,
  • vpp - commit number specified in vpp submodule.

To build specific commits (one or both), use build.sh with parameters:

  • -a or --agent to specify vpp-agent commit number,
  • -v or --vpp to specify vpp commit number.

Example:

./build.sh --agent 9c35e43e9bfad377f3c2186f30d9853e3f3db3ad --vpp f3bcdbf071c98ed676591bd22c3d3f8601009fa8

You can still build image using docker build command, but you must explicitly specify the agent and vpp commit numbers:

sudo docker build -t dev_vpp_agent --build-arg AGENT_COMMIT=2c2b0df32201c9bc814a167e0318329c78165b5c --build-arg VPP_COMMIT=f3bcdbf071c98ed676591bd22c3d3f8601009fa8 --no-cache .

Verifying a Created or Downloaded Image

You can verify the newly built or downloaded image as follows:

docker images

You should see something like this:

REPOSITORY                       TAG                 IMAGE ID            CREATED             SIZE
dev_vpp_agent                    latest              0692f574f21a        11 minutes ago      3.58 GB
...

Get the details of the newly built or downloaded image:

docker image inspect dev_vpp_agent
docker image history dev_vpp_agent

Shrinking the Image

Dev_vpp_agent image can be shrunk by typing the command:

./shrink.sh

This will build a new image with the name dev_vpp_agent_shrink, where vpp sources and build related files have been removed (in total about 2GB).

The shrink.sh script is using docker export and import command, but due Docker issue it will fail on docker older than 1.13.

$ docker images
REPOSITORY                                            TAG                 IMAGE ID            CREATED             SIZE
dev_vpp_agent                                         latest              442771972e4a        8 hours ago         3.57 GB
dev_vpp_agent_shrink                                  latest              bd2e76980236        8 hours ago         1.68 GB

Starting the Image

By default, the VPP & the Agent processes will be started automatically in the container. This is useful e.g. for deployments with Kubernetes, as described in this README. However, this option is not really required for development purposes, and it can be overridden by specifying a different container entry point, e.g. bash, as shown below.

To start the image, type:

sudo docker run -it --name vpp_agent --privileged --rm dev_vpp_agent bash

To open another terminal into the image:

sudo docker exec -it vpp_agent bash

Running VPP and the Agent

NOTE: The Agent will terminate if it cannot connect to VPP and to a Etcd server. If Kafka config is specified, a successful connection to Kafka is also required. If Kafka config is not specified, the Agent will run without it, but all Kafka-related functionality will be disabled.

Start VPP in one of two modes:

  • If you don't need (or don't have) DPDK, use "vpp lite":
vpp unix { interactive } plugins { plugin dpdk_plugin.so { disable } }

Note: you most likely do not have DPDK support if you're doing development on your local laptop.

  • If you want DPDK (with no PCI devices), use:
vpp unix { interactive } dpdk { no-pci }

Note that for DPDK, you would need to run the container in privileged mode (add --privileged option to docker run). For more options, please refer to VPP documentation.

To run the Agent, do the following:

  • Edit /opt/vpp-agent/dev/etcd.conf to point the agent to an ETCD server that runs outside of the VPP/Agent container. The default configuration is:
insecure-transport: true
dial-timeout: 1000000000
endpoints: 
 - "172.17.0.1:2379"

Note that if you start Etcd in its own container on the same host as the VPP/Agent container (as described below), you can use the default endpoint configuration as is. ETCD is by default mapped onto the host at port 2379; the host's IP address will typically be 172.17.0.1, unless you change your Docker networking settings.

  • Edit /opt/vpp-agent/dev/kafka.conf to point the agent to a Kafka broker. The default configuration is:
addrs:
 - "172.17.0.1:9092"

Note that if you start Kafka in its own container on the same host as the VPP/Agent container (as described below), you can use the default broker address configuration as is. Kafka will be mapped onto the host at port 9092; the host's IP address will typically be 172.17.0.1, unless you change your Docker networking settings.

  • Start the Agent:
vpp-agent --etcdv3-config=/opt/vpp-agent/dev/etcd.conf --kafka-config=/opt/vpp-agent/dev/kafka.conf

Running Etcd Server on Local Host

You can run an ETCD server in a separate container on your local host as follows:

sudo docker run -p 2379:2379 --name etcd --rm \
    quay.io/coreos/etcd:v3.1.0 /usr/local/bin/etcd \
    -advertise-client-urls http://0.0.0.0:2379 \
    -listen-client-urls http://0.0.0.0:2379

The ETCD server will be available on your host OS IP (most likely 172.17.0.1 in the default docker environment) on port 2379.

Call the agent via ETCD using the testing client:

cd $GOPATH/src/github.com/ligato/vpp-agent/cmd/vpp-agent-ctl
go run main.go /opt/vpp-agent/dev/etcd.conf -ct
go run main.go /opt/vpp-agent/dev/etcd.conf -mt
go run main.go /opt/vpp-agent/dev/etcd.conf -dt

Running Kafka on Local Host

You can start Kafka in a separate container:

sudo docker run -p 2181:2181 -p 9092:9092 --name kafka --rm \
 --env ADVERTISED_HOST=172.17.0.1 --env ADVERTISED_PORT=9092 spotify/kafka

Rebuilding the Agent

cd $GOPATH/src/github.com/ligato/vpp-agent/
git pull      # if needed
make
make test     # optional
make install

This should update the agent binary in yor $GOPATH/bin directory.

Rebuilding of the container image:

Use the --no-cache flag for docker build:

sudo docker build --no-cache -t dev_vpp_agent .

Mounting of a host directory into the Docker container:

Use -v option of the docker command:

sudo docker run -v /host/folder:/container/folder -it --name vpp_agent --privileged --rm dev_vpp_agent bash

E.g. if you have the vpp-agent code in ~/go/src/github.com/ligato/vpp-agent/ on your host OS, you can mount it as /root/go/src/github.com/ligato/vpp-agent/ in the container as follows:

sudo docker run -v ~/go/src/github.com/ligato/vpp-agent/:/root/go/src/github.com/ligato/vpp-agent/ -it --name vpp_agent --rm dev_vpp_agent bash

Then you can modify the code on you host OS and us the container for building and testing it.

Example: Using the Development Environment on a MacBook with Gogland

This section describes the setup of a lightweight, portable development environment on your local notebook (MacBook or MacBook Pro in this example). The MacBook will be the host for the Development Environment container and the folder containing the agent sources will be shared between the host and the container. Then, you can run the IDE, git, and other tools on the host and the compilations/testing in the container.

Prerequisites

  1. Get Docker for Mac. If you don't have it already installed, follow these install instructions.

  2. Install Go and the Gogland IDE. Go can be downloaded from this repository, and its install instructions are here. The download and install instructions for Gogland are here.

  3. Once you have Docker up & running on your Mac, build and verify the Development Environment container as described above.

Building and Running the Agent

For the mixed host-container environment, the folder holding the Agent source code must be setup properly on both the host and in the container. You must also set GOPATH and GOROOT appropriately in Gogland and in the development container. We will now walk you through these steps.

On your Mac:

  • Create the Go home folder, for example ~/go/

  • Create the Go source folder in your Go home folder. The Go source folder must be called src. So you will have: ~/go/src

  • In the Go source folder, create the folder that will hold the local clone of the vpp-agent repository. The path for the folder must reflect the import path in Go source code. So, the vpp-agent repository folder will be created as follows:

   cd  ~/go/src
   mkdir github.com
   mkdir github.com/ligato
  • The agent repository is located at https://github.com/ligato/vpp-agent. Go into your local vpp-agent repo folder and checkout the Agent code:
   cd github.com/ligato
   git clone https://github.com/ligato/vpp-agent.git

  • In Gogland, set GOROOT and GOPATH (Preferences->Go->GOROOT, Preferences->Go->GOPATH). Set GOROOT to where Go is installed (default: /usr/local/go) and the global GOPATH to the location of your Go home folder (/Users/jmedved/Documents/Git/go-home/ in our example).

  • Create a new project in Gogland (File->New->Project, ) will popup the project creation window. Enter your newly created Go home folder (/Users/jmedved/Documents/Git/go-home/ in our example) as the location and accept the default value for the SDK. Click Create, and you should now be able to browse the Agent source code in Gogland.

  • Start the Development Environment container with the -v option, mounting the Go home folder in the container. With our example, and assuming that we want to mount our Go home folder into the root/go-home folder, type:

   sudo docker run -v ~/go/src/github.com/ligato/vpp-agent/:/root/go/src/github.com/ligato/vpp-agent/ -it --name vpp_agent --rm dev_vpp_agent bash

The above command will put you into the Development Environment container console.

In the container console:

  • Setup the GOPATH and PATH variables in the Development Environment container:
   export GOPATH=/root/go
   export PATH=/$GOPATH/bin:$PATH
  • Change directory into the vpp-agent folder and build & install the Agent:
   cd /root/go-home/src/github.com/ligato/vpp-agent
   make
   make install