Steps:
- Clone an existing configuration as a base.
- Customize it.
- Create two different overlays (staging and production) from the customized base.
- Run kustomize and kubectl to deploy staging and production.
First define a place to work:
DEMO_HOME=$(mktemp -d)
Alternatively, use
DEMO_HOME=~/hello
Let's run the hello service.
To use overlays to create variants, we must first establish a common base.
To keep this document shorter, the base resources are off in a supplemental data directory rather than declared here as HERE documents. Download them:
BASE=$DEMO_HOME/base
mkdir -p $BASE
curl -s -o "$BASE/#1.yaml" "https://raw.githubusercontent.com\
/kubernetes-sigs/kustomize\
/master/examples/helloWorld\
/{configMap,deployment,kustomization,service}.yaml"
Look at the directory:
tree $DEMO_HOME
Expect something like:
/tmp/tmp.IyYQQlHaJP └── base ├── configMap.yaml ├── deployment.yaml ├── kustomization.yaml └── service.yaml
One could immediately apply these resources to a cluster:
kubectl apply -k $DEMO_HOME/base
to instantiate the hello service. kubectl
would only recognize the resource files.
The base
directory has a kustomization file:
more $BASE/kustomization.yaml
Optionally, run kustomize
on the base to emit
customized resources to stdout
:
kustomize build $BASE
A first customization step could be to change the app label applied to all resources:
sed -i.bak 's/app: hello/app: my-hello/' \
$BASE/kustomization.yaml
See the effect:
kustomize build $BASE | grep -C 3 app:
Create a staging and production overlay:
- Staging enables a risky feature not enabled in production.
- Production has a higher replica count.
- Web server greetings from these cluster variants will differ from each other.
OVERLAYS=$DEMO_HOME/overlays
mkdir -p $OVERLAYS/staging
mkdir -p $OVERLAYS/production
In the staging
directory, make a kustomization
defining a new name prefix, and some different labels.
cat <<'EOF' >$OVERLAYS/staging/kustomization.yaml
namePrefix: staging-
commonLabels:
variant: staging
org: acmeCorporation
commonAnnotations:
note: Hello, I am staging!
bases:
- ../../base
patchesStrategicMerge:
- map.yaml
EOF
Add a configMap customization to change the server greeting from Good Morning! to Have a pineapple!
Also, enable the risky flag.
cat <<EOF >$OVERLAYS/staging/map.yaml
apiVersion: v1
kind: ConfigMap
metadata:
name: the-map
data:
altGreeting: "Have a pineapple!"
enableRisky: "true"
EOF
In the production directory, make a kustomization with a different name prefix and labels.
cat <<EOF >$OVERLAYS/production/kustomization.yaml
namePrefix: production-
commonLabels:
variant: production
org: acmeCorporation
commonAnnotations:
note: Hello, I am production!
bases:
- ../../base
patchesStrategicMerge:
- deployment.yaml
EOF
Make a production patch that increases the replica count (because production takes more traffic).
cat <<EOF >$OVERLAYS/production/deployment.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
name: the-deployment
spec:
replicas: 10
EOF
DEMO_HOME
now contains:
-
a base directory - a slightly customized clone of the original configuration, and
-
an overlays directory, containing the kustomizations and patches required to create distinct staging and production variants in a cluster.
Review the directory structure and differences:
tree $DEMO_HOME
Expecting something like:
/tmp/tmp.IyYQQlHaJP1 ├── base │ ├── configMap.yaml │ ├── deployment.yaml │ ├── kustomization.yaml │ └── service.yaml └── overlays ├── production │ ├── deployment.yaml │ └── kustomization.yaml └── staging ├── kustomization.yaml └── map.yaml
Compare the output directly to see how staging and production differ:
diff \
<(kustomize build $OVERLAYS/staging) \
<(kustomize build $OVERLAYS/production) |\
more
The first part of the difference output should look something like
< altGreeting: Have a pineapple! < enableRisky: "true" --- > altGreeting: Good Morning! > enableRisky: "false" 8c8 < note: Hello, I am staging! --- > note: Hello, I am production! 11c11 < variant: staging --- > variant: production 13c13 (...truncated)
The individual resource sets are:
kustomize build $OVERLAYS/staging
kustomize build $OVERLAYS/production
To deploy, pipe the above commands to kubectl apply:
kustomize build $OVERLAYS/staging |\ kubectl apply -f -
kustomize build $OVERLAYS/production |\ kubectl apply -f -