WSO2 Con USA 2015 tutorial session on running WSO2 products on Kubernetes and the features of WSO2 App Factory.

1. Revolutionizing WSO2 PaaS
with Kubernetes & App Factory
Imesh Gunaratne
Senior Technical Lead, WSO2
Dmitry Sotnikov
Vice President - Cloud, WSO2

2. Agenda
• An Introduction to Linux Containers
• An Introduction to Docker
• An Introduction to Kubernetes
• Deploying WSO2 products on Kubernetes
• Carbon cluster discovery on Kubernetes
• Monitoring server health
• Artifact distribution
• Propagating software updates
• Load balancing with Nginx
• Demo

3. Agenda
• App Factory and WSO2 App Cloud
• Creating applications and uploading existing apps
• Hosting web applications and API backends
• Using databases in the Cloud
• Coding and debugging applications with Cloud IDE or
desktop tools
• Application lifecycle management
• Custom URLs
• Teamwork and social development
• Issue and task tracking

4. An Introduction to Linux Containers

5. Linux Containers
Linux Container Brief for IEEE WG P2302, Boden Russell

6. Kernel features used by Linux
Containers
● Namespaces
● cgroups
○ Limit, account & Isolate
resource usage (CPU,
memory, disk, etc)
● chroot
○ Isolate access to disk
● AppArmor
● SELinux
● seccomp
- mnt (mount points, filesystems)
- pid (processes)
- net (NICs, routing)
- ipc (inter-process communication)
- uts (hostname)
- user (user ids)
- Secure computing/
application sandboxing
- Security modules for controlling access
to resources based on security policies

7. Linux Container Brief for IEEE WG P2302, Boden Russell
LXC - A Hypervisor for Linux
Containers

8. LXC Components
https://linuxcontainers.org/lxc/introduction
● The liblxc library
● Language bindings for the API:
○ python3, python2
○ lua
○ Go
○ ruby
○ Haskell
● A set of standard tools to control the
containers
● Distribution container templates

9. More Information on LXC
https://linuxcontainers.org

10. An Introduction to Docker

11. Virtual Machines Vs Docker
https://www.docker.com/what-docker

12. Introduction to Docker
● Started as an internal project
within dotCloud
● Initial release in March 2013
● Initially used libvirt, LXC &
systemd-nspawn
● Introduced libcontainer: A
standard interface for Linux
containers
https://en.wikipedia.org/wiki/Docker_(software)

13. Docker Ecosystem
Enterprise Docker, Adrien BLIND, Aurelien GABET, Arnaud MAZIN

14. Dockerfile
FROM debian:7.7
MAINTAINER dev@wso2.org
ENV DEBIAN_FRONTEND noninteractive
ENV JAVA_HOME /opt/jdk1.7.0_80
ADD packages/jdk-7u80-linux-x64.tar.gz /opt
COPY packages/wso2esb-4.8.1.zip /opt/
WORKDIR /opt/
RUN apt-get update && apt-get install -y zip
RUN unzip /opt/wso2esb-4.8.1.zip
EXPOSE 9763 9443
ENTRYPOINT /opt/wso2esb-4.8.1/bin/wso2server.sh

15. Docker Image Structure
https://www.docker.com

16. An Introduction to Kubernetes

17. Why Container Clusters?
• Avoid single point of failure
• Make horizontally scalable
• Have more granular
management for distributed
applications (microservices)
• Self healing systems
http://googlecloudplatform.blogspot.com/2015/01/what-makes-a-container-cluster.html
[image ref] https://www.docker.com/what-docker

18. Kubernetes Architecture
Docker Host 1 Docker Host 2 Docker Host n
Physical Network
Controller Host
KubernetesAPI
Overlay Network (SDN)Scheduler

19. Kubernetes Component
Architecture

20. Kubernetes Pods
● A group of containers which can share
resources and context
● Shared namespaces:
○ PID namespace (processes visible
globally)
○ network namespace (same IP and port
space)
○ IPC namespace (SystemV IPC or POSIX)
○ UTS namespace (share a hostname)
Pod
C1 C2 C3
http://kubernetes.io/v1.0/docs/user-guide/pods.html

21. Kubernetes Labels & Selectors
● Labels are key/value pairs
attached to objects
● Selectors use the label key to
find a collection of objects
matched with the same value
○ L1 -> ClusterID = C1
○ L2 -> ClusterID = C2
Pod 1
http://kubernetes.io/v1.0/docs/user-guide/labels.html
L1
Pod 2
L1
Pod 3
L1
Pod 3
L2
Pod 4
L2

22. Pod
Template
Replicas = n
Kubernetes Replication Controllers
● Provides features for replicating
pods:
○ Auto-healing
○ Scaling
○ Rolling updates
○ Multiple release tracks Pod 1
http://kubernetes.io/v1.0/docs/user-guide/replication-controller.html
Pod 2 Pod n
Replication
Controller

23. Node IP: 172.17.8.102
Port: 9443
Domain Name: service1
IP: 10.2.10.20
Port: 9443
NodePort: 32001
Protocol: TCP
Kubernetes Services
● Nginx based load balancing rules
● Service types:
○ ClusterIP (default)
○ NodePort
○ LoadBalancer
● Service discovery:
○ DNS
○ Environment variables
● Session Affinity
Pod 1
http://kubernetes.io/v1.0/docs/user-guide/services.html
Pod 2 Pod n
Service
L1
L1 L1 L1
Node

24. ● A distributed key value store
● Read and write values with curl
and other HTTP libraries
● Store data in directories, similar
to a file system
● Watch a key or directory for
changes and react to the new
values
https://coreos.com/etcd/
etcd

25. ● A software defined network
● Runs an agent, flanneld, on each
host
● Uses etcd to store the network
configuration, allocated subnets,
and auxiliary data (host ips)
https://github.com/coreos/flannel
flannel

26. Deploying WSO2 products on
Kubernetes

27. Carbon Cluster Discovery on
Kubernetes
Pod 1 Pod 2 Pod n
Service
Server 1 Server 2 Server n
Pod 1
Service
Server 1
Pod 1 Pod 2
Service
Server 1 Server 2
Hazelcast member
initialization
Hazelcast member
initialization
Hazelcast member
initialization
1 2 n

28. WSO2 Carbon Reference Architecture
for Kubernetes
Pod 1 Pod 2
Manager Cluster
Services
Pod 3 Pod 4 Pod n
Worker Cluster
Services
Manager
Replication
Controller
Worker Replication
Controller
Client
Gov
Reg
Conf
Reg
User
Store

29. WSO2 Configurator
A python module written using
Jinja2 template engine for
configuring a product using a set of
key/value pairs.

30. 4
1 2
3
Deployment Workflow
Build Template
Module
Kubernetes
Membership
Scheme
Build Docker
Image
Import DI to
Kubernetes Nodes
Application Artifacts
Template Module
Product Distribution
Docker Image (DI)
Configurator
JDK
Kernel & Security
Patches
Templates
Deploy Kubernetes
Artifacts
Kubernetes Artifacts

31. 3
1 2
Artifact Distribution/Software Updates
Build Docker
Image
Import DI to
Kubernetes Nodes
Application Artifacts
Template Module
Product Distribution
Docker Image (DI)
ConfiguratorJDK Execute Rolling
Update
Replication
Controller

32. Monitoring Kubernetes Cluster Health

33. Monitoring Kubernetes Node/Pod
Health

34. cAdvisor
Monitoring Kubernetes
Cluster/Node/Pod Health
cAdvisor
Node 1
cAdvisor
Heapster
Node 2 Node n
Grafana
InfluxDB

35. Demo: Deploying WSO2 ESB on
Kubernetes

36. WSO2 App Factory & App Cloud

37. WSO2 Platform

38. Application PaaS from WSO2

39. WSO2 Platform Deployment Options

40. Demo Time!
• App Factory and WSO2 App Cloud
• Creating applications and uploading existing apps
• Hosting web applications and API backends
• Using databases in the Cloud
• Coding and debugging applications with Cloud IDE or
desktop tools
• Application lifecycle management
• Custom URLs
• Teamwork and social development
• Issue and task tracking

41. Announcing:
ESB in App Cloud / App Factory

42. Demo Time!
• Create ESB project
• Create Properties
pointing to endpoints
• Move through lifecycle
and observe change in
endpoints invoked

43. Questions

44. Thank You