Software Kept Eating the World
Software is transforming our world at an ever quickening page. In the modern world, realtime information drives decision making in enterprises that were not traditionally considered technology companies. If you recognize software is a competitive advantage, delivering software rapidly and reliably takes the advantage to the next level.
2. 2
Pivotal Confidential–Internal Use Only
Bold Vision: Pivotal is a technology company at the intersection of cloud, Big Data and agile development
Proven Leadership: Paul Maritz, CEO
Exceptional Talent: 1700 employees
Global Customer Validation: +1200 Tier-1 Enterprise Customers
Strategic Backing: $105M investment by GE
Proud member of the EMC Federation of companies
What is Pivotal?
3. 3
Pivotal Confidential–Internal Use Only
SERVICE PROVIDER
ENTERPRISE DATA CENTER
BIG DATA SOLUTIONS
PLATFORM-AS-A-SERVICE
AGILE APPLICATION DEVELOPMENT
ENTERPRISE MOBILITY
SOFTWARE-DEFINED DATA CENTER
INFORMATION INFRASTRUCTURE
CONVERGED INFRASTRUCTURE
PLATFORM
AS A SERVICE
VIRTUAL
WORKSPACE
BUSINESS DATA LAKE
SECURITY
ANALYTICS
SOFTWARE DEFINED
DATA CENTER
Partners
vCloud Hybrid Service
ADVANCED SECURITY
EMC Federation of Companies
4. 4
Pivotal Confidential–Internal Use Only
Where we’re going today…
2 great keynotes:
–“Software Kept Eating the World”
–“Architecting for Continuous Delivery”
4 intensive hands-on training sessions:
–The Developer Experience
–Architecture and Operations
–Enabling Continuous Delivery
–Custom Buildpacks and Data Services
5. 5
Pivotal Confidential–Internal Use Only
Software Kept Eating the World
Why Cloud Foundry Is Different
James Watters
VP, Cloud Foundry
6. 6
Pivotal Confidential–Internal Use Only
Who am I?
•@wattersjames
•VP, Cloud Foundry/Pivotal CF @Pivotal
•Early Cloud Foundry team member
•Formerly of VMware, Sun Microsystems, Level 3
•Transforming Enterprise IT with cloud native technologies then tweeting about it….
7. 7
Pivotal Confidential–Internal Use Only
Software is Changing Industries
$6B valuation
Financial Services
$12B valuation
Travel & Hospitality
$19B valuation
Transportation
$3.2B Acquisition by Google
Home Automation
$28B valuation Entertainment
$32B Evaluation
Automotive
9. 9
Pivotal Confidential–Internal Use Only
Every Company Needs to Build Great Software
Francisco Gonzalez, CEO
“Banks need to take on Amazon and Google or die. The shift to digital requires a complete overhaul of banks technology…it is a matter of survival.”
14. 14
Pivotal Confidential–Internal Use Only
As we head into a time of stronger growth coupled with increased technological change, the message for senior executives is clear: if you aim to maintain control of your corporation and deliver value to shareholders and customers, you must embrace creative destruction rather than wait to become a victim of this unstoppable force.
Richard Foster
‘Creative Destruction Whips through Corporate America’
Alt reading: Clayton Christensen “The Innovator’s Dilemma”
15. 15
Pivotal Confidential–Internal Use Only
You are either building a software business…
Or losing to someone who is.
- @littleidea
22. 22
Pivotal Confidential–Internal Use Only
An interlude on Open Source & Transformation
•In the beginning…
•Open vs Proprietary
•Open Source is the new Open Standard
•Open Source as a Strategic Asset
•Purpose Motive as Competitive Differentiator
24. 24
Pivotal Confidential–Internal Use Only
A Quick Recap - What we’ve learnt so far
•Being Good at Software is Important
•Good Ops and Dev Process is Important too
•Platforms can help
•OSS is where strategic enterprise technologies will come from
•If I’m not good at Software I might be in some trouble
25. 25
Pivotal Confidential–Internal Use Only
If You Prefer More a More Traditional Agenda…
•2 great keynotes:
–“Software Kept Eating the World”
–“Architecting for Continuous Delivery”
•4 hands-on sessions:
–The Cloud Foundry Developer Experience
–Cloud Foundry Architecture and Operations
–Enabling Continuous Delivery with Cloud Foundry
–Cloud Foundry Custom Buildpacks and Data Services
28. 28
Pivotal Confidential–Internal Use Only
Cloud Foundry Foundation: Industry Standard
Platinum $500k / year
Gold $100k / year
Silver
$5-30K / year
DataStax
Fidelity
Mongo
Piston Cloud
CloudCredo
BlueBox
Docker
Stark & Wayne
Anynines
AppDirect
AppDynamics
CloudFlare
29. 29
Pivotal Confidential–Internal Use Only
Cloud Foundry Open Source Dojo
Pair programing with IBM, SAP, Swisscom, Altoros, Cloud Credo: all send developers to San Francisco HQ of Pivotal for intensive 8 week residencies
Work directly on the CF OSS engineering team and innovate together with us
30. 30
Pivotal Confidential–Internal Use Only
Dogfood In a Cloud Hosted Version Since Day One
Pivotal Web Services. Run by the Cloud Foundry Experts.
31. 31
Pivotal Confidential–Internal Use Only
Jonathan Rosenberg
CTO & VP, Collaboration
“PaaS is the operating system for the cloud. As the set of APIs and services for PaaS's grow, the choice of PaaS becomes more crucial as the costs of porting go up. This is one of the benefits of open source PaaS offerings like Cloud Foundry.”
32. 32
Pivotal Confidential–Internal Use Only
Rapid Innovation Requires a New Approach
Dramatically improve developer experience
Agile teams, rapid iteration
Ingest and incubate open source advancements and new data services
Continuous delivery, no planned downtime
Instant scaling of apps and data services
Automation and deployment consistency at every step
DEVELOPERS
OPERATORS
33. 33
Pivotal Confidential–Internal Use Only
Containers Alone Aren’t Enough
Enterprises do not want app development groups each writing their own platforms
Value is unlocked when standard common services are built into each managed container
34. 34
Pivotal Confidential–Internal Use Only
Technology Demo: Cloud Foundry ‘Diego’
Deploy Application files, or Docker images: <20 seconds
Scale 300x: <40 seconds
Recovery from 20% hardware loss: <5 seconds
Requests dropped during recovery: 0
Core scheduling, routing, log aggregation, health management Go code: <45MB!
35. 35
Pivotal Confidential–Internal Use Only
From Data Center to Software Factory Pivotal CF: Containers surrounded with services
Application
Containerization & Cluster Scheduling
Native and Extended Data Services
Automatic App Server
& OS Configuration with Buildpacks
Policy, Identity and Roles Management
App Health Management, Load Balancing,
Rapid Scaling, Availability Zones
IaaS Provisioning, Scaling & Configuration
Application Network Security Groups
Application to Services Binding and Access
Logging as a service,
Application metrics & performance,
Metric based scaling
38. 38
Pivotal Confidential–Internal Use Only
How to Get There With IAAS + PAAS
PAAS DEV
PAAS OPS
IAAS
Better SLAs
Flexibility
Speed
Availability
Faster Time To Market
Mobile + Data Services
Agile and Iterative
Leverage OSS
Continuous Delivery
No Downtime
Instant scaling
Consistency & Automation
40. 40
Pivotal Confidential–Internal Use Only
A Multi-Cloud 3rd Platform: Pivotal CF
Elastic Runtime Agile Microservices
Elastic Hadoop
Jenkins Service (CI)
Google
Redis
PCF Operations Manager (CF-BOSH)
HA MySQL
VMware
EC2
OpenStack
Multi-Cloud Declarative Service Deployment, Operations
Elastic managed runtime service integrated into leading data services; all scaled and managed by CF BOSH
Rabbit MQ
41. 41
Pivotal Confidential–Internal Use Only
4 Levels of High Availability
1.Application Failure = Reboot in new container
2.PaaS Process Failure = Reboot component in new VM
3.Operating System Failure = VM Monitor
4.Rack Failure = Availability Zones
42. 42
Pivotal Confidential–Internal Use Only
A “Simple” Case - Routing
No Single Point of Failure, Enterprise Production Deployment
mod_proxy
1.The platform takes care of all the steps on the left automatically
50 Configuration Touches
1.Register Hostname with DNS
2.Configure F5 Load Balancing Group
3.Configure Apache HTTPd Worker Pool
4.Configure mod_proxy Connector Routing
5.Configure Tomcat Connector Pool
1 Configuration Touch
1
2
4
4
40
1
43. 43
Pivotal Confidential–Internal Use Only
PCF: Operational Benefits
Instant Dynamic Routing
App-centric policy
Streaming Logging Aggregation
ID/team/RBAC/Policy
Four layers of built-in Availability and Health Management
Application Performance Monitoring (APM)
Auto-scaling, Scheduling
45. 45
Pivotal Confidential–Internal Use Only
Screen shot of Dev Console – pointing out simple abstraction
Demo
Focus on Application and Services..
46. 46
Pivotal Confidential–Internal Use Only
10x+ Increase in Speed and Agility
Old World:
App Deployment in Days/Hours
Pivotal CF: App Deployment in Minutes/Seconds
IT configures complex middleware
App deployment waits for 8+ manual steps
Target <my cloud>
Push <my app>
1-Click to Scale
48. 48
Pivotal Confidential–Internal Use Only
▪Deliver OOTB, PCF based Spring Cloud Services to support micro-services style architectures
▪Spring Boot applications will be optimized to bind to these Spring Cloud Services
PCF and Spring IO: End-to-End micro-service platform
Pivotal Cloud Foundry
Spring Cloud Services
Spring Workload
Spring Workload
Spring Workload
Spring Workload
PCF Services
52. 52
Pivotal Confidential–Internal Use Only
PaaS is Crucial for Mobile
Mobile has resulted in exponential workload increases and highly dynamic loads
User expectation is no downtime for upgrades / maintenance
Mobile device / OS speed iteration is faster than ever before
Client / Server OS
5 year cycle
Mainframe OS
10+ year cycle
Mobile OS
1 year cycle
53. 53
Pivotal Confidential–Internal Use Only
Pivotal CF Mobile Services Deliver for Enterprises
Enterprise Backend Applications
Pivotal CF Mobile Services
Push Notifications
API Gateway
Data Sync
Pivotal CF Elastic Runtime
Pivotal CF Ops Manager
Mobile backend services for enterprises to match the best consumer app experiences
Choice of Infrastructure:
Built on Pivotal CF for simplified deployment and operation in private cloud
Enables businesses to apply the power of Pivotal’s Big Data Suite to mobile solutions
54. 54
Pivotal Confidential–Internal Use Only
PCF 2014 -15 R&D Focus
Enterprise Adoption
1.Robust multi-cloud operations manager
2.Commercial .NET support
3.Advanced networking, auth, audit, and security features
4.More production grade add-on services (mobile, MySQL, RMQ, Redis, Gemfire)
5.Application management tooling: APM/API/Metrics
Advanced Technology
1.Industry leading Docker orchestration and integration with BOSH/Diego
2.Spring/Microservices integration
3.Big Data ecosystem on CF
4.Pivotal Web Services
5.Local (laptop) developer experience and component proliferation (Diego)
Web and mobile application software competition is growing exponentially across industries
Companies need to build and deliver software at unprecedented pace
But…
Enterprise architectures were designed for slower moving systems
We are trying to help *traditional* companies and industries innovate faster with software
Because Apps are the new front office, Internet of things placing emphasis on new development etc.
In the beginning people used to say that open source couldn’t innovate. That it was only good for commoditizing existing capabilities. That it was a race to the bottom which would destroy industry value.
Bullshit.
We never believed that. Still don’t. Open source is the best way to innovate because of the short feedback cycles it can create that we talked about previously. In the last few weeks, we’ve seen a subset of the vendors in the Hadoop space, which is itself just a part of the over 140 projects at the Apache Software Foundation, achieve a combined market valuation of $3Bn (Cloudera = $2Bn, HW = $1Bn). That’s a whole lot of industry value being created through open source. What happened?
First open source became a means of overcoming proprietary lock-in,. Then it replaced standards at the leading edge of industry adoption, fueled by a rate of innovation that standards could never keep up with. Then it became a strategic asset and an integral part of corporate strategy.
WHAT
Pivotal CF is next generation middleware that delivers 9 things that are typically delivered via point software products.
We provision operating systems and middleware.
We deliver workload density without compromising application performance.
We ensure that applications have appropriate network security safe guards to prevent security threats.
We support application connections to external sources including databases and legacy middleware.
We provide 4 levels of HA, with built in load balancing for scale in/out
We support multi-tenant environments so that each line of business can operate with a discrete quota and isolated system access.
We provision next generation data services including NOSQL databases, traditional databases and hadoop clusters.
We provide horizontal and vertical scaling for the underlying IaaS so that you can scale your infrastructure in lock step with your Business.
We provide a built-in log aggregation service, built-in APM metrics and utilization based auto-scaling so that you can monitor the health of your applications and scale out without human or 3rd party tool intervention.
I am going to cover each of these 9 capabilities in more detail, but it’s important to note the impact of this collection of capabilities. The following slides will include information on CAPEX and OPEX reduction. We will also discuss how you can deliver faster time to value while holding the line on infrastructure cost.
WHY
With a simple, modest, production, web application you are dealing with 5 components and each has at least one distinct configuration file. In this example, there are 50 configuration touches for a new web application release. Why on earth does it need to be this way? A new web application release that involves load balancing should involve a single configuration touch.
Application performance and reliability have a direct correlation to HA capability. Pivotal provides 4 level of HA so that you don’t need to invest in people/software to handle common failure situations. If an application fails, we will reboot it in a new container. This automated remediation addresses application bugs that result in outages. If a Pivotal process fails, we will reboot it in a new virtual machine. Our PaaS essentially monitors and remediates itself. If an OS or network failure occurs, our VM monitor will detect this and kill the VM, then reboot it in a new container. This streamlines Linux sysadmin operations. Lastly, if a datacenter rack fails, we will ensure the application stays running because we load application instances in multiple availability zones. No 2 availability zones live on the same datacenter rack. This hardware failure level resilience is very difficult to design using traditional tools provided by HP/CA/IBM.
And, by using Pivotal, you reduce the number of servers that require HP/CA/IBM monitoring tools.
Having the OS/Middleware/Application all managed via a single platform is great, but by including dynamic, no single point of failure load balancer we make it easy to:
1. Ensure application requests are routed to healthy application instances. This enhances the user experience with no operational overhead.
2. Provide an elegant way to upgrade applications using a common Blue/Green deployment pattern. This allows development teams to deploy releases on tighter intervals. The business shouldn’t wait 6 months for new features.
3. When an application is wildly successful, it’s easy to add capacity. And, if an application tends to be spikey, we can scale down/up on demand.
The key to 1-3 is a redundant, reliable router that replaces traditional software load balancers like Apache Web Server. It also reduces the need for hardware load balancers like F5 and Cisco.
Network security is a legitimate concern and Pivotal does several things to make sure that your applications have the right level of access to the network. First, each application instance lives inside of a linux control group and it only has visibility to file system and network connections for that application instance. 2 different application instances are not aware of each others filesystem or network usage.
Second, we use IP table rules to firewall application instances from each other. This is the same concept that Amazon Web Services uses to maintain tenancy and it’s been a Linux best practice for over a decade. There are times when 2 applications should be allowed to share a network connection, but that is only allowed with a system administrator override.
Pivotal reduces the need to purchase physical switches from Cisco. We provide similar benefits to VMware NSX, without forcing the customer to adopt a specific IaaS. Our technology works on top of VMWare, VCHS, OpenStack and public IaaS like Amazon.
Every application uses some sort of database or integration platform. Pivotal promotes the idea that these systems do not need to be managed by our software. You can connect any application to any traditional database or data warehouse system. You can connect to any message broker technology and we support connectivity to any NOSQL data platform.
It is very important to make sure that every OS and Middleware instance matches the gold image. Each application deploy is guaranteed to use a gold image for all software including the OS, platform services including VM monitors, and middleware. We provide a dedicated IT Operator web dashboard with authentication/authorization. We also provide a developer/tester web console that can be used view application health, scale applications and manage load balancer settings. Pivotal provides multi-tenancy at the line of business level so that each organization has self service access without visibility outside of the organization.
In traditional environments expensive tools provided by CA, HP and BMC try to provide similar capabilities. And, the operational overhead of these tools is high because there is no out of the box self service capability. Most companies try to build their own PaaS by bolting Remedy on top of legacy tools. Not only is this complex and brittle, it doesn’t deliver the instant self service experience that you get when using public cloud platforms like Amazon, Google and Heroku.
We deliver an exceptional self service user experience without forcing you to the public cloud. We allow you to choose to be compliant on-premise or off-premise.
We are not a traditional database as a service provider. But, we do provide out of the box support for highly available MySQL. We provide unique mobile data sync technology that allows you to build best of breed mobile applications. We provision MongoDB for document datastore usage. We provision Redis key/value caches, hadoop big data clusters and we even provide an S3 interface object store. We also provide advanced SQL services on top of Hadoop for real-time transactions and analytic use cases. It is also possible to extend our data service architecture to support existing data platforms. MPP Databases and In-Memory Data Grids are good candidates for automation.
If you take the religious aspect of databases out of the mix, you can drastically reduce cost by reducing use of Oracle RAC, DB2 and SQL Server. You can replace Coherence and Terracotta with key/value caching. And, you can build mobile applications without the added cost of Kony, Feedhenry and Urban Airship.
Application performance monitoring is built into the platform. Pivotal aggregates and streams all system logs, including the load balancer, application, middleware, and operating system. We also log and aggregate application deployment and scale events. You can combine Pivotal with Splunk or use a lower cost log event correlation system because we handle aggregation of multiple log sources. When it comes to application metrics, we provide a multitude of IT operator data points, including routing counters and VM CPU/RAM health statistics. Each line of business can turn on auto-scaling that will increase/decrease the application instances when average CPU utilization goes up/down.
Lastly, Pivotal recognizes that some vendors can add monitor capabilities above/beyond what we provide. We strongly caution you against using “legacy” platforms like CA and HP, but App Dynamics and New Relic are PaaS aware and work out of the box with Pivotal CF.
There are many ways to provision a VM, but we are the only vendor that can provision a VM Resource Pool to fully functional PaaS in minutes. We are the only vendor that supports Public cloud providers like Amazon, Private IaaS vendors including VMware and Openstack and VMware’s VCHS hybrid cloud offering.
We provide an IT Operator dashboard that supports horizontal and vertical scaling. You can increase the number of VMs to add redundancy and scale. You can create larger VM instances that can host more application instances or handle more application connections per VM. We are the only platform that can upgrade itself without zero downtime. And, we give the Line Of Business power over how/when to scale application instances.
WHY
Remember the good old days when you had a separate chunk of plastic to take live video, make phone calls, listen to music, snap a picture with friends, get instant messages from co-workers, check the time and use that new fangled world wide web? Can you imagine swapping your smart phone for 8 pieces of gear that barely fit into a duffle bag?
We are on the cusp of a similar transition in the datacenter. You shouldn’t need to work with different vendors when running applications. You shouldn’t need a separate vendor for your operating system, middleware, load balancer, system provisioning and policy management.
Why would you use these devices in a world where a single platform displaces a myriad of unnecessary and expensive products.