Contenu connexe Similaire à Software as Craft (20) Plus de Nicole Forsgren (10) Software as Craft1. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.1 @nicolefvhttp://devops-research.com © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.@nicolefv
Software as Craft
Nicole Forsgren, PhD
DevOps Research and Assessment (DORA)
2. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.2 @nicolefv
IT (Technology)
is a Cost Center
3. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.3 @nicolefv
4. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.4 @nicolefv
“IT doesn’t matter.”
-- Nicholas Carr, 2003
5. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.5 @nicolefv
6. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.6 @nicolefv
“IT doesn’t matter.”
-- Nicholas Carr, 2003
7. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.7 @nicolefv
Technology DOES matter
8. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.8 @nicolefv
Key Findings 2018 ASODR - Elite Performers
9. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.9 @nicolefv
Key Findings 2018 ASODR - Year over Year
10. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.10 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Elite Performers
Proportion of high performers has
grown YoY, but the bar for
excellence remains high
Highest (elite) performers are still able
to optimize for throughput and
stability
11. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.11 @nicolefv
New 2018 Performance Benchmarks
12. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.12 @nicolefv
13. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.13 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Adding Availability
Ability for teams to ensure their
product or service can be accessed
by end users
Software delivery +
operational performance is
SDO performance
Elite performers are
3.5X more likely to have strong
availability practices
14. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.14 @nicolefv
Some teams still struggle
Why?
15. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.15 @nicolefv
The key to performance is
EXECUTION
16. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.16 @nicolefv
17. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.17 @nicolefv
You’re doing it wrong.
There is no
”DevOps in a box”
18. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.18 @nicolefv
the CLOUD
19. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.19 @nicolefv
the CLOUD
20. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.20 @nicolefv
● Hands up! Working in the cloud
the CLOUD
21. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.21 @nicolefv
● Hands up! Working in the cloud
● Keep them up: On-demand self-service. NO TICKETS
the CLOUD
22. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.22 @nicolefv
● Hands up! Working in the cloud
● Keep them up: On-demand self-service. NO TICKETS
● Keep them up: Broad network access: ALL THE DEVICES
the CLOUD
23. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.23 @nicolefv
● Hands up! Working in the cloud
● Keep them up: On-demand self-service. NO TICKETS
● Keep them up: Broad network access: ALL THE DEVICES
● Keep them up: Resource pooling: RESOURCES DYNAMICALLY ASSIGNED
the CLOUD
24. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.24 @nicolefv
● Hands up! Working in the cloud
● Keep them up: On-demand self-service. NO TICKETS
● Keep them up: Broad network access: ALL THE DEVICES
● Keep them up: Resource pooling: RESOURCES DYNAMICALLY ASSIGNED
● Keep them up: Rapid elasticity: BURSTING LIKE MAGIC
the CLOUD
25. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.25 @nicolefv
● Hands up! Working in the cloud
● Keep them up: On-demand self-service. NO TICKETS
● Keep them up: Broad network access: ALL THE DEVICES
● Keep them up: Resource pooling: RESOURCES DYNAMICALLY ASSIGNED
● Keep them up: Rapid elasticity: BURSTING LIKE MAGIC
● Keep them up: Measured service: AUTO RESOURCE OPTIMIZATION
the CLOUD
26. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.26 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Doing Cloud Right
It's not just about adopting cloud, it’s
using cloud in essential ways that
matters.
Only 22% of teams are doing cloud
right
Teams that use these essentials
characteristics are 23X more likely
to be elite performers
AGREED OR STRONGLY AGREED
On-demand self-service
Broad network access
Resource Pooling
Rapid elasticity
Measured service
27. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.27 @nicolefv
Architecture matters
Technology stack doesn’t
28. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.28 @nicolefv
Technology stack doesn’t matter
● Low performers are more likely to:
○ be working with outsourced software
○ be working on a mainframe system
BUT
● Working on a mainframe system was not correlated
with performance.
● Working on greenfield or brownfield (or any other
system) was not correlated with performance, either.
29. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.29 @nicolefv
Architectural outcomes matter
Can my team
○ Change the design of its system
○ Test the system
○ Deploy the system
... without communication and coordination
with people outside the team?
30. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.30 @nicolefv
Conway’s Law
“organizations which design systems …
are constrained to produce designs
which are copies of the communication
structures of these organizations”
31. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.31 @nicolefv
More execution
DOs and DON’Ts
32. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.32 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
DO: Open Source Software
The data shows that using open
source software is correlated with
high SDO performance
Teams that use open source
software are 1.75X more likely to be
elite performers
Those same teams are also
1.5X more likely to expand their
open source usage in future
33. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.33 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
DON’T: Go Slow
Misguided Performers
Some teams optimize for caution:
low deploy frequency, high lead
times, and low deployment failure
That same group also reports the
longest times to restore service
for outages (1-6 months!)
Large-batch changes add
complexity & no one thinks it will
happen to them, but 5% of teams
suffer the consequences
34. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.34 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
DON’T: Outsourcing
Low performing teams are
3.9X more likely to use
functional outsourcing than
elite teams
Elite teams rarely adopt
functional outsourcing
Misguided performers have the
highest use of outsourcing
of all groups
35. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.35 @nicolefv
Some new technical
practices from 2018
36. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.36 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Include the Database
Integrating database practices look
much like integrating ops work in
early days: communication, config
management, including teams,
visibility
Teams could think about this like
“shifting left”
Database change management is
important for ALL teams
37. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.37 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Evolve Testing
Automated testing played a role in
prior years’ research. We
investigated if the evolving role of
testing in continuous delivery
contributes.
Continuous testing extends
automated testing practices and
positively contributes to SDO
performance
38. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.38 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Evolve Testing
Continuous testing:
• Fast, reliable test suites
• Created & maintained by devs
• Data easily available for tests
• Continuously improving test suites
• Testers + developers = <3
• Manual test throughout
(exploratory, usability, acceptance)
• Have devs practice TDD
• Be able to get feedback from test
suites in 10 min or less
39. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.39 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Looking Into Our Systems
Teams with a comprehensive
monitoring and observability
solution were 1.3 times more likely
to be an elite performer.
Having a monitoring and
observability solution positively
contributed to SDO performance.
Fun stats fact: monitoring and
observability load together.
40. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.40 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Security
Shifting left on security remains
important. 87% of respondents
were subject to regulatory
compliance.
Low performers take weeks to
conduct security reviews and
complete the changes; elite
performers take days to do the
same.
41. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.41 @nicolefv
Deeper Analysis
42. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.42 @nicolefv
Some Surprises
43. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.43 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Industry Doesn’t Matter
Industry does not matter for
achieving high performance for
software delivery
High performers exist in both non-
regulated and
highly regulated industries alike
Any team in any industry has the
potential to achieve a high degree of
SDO performance
44. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.44 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Change Approvals…
Change Approval Boards (CABs)
don’t work for improving
performance or even stability. They
do help to notify others about
changes
The best bet for approvals?
• Peer review
• Lightweight (peer) change
approvals
• NO change approval process
45. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.45 @nicolefv
Security
Who is responsible for security?
46. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.46 @nicolefv
The J-Curve of Transformation
Teams begin
transformation
and identify
quick wins
Automation helps low
performers progress to
medium performers
Automation increases test
requirements, which are dealt
with manually. A mountain of
technical debt blocks progress.
Technical debt and increased
complexity cause additional manual
controls and layers of process around
changes, slowing work
Relentless improvement
work leads to excellence
and high performance!
High and elite
performers leverage
expertise and learn from
their environments to
see jumps in productivity
47. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.47 @nicolefv
We can make work better
48. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.48 @nicolefv
49. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.49 @nicolefv
Smart investments in tech and
practices make our work better
● The work?
○ Less deployment pain
○ Less burnout
○ Higher employee Net Promoter Score
50. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.50 @nicolefv
Microsoft Engineering
Thiago Almeida -- DevOps Days London, 2016
Work/Life
Scores
Before CD: 38%
After CD: 75%
https://vimeo.com/165184757
51. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.51 @nicolefv
Employees in high performing
organizations are 2.2 times
more likely to recommend
their organization as a
great place to work
52. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.52 @nicolefv
Westrum Organizational Culture
53. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.53 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Improving Culture
Giving teams autonomy
improves voice and trust
Voice and trust improve
Westrum organizational
culture, which drives SDO
and organizational
performance
54. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.54 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Improving Culture
Retrospectives that drive
learning & improvement
contribute to a climate for
learning and a better
culture.
A strong climate for
learning is key in times of
changing tech, market
conditions, and customer
demands.
55. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.55 @nicolefv
TL;DR
● Execution is key
● Technology matters
● Architecture > technology
● Cloud works*
● Do’s (OSS) and Don’ts (Outsourcing)
● We can make work & our culture better
56. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.56 @nicolefvhttp://devops-research.com © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.http://devops-research.com
Download the full
report
https://cloudplatformonline.com/2018-state-of-devops.html
57. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.57 @nicolefvhttp://devops-research.com © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.http://devops-research.com
Questions?
https://cloudplatformonline.com/2018-state-of-devops.html
58. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.58 @nicolefv
Boneyard
59. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.59 @nicolefv
Ways to Improve SDO Performance
● Adopting essential cloud characteristics is key to truly realizing benefits
● Organizations need to make smart investments in technology, lean
practices and culture -- holistic transformation is important
● The data on functional outsourcing is in, and it’s decisive: this is not a
winning bet
● Optimize for throughput, stability, and availability
60. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.60 @nicolefv
Report Authors
The DORA Cofounders
Dr. Nicole Forsgren: PhD, sysadmin, scientist, author of Accelerate, named top 10 influencer in DevOps
Jez Humble: Author of Accelerate, Continuous Delivery, Lean Enterprise, and The DevOps Handbook
Gene Kim: Founder of Tripwire Inc, author of Accelerate, The Phoenix Project, DevOps Handbook, & more
Many thanks to George Miranda and Xavier Velasquez for their contributions to the report. Cheryl Coupe was our
copyeditor and Siobhan Doyle did design. We also thank those who assisted with research advice and guidance.
61. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.61 @nicolefv
Gold Sponsors
Diamond Sponsor
62. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.62 @nicolefv
● Largest and longest-running research of its kind
● 5 years of rigorous research, surveying 30,000+ professionals worldwide
● Investigates practices that lead to higher software delivery performance
● Higher software delivery performance = powerful business outcomes
● Only report to include performance benchmarks with cluster analysis
● Predictive analysis to identify specific improvement strategies
The Accelerate: State of DevOps Report
63. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.63 @nicolefv
Introductions - Your host
Dr. Nicole Forsgren
Lead investigator, PhD
CEO and Chief Scientist, DORA
Diet Coke lover*
* Nicole wrote this slide
64. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.64 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Software Delivery and
Operational performance
(SDO performance)
2018 - Key Themes
SDO performance is the driver that
unlocks competitive advantages for IT
organizations.
SDO performance is the practice
behind not just creating, but also
operating, software in ways that
generate powerful business outcomes.
65. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.65 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Identify the key
Technical Practices
that drive SDO performance
2018 - Key Themes
The Accelerate: State of DevOps
Report confirms findings from previous
years.
New for 2018, key technical practices
include:
● Monitoring and observability
● Continuous testing
● Database change management
● "Shifting left" on security
66. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.66 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Identify the key
Cultural Practices
that drive SDO performance
2018 - Key Themes
The Accelerate: State of DevOps
Report confirms the Westrum cultural
model from previous years.
New for 2018! How to influence
culture through organizational work:
● Influencing culture through
autonomy & trust
● Creating a culture of learning
(retrospectives)
Notes de l'éditeur Our story begins with Harvard Business Review.
BUT WHAT IS HARVARD BUSINESS REVIEW?
HBR is a magazine that managers and executives read that presents research in an short, easy-to-read format.
This is where management gets all of their ideas from. In the year of our lord 2003, Nicholar Carr wrote an article TITLED
Who is Nicholas Carr? He is a Pulitzer Prize nominated writer. So his ideas count even more! That whole “IT doesn’t matter” thing? Nicholas Carr had a point.
He was making his case based on the way companies were doing tech in the 80s and 90s.
… Well, this idea can die in a fire.
IT, and technology, DOES matter.
But we need more than stories and intuition to tell us that. We need data. We need proof to tell management so that we can get our work and our initiatives funded. That whole “IT doesn’t matter” thing? Nicholas Carr had a point.
He was making his case based on the way companies were doing tech in the 80s and 90s.
…