Productivity Engineering: Surviving DevOps

ProductivityEngineeringSurviving DevOps
Mike McGarr
@SonOfGarr
© J. Michael McGarr, 2018

17 years ago...

Agile

developers
+
the business

Scrum
TDD
Continuous integration

9 years ago...

DevOps

cloud
microservices
Deming/lean
continuous delivery
web scale
containers
nosql
telemetry

Engineers
in a DevOps world

Engineers
in a DevOps world
Full Stack Engineers?

are we are asking too much?

There are known knowns. These are things we
know that we know. There are known unknowns.
That is to say, there are things that we know we
don't know. But there are also unknown
unknowns. There are things we don't know we
don't know.

· write code

· write code
· write tests

· write code
· write tests
· manage dependencies

· write code
· write tests
· create deployment pipelines

· write code
· write tests
· create metrics, alerts and graphs

· write code
· write tests
· performance tuning

· write code
· write tests
· participate in chaos monkey

· write code
· write tests
· design a canary

· write code
· write tests
· design a canary
· wear a pager

· rotate your logs

· rotate your logs
· pump logs through the data pipeline

· rotate your logs
· ensure your service clients have sane fallbacks

· rotate your logs
· semantic version your libraries

· rotate your logs
· define A/B tests

· rotate your logs
· define A/B tests
· manage dynamic properties globally

· rotate your logs
· define A/B tests
· determine which instance type you need

· rotate your logs
· define A/B tests
· security groups, IAM roles!

· rotate your logs
· define A/B tests
· security groups, IAM roles!
· encrypt your secrets

I could keep going...

deliver business value

complexity
scale
availability
velocity

ProductivityEngineering

Productivity Engineering aims to reduce
cognitive load so that engineers can devote the
majority of their attention to delivering business
value.

Reducingcognitiveload

centralized enablement
platforms
developer experience

centralizedenablement

Who is going to make engineering's life easier?

individuals

centralizedteams

organizational commitment

· Developer Productivity (VCS, build, artifacts)

· Delivery Engineering (cloud delivery)

· Runtime Engineering (service RPC and discovery)

· OS Engineering (base AMI)

· CORE Reliability (availability)

· Chaos Engineering (service resiliency)

· Traﬀic Engineering (regional failovers)

· Cloud Security (security)

· Cloud Security (security)
· Insight Engineering (telemetry)

centralized teams enable product teams

middle 80%

freedomandresponsibility

those with the responsibility,
should have the freedom

platforms

tools

build automation tooling
deployment tooling
RPC tooling
service discovery tooling
telemetry tooling
persistence tooling
security tooling

PavedRoad

abstractions

$ newt package // Java projects
$ newt package // node.js projects
$ newt package // Python projects
$ newt package // Ruby projects

extensibility

app-types© J. Michael McGarr, 2018

· internal tool, built like a
commercial product

commercial product
· heavy focus paid to design
and user experience

commercial product
and user experience
· focus on API's as well as UI

commercial product
and user experience
· Extensibility built it

commercial product
and user experience
· Extensibility built it
· Abstraction of focused, niche
platforms

product management

empathy for users

developerexperience

everybody is a developer

beyond building a better IDE

whatistheworkengineersdo
thatcanbeoffloaded?

developerexperience
· tooling/api proliferation

let 1000 flowers bloom

Is there a tool that does ____________?

stop building tools?

centers of gravity

developerexperience
· organization-wide integration

sharingcode

Publishers
Consumers

Publishers

Publishers
· Who is consuming my library?

Publishers
· Who is using this API in my library?

Publishers
· Who is using this API in my library?
· Who will I break if I change this API?

Consumers

Consumers
· Is there code available that solves problem X?

Consumers
· Which version of this library is safe?

Consumers
· Why did I get this particular version?

Consumers
· Why did I get this particular version?
· How o!en should I get the latest version?

Sowebuilt...

Sowebuilt...
1. A tool to determine ownership of a git repo

Sowebuilt...
2. A tool to understand the dependency graph

Sowebuilt...
3. A tool to lock resolved dependencies

Sowebuilt...
3. A tool to lock resolved dependencies
4. A tool to build all downstream consumers

rebuilding it all into a platform!

developerexperience
· organization-wide integration
· change engineering

move the company from state A to B

· upgrade from Java 6 to Java 7

· migrate from CentOS to Ubuntu

· migrate from Perforce to Git

reduce the cost of change

changecampaigns

distributedrefactoring

1. find all git repos

2. convert all code to AST

3. find the variety of calls to logging library

4. transform all code to call new logging library

5. issue pull requests to all git repos

5. issue pull requests to all git repos
6. automate testing for every pull request

ProductivityEngineering
centralized enablement
platforms
developer experience

QuestionsMike McGarr
@SonOfGarr

Productivity Engineering: Surviving DevOps

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

Similaire à Productivity Engineering: Surviving DevOps

Similaire à Productivity Engineering: Surviving DevOps (20)

Plus de Mike McGarr

Plus de Mike McGarr (15)

Dernier

Dernier (20)

Productivity Engineering: Surviving DevOps