The document discusses measuring software development team performance through metrics like efficiency, effectiveness, employee sentiment, and relative performance compared to other teams. It suggests collecting a variety of data points over multiple stages to get a more holistic view of how fast a team is going, including efficiency metrics like lead time and throughput, effectiveness metrics like customer retention and value delivered, employee sentiment surveys, and finding ways to compare performance to other teams either internally through rotations or externally through collaborations. The goal is to understand if a team is truly fast, above average, or awesome and identify opportunities to accelerate their speed further.
2. 2
At
We are starting to try to collect
the data to find out, and to get
relativity we need others to join
us!
Douglas Talbot
Douglas.Talbot@Ocado.com
@douglastalbot
Head of Organisational Effectiveness
Thought provoker and Catalyst
7. 7
The goal estimate is
‘‘the most optimistic prediction that has a
non-zero probability of coming true’’
- Tom DeMarco 1982
8. 8
Focal Bias
Anchoring and Adjustment problems
Motivation
Perceived power
Social cues
Temporal perspective
Unpacking
Deliberation
etc etc etc
The team scaling fallacy
The Planning Fallacy
9. 9
Dunning – Kruger effect
Unrealistic optimism
Over estimating desirable effects
Over confidence in judgement
Information deficits
Ill defined nature of competence
Information neglect
Focus on the self
Influenced by external cues
Self Perception Fallacy
30. 30
We can compare ourselves to our last
attempt
- How much did we do?
- Has our quality got better?
- How fast can we deliver change?
31. 31
We have an Efficiency measure
Do you think this team is going fast?:
Lead time: 103 days
Cycle time: 81 days
Efficiency: 49.5 / 81 = 61%
Throughput: 6 Small features
3 Medium features
1 Large feature / 81 days
32. 32
We can probably even answer
more esoteric questions -
How predictable is that?
Can we better use our people?
33. 33
Efficiency measurement
There have been studies considering this in far more detail
looking at best methods for:
TCO - Total Cost of Ownership, CoQ - Cost of quality, Speed1
Factors of success, Factors of value, Project failure rates2
1.InfoQ - Evaluating agile software methodologies
2.http://www.standishgroup.com/Reports2015
43. 43
Effectiveness
- Was it worth it (ROI)?
- Creativity
- Innovation
- On time
- On budget
- Impressive brand win
- Lower costs to recruit
44. 44
What should we be measuring about
ourselves as a team to be the best we
can be for our businesses and create
trust/belief in our integrity and skills?
46. 46
Effectiveness
Do you think this team is going fast?:
Value: + £231,000 sales volume,
+2% customer retention
+1% customer acquisition on
previous rate in the last 30 days
52. 52
Fast
team?
Sentiment No. of answers
Overall 0.588 100
Department 1 0.928 2
Department 2 0.785 16
Department 3 0.727 20
Department 4 0.680 10
Department 5 0.591 1
Department 6 0.544 17
Department 7 0.538 15
Department 8 0.516 5
Department 9 0.246 3
Department
10
0.234 1
Department
11
0.124 10
Ocado Technology Adjusted data for example
53. 53
Can we know
what this does
to Efficiency
and
Effectiveness?
Sentiment No. of answers
Overall 0.588 100
Department 1 0.928 2
Department 2 0.785 16
Department 3 0.727 20
Department 4 0.680 10
Department 5 0.591 1
Department 6 0.544 17
Department 7 0.538 15
Department 8 0.516 5
Department 9 0.246 3
Department
10
0.234 1
Department
11
0.124 10
Ocado Technology Adjusted data for example
58. 58
How would you really know you’re
FAST?
or better than average?
or Awesome?
59. 59
Let’s try
Efficiency - 61% Value add, Throughput
– 3 Medium features / 81 days
Value - £231,000 and 2% new
customers in the last 30 days
We have a sentiment score of 0.8
60. 60
Is that fast, > average, or awesome?
How much faster can we get?
How fast learning are we?
Some questions
61. 61
“If you’re not moving at the speed of
the market you’re already dead …
you just haven’t stopped breathing
yet”
- Jack Welch, CEO GE
Are our devs / teams at
market speed?
68. 68
The how discussion!
Coding competition?1
Trust for Productivity study?2
Team rotation?
Common assessment model? But for teams?
Hopefully brainstorm time
1.Peopleware, Timothy Lister & Tom de Marco
2.Teams in the test tube
69. 69
At
We are starting to try to collect
the data to find out, and to get
relativity we need others to join
us!
Please come and chat!
Make contact if you are interested in this
challenge.
Douglas Talbot
Douglas.Talbot@Ocado.com
@douglastalbot
I’m hiring Catalysts / Coaches!