SlideShare une entreprise Scribd logo
1  sur  71
@OptimiseOrDi
e
• Growth Optimisation, Lean, Agile
• Teams, Culture, Methodology
• Split Testing, Analytics, UX
• 200M+ visitors tested
• 230+ sites, 26 languages
• Is it working right?
• No?
• Sullivac @ gmail.com
@OptimiseOrDiecolinski.tumblr.com
Why Organisations are
the Biggest Conversion
Killer
and How to Fix it!
@OptimiseOrDie
Digital Product Design
is
And we’re all going to die…
@OptimiseOrDie
Designing for Humanity!
@OptimiseOrDie
Designing for Humanity!
@OptimiseOrDie
You had One F***ing Job to Do!
@OptimiseOrDie
bit.ly/OneJobToDo
From 1994 -> To the Future!
@OptimiseOrDie
The Depressing Reality of 2016:
@OptimiseO
Stuff I expected to be HERE:
• Artificial Intelligence instead of Forms
• Instant Customer Service
• Seamless Web and Call Tracking
• Microwave dinners that open properly
• Flying Cars
• Jetpacks
• Free Energy
• Space Tourism
• Learning from past Design Mistakes!
• More Usable Products!
@OptimiseOrDie
Why?
Because We are
F***ing Stupid!
Let me give you a couple of examples…
@OptimiseOrDie
@OptimiseOrDieAnnual Sales in DE/FR/UK/IT/ES = £4.5Bn (2015)
After Millions of Years of Evolution…
@OptimiseOrDie
@OptimiseOrDie
3 minutes later…
Quick Calculation:
• £4.5Bn Sales @ £3.5 average price
• Assume 60% are failures
• Costs 90 seconds of wasted time
• 72514285714 seconds wasted
• 1208571428 minutes
• 20142857 hours
• 839,285 days of life - wasted on friction!
• What about injuries?
@OptimiseOrDie
@OptimiseOrDie
A Completely Solvable Problem!
A Packaging Manifesto:
1. Packaging should never require a sharp implement to
open.
2. Packaging should not require finger control or strength
which discriminates against population groups
3. Any packaging must be capable of being returned to its
original state to preserve any unused contents
@OptimiseOrDie
Why?
“If it comes off in one, it's gonna be
banging! If you’re picking plastic
out of your dinner for ten minutes,
it's probably gonna taste like shit.”
@OptimiseOrDie
Why?
“Because an experience
is only as good as its
shittiest part”
@OptimiseOrDie
@OptimiseOrDie
Edwardian Hygiene
“It was only in the early 1900s that British doctors
realised that the housefly could carry disease on its
bristly legs. Flies were a major transmitter of both
typhoid and summer-sickness, causing thousands of
deaths each year.
After the hot summer of 1911, there was rising
public panic about the high levels of infant mortality
from diarrhoea. Medical officers decided that they
needed to change the way the British public felt
about flies.”
@OptimiseOrDie
bit.ly/OODfly
@OptimiseOrDie
“The creation of disgust
around flies was a
major achievement of
the early 20th Century…
The Death rate from
diarrhoea fell steadily
from 1913…”
bit.ly/OODfly
@OptimiseOrDie
@OptimiseOrDie
“A 2010 Study found
that when swabbed,
28% of London
Commuters had
faecal bacteria on
their hands!”
bit.ly/OODfly
@OptimiseOrDie
Quick Calculation:
• Less than 20% of people in the world wash hands
• Mainly because they don’t have soap and running water
• London is well served for these!
• A huge part of UK ‘Food Poisoning’ is actually faecal bacteria
• This part costs the economy up to £1.5Bn a year
• British travellers get ill on holiday more often than Americans,
Australians or Europeans!
@OptimiseOrDie
@OptimiseOrDie
“The London Handshake”
Why?
Because We are
F***ing Stupid!
@OptimiseOrDie
What can Manufacturing & Retail teach us?
@OptimiseOrDie
Car Manufacturing Timeline
1893 The Daimler Motor Syndicate formed in Britain
1908 The first Model T rolls off the production line
1930s New innovations in body types – bumpers, closed bodies, boots!
1945 Car Manufacturing takes off in Europe
1959 The Mini comes onto the market!
1961 The first Robot used by General Motors
1960s Japan becomes a major force in manufacturing
1973 Oil Crisis Hits, US market stagnates, Toyota, Nissan, BMW thrive!
1980 Japan becomes 1st in worldwide car production
1980s Use of robots prevalent at virtually all manufacturers
@OptimiseOrDie
Car Manufacturing Timeline
1983 Chrysler opens new ‘just in sequence’ assembly line
1990 Japanese carmakers nab 28% of the US market
1991 GM and Ford post record losses whilst Japan booms
1997 Toyota launches the Prius Hybrid car
2005 Four of the 10 largest companies are oil, four are car companies!
2006 Chrysler and GM post huge losses and are rescued
2008 Tesla debuts the Roadster
2010 Toyota, GM, VW and Hyundai the biggest companies
2010 GM sells more cars in China than the USA
2015 First mass market hydrogen car
@OptimiseOrDie
Car Manufacturing Timeline
Toyota Production System (1960s ->)
Lean Manufacturing (1960s ->)
Kanban (1960s ->)
Continuous Improvement (1970s ->)
Six Sigma (1986 ->)
Agile Manufacturing (1990s ->)
@OptimiseOrDie
1. Change Growth TrajectoryWhat are these for?
• Maintain or Improve Quality
• Remove Defects & Waste
• Increase Production Capacity
• Agility, Flexibility, Rapid Delivery
• Continuous and Rapid Change
• Roboticisation & Automation
• Market, Demand, Resource Planning
• Get it very right or death results!
@OptimiseOrDie
What Can Retail Teach Us?
Let’s take some random stuff from online:
• The toilets must be clean
• All the lights must work
• Rails must not be stuffed with clothes
• Disturbed clothing must be tidied
• All tills must be adequately staffed
• Window displays must be changed daily
• All doors and lifts must work
• Floor surfaces must be spotlessly clean
• The air has to smell right!
Thousands of little, tiny and very important details!
@OptimiseOrDie
What Can Retail Teach Us?
Let’s try some online stuff:
• Checkout fails on Chrome browsers
• Contact Us page doesn’t render on iPads
• Mobile payment page fails on PayPal
• Navigation was built by a Sadist
• Search is so poor nobody uses it
• Performance unusable on 3G data
• Errors on checkout are never noticed
• Your basket disappears after 15 minutes
• The password reset takes 45 minutes to arrive
• Nobody changes the homepage for a bloody year!
@OptimiseOrDie
1. Change Growth TrajectoryWindow Displays & Basic Merchandising
@OptimiseOrDie
Arrogance and Basic Standards
• Hiring call with developers
• Candidate told me “People are f***ing stupid if
they use browsers like Internet Explorer”
• I explained using a buggy!
@OptimiseOrDie
The Big Problem
@OptimiseOrDie
The Big Problem
@OptimiseOrDie
• Clothing 1M per month, 2 bugs
• Travel 2M per month, 13 bugs
• Telecoms 1.4M per month, 3 bugs
• Travel 0.6M per month, 5 bugs
• Event Site 2.5M per month, 11 bugs
– These were only the first bugs we found
– < 5 days time to fix – an ROI of 91,150%
– Larger than the annual IT budget for some!
How Much do Bugs Cost?
Browser Checks www.crossbrowsertesting.com
www.browserstack.com
www.spoon.net
www.saucelabs.com
Mobile & Tablet www.appthwack.com
www.deviceanywhere.com
www.opendevicelab.com
Article & Info bit.ly/devicetesting
6: Here is our £84 Million testing rig!
@OptimiseOrDie
Fix Those Bugs!
6: Here is our £84 Million testing rig!
@OptimiseOrDie
We Are All Going to Die!
• Made by PetNet
• “The World’s first Intelligent Pet Feeder”
• Links to your smartphone app
• Schedule feeding times remotely
• Ooops! Server outage!
“We are experiencing difficulties
with one of our third party
servers. You may experience a
loss of scheduled feeds and
failed remote feedings”
WTF! The Pet experiences the loss!
6: Here is our £84 Million testing rig!
@OptimiseOrDie
Holiday Diet Feature!
Before After
6: Here is our £84 Million testing rig!
@OptimiseOrDie
It’s only just starting!
• Cheap devices coming!
• Some very good
• Some designed by idiots
• Most designed by idiots
• Never built a digital product
• Never designed one
• Now we make one
• What’s wrong with that?
• Access to your Wi-Fi network!
6: Here is our £84 Million testing rig!
@OptimiseOrDie
Already Hacked!
• Cars
• Watches
• Lightbulbs
• Home Security
• Phones
• Alarms
• Music Systems
• Baby Monitors
• Video surveillance
• Power & Utility
• Printers
• Kettles
codecurmudgeon.com/wp/iot-hall-shame/
6: Here is our £84 Million testing rig!
@OptimiseOrDie
Already Hacked!
• No ‘Best Practice’ security for design
• No infrastructure for updating or patching product
• Needs unfettered access to Wi-Fi network
• Allows untrusted computers to connect
• No ‘two factor’ authentication
“Samsung Toaster Hack Paralyzes Bay Area”
“Hungarian Mercedes Hack shuts Uber in Budapest”
“Thermostat Worm costs $4Bn and counting”
“Search engine available for Hacked Baby Monitors”
6: Here is our £84 Million testing rig!
@OptimiseOrDie
Read More!
bit.ly/iotdeath
16. Ignorance Example
“As your Circle of
Knowledge grows, as
the diameter
increases, so does the
circumference that’s in
contact with all that
darkness outside the
circle of light.”
The Solution to Stupidity?
“You Need to Get a
Better Quality of
Ignorance!”
@OptimiseOrDie
Rehab for Companies
@OptimiseOrDie
1. What are the signs?
2. Burn Down the Silos
3. Startup Growth Team Models
4. Lean Corporate & Optimisation
5. Product Themes / Decoupling
6. Culture of Failure & Velocity
1. “We have analytics – we just don’t use it (properly)”
2. “We have testing – we just don’t learn anything useful”
3. “We have Customer Insight – we just don’t listen or act upon
what they tell us”
4. “We do ‘Agile’, but we’re not really agile at all”
5. “We have a Growth Hacker, but they work in a silo”
6. “We apply optimisation but don’t change the organisational
structure or management at all”
7. “We have all these tools – but nothing happens”
@OptimiseOrDie
1. Signs you need Rehab
@OptimiseOrDie
• Enough Project Managers and Business Analysts to host your own IT
conference.
• Silos work on product separately
• No ‘One Team’ per product/theme
• Non agile, non iterative design
• Product is ‘passed around’
• Large teams, unwieldy coordination
• Endless meddling and signoff
• AB testing usually crippled too!
2. Burn Down the Silos!
@OptimiseOrDie
3. Independent Team, by Features
Uber
Facebook
bit.ly/GHmodel
@OptimiseOrDie
3. Independent Team, by Metrics
Uber
Facebook
bit.ly/GHmodel
@OptimiseOrDie
3. Integrated Product Teams - Functional
Pinterest
Twitter
Linkedin
Dropbox
BitTorrent
Airbnb
FT
ING
Spotify
bit.ly/GHmodelbit.ly/ingvideo
4. Lean Optimisation and Lean Corporate
@OptimiseOrDie
@OptimiseOrDie
4. FT.COM – Example
• Small teams (6-15) with direct access to publish
• Ability to set and get metrics data directly
• Tools, Autonomy, Lack of interference
• No Project Managers or Business Analysts
• Business defines ‘outcomes’ – teams deliver
• No long signoff chain
• No pesky meddling fools during execution!
@OptimiseOrDie
4. FT.COM – Labs, Beta, Split Testing
• 100s of releases a day!
• MVP approach
• Launch as alpha, beta, pilot,
phased rollout
• This approach includes split
testing to tune, optimize or
decide!
• Like getting in a shower
• Read more at labs.ft.com
@OptimiseOrDie
1. Change Growth Trajectory4. Increased Productivity
• Most product changes we make are a waste of time!
• The Financial Times – 50-70% of product developer time wasted
in a siloed organisational structure
• Minimum project time was “At least 18 months” for anything
• Projects were always late, underperformed, didn’t shift metrics
as expected
• Post changes, every IT project was under time & budget
• Products were iterated to hack their way to success
• xxM per annum additional profit after three years
@OptimiseOrDie
4. FT.COM – Pesky Meddling & Signoff
@OptimiseOrDie
1. Change Growth Trajectory4. A Holistic Approach
“Product changes and AB tests are just the same
thing to us. Where we’re moving to is measuring
and testing everything we do.
This approach tells us what works, what doesn’t,
what to keep, what to remove and what we need
to iterate.”
Financial Times – NextFT project
#1 Analytics / Quantitative
#2 Split Testing
#3 UX / Qualitative
#4 Agile & Lean
#5 Culture & Organisation
The Optimisation Barstool
@OptimiseOrDie
1. Invest more in Analytics
Build your own data layer with tools, people, training, self sufficiency
and continual improvement . Invest MORE!
2. Remove wastage and defects
By building products more efficiently, cheaply, successfully. Remove
experience defects at all stages of the lifecycle.
3. Reform the organisation
Set teams free to find the right outcomes and self optimise
SUMMARY
@OptimiseOrDie
4. AB and MVT Testing
Don’t just test stuff. Winners have a process and methodology around
discovering, prioritising and running their tests
5. Stop Reading Best Practice Bullshit
Their customers, website, data, market are not yours. Stop reading what other
people do and start listening to and measuring your customers!
6. Qual AND Quant
If you are not measuring customer behaviour (and reaction to experiments)
with both, then you’re hosed. Use data and insight to replace Ego, Opinion,
Assumption, Cherished Notion or Bullshit
SUMMARY
• Leicester & Orchestra side
63
Orchestration!
You can still be beaten by people
without your budget, tech or tools!
@OptimiseOrDie
Hacking
efficiency/time/
delight/productivity/fun
Tell your friends good
Lovable Empathetic Delightful
Self actualisation Life changing Rewiring
FUNCTIONAL
ACCESSIBLE
USABLE
USEFUL
PERSUASIVE
COMPELLING
TRANSFORMATIONAL
Device Browser Mobile Audience
Performance Accessibility Platforms
Comprehension Affordance Simplicity Relevance Clarity Context
Utility Tasks Goals Steps Completion Progression
Resonant Authentic Compelling Consistent
Benefits Value Trust
Social Integration and Proof
Habits Nudges Addictions Lifecycle
Promotions Personalisation Brand
Belonging Trusted Emotive
TIME
ROI
Your Dendritic Future
“If we are to survive, we
have to stop wasting
money on things that don’t
work, cause more harm
than good or aren’t actually
needed.”
The Three Horizons of Innovation (bit.ly/3horiz)
@OptimiseOrDie
McDonalds Hipster Test Store
bit.ly/1TiURi7
@OptimiseOrDie
70
Thank You!
Email me sullivac@gmail.com
Slides Will be tweeted!
LinkedIn linkd.in/pvrg14

Contenu connexe

Tendances

Cross Device Optimisation - Google Analytics Shortcuts
Cross Device Optimisation - Google Analytics ShortcutsCross Device Optimisation - Google Analytics Shortcuts
Cross Device Optimisation - Google Analytics ShortcutsCraig Sullivan
 
Myths, Lies and Illusions of AB and Split Testing
Myths, Lies and Illusions of AB and Split TestingMyths, Lies and Illusions of AB and Split Testing
Myths, Lies and Illusions of AB and Split TestingCraig Sullivan
 
#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB tests#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB testsCraig Sullivan
 
Conversion Research in One Hour
Conversion Research in One HourConversion Research in One Hour
Conversion Research in One HourCraig Sullivan
 
Interact London - 21 Oct 2015 - Scaling Stupidity
Interact London - 21 Oct 2015 - Scaling StupidityInteract London - 21 Oct 2015 - Scaling Stupidity
Interact London - 21 Oct 2015 - Scaling StupidityCraig Sullivan
 
Digital Impact 2014 - Oh Boy These AB tests sure look like Bullshit to me
Digital Impact 2014 - Oh Boy These AB tests sure look like Bullshit to meDigital Impact 2014 - Oh Boy These AB tests sure look like Bullshit to me
Digital Impact 2014 - Oh Boy These AB tests sure look like Bullshit to meCraig Sullivan
 
12 Things to do Before Your Company Dies : Conversion Conference London - Oct...
12 Things to do Before Your Company Dies : Conversion Conference London - Oct...12 Things to do Before Your Company Dies : Conversion Conference London - Oct...
12 Things to do Before Your Company Dies : Conversion Conference London - Oct...Craig Sullivan
 
The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014
The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014
The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014Craig Sullivan
 
#Measurecamp : 18 Simple Ways to F*** up Your AB Testing
#Measurecamp : 18 Simple Ways to F*** up Your AB Testing#Measurecamp : 18 Simple Ways to F*** up Your AB Testing
#Measurecamp : 18 Simple Ways to F*** up Your AB TestingCraig Sullivan
 
Onboard like a juggernaut - Elite camp 2015
Onboard like a juggernaut - Elite camp 2015Onboard like a juggernaut - Elite camp 2015
Onboard like a juggernaut - Elite camp 2015Conversionista
 
Mobile presentation - Sydney Online Retailer - 26 Sep 2011
Mobile presentation - Sydney Online Retailer - 26 Sep 2011Mobile presentation - Sydney Online Retailer - 26 Sep 2011
Mobile presentation - Sydney Online Retailer - 26 Sep 2011Craig Sullivan
 
Why do my AB tests suck? measurecamp
Why do my AB tests suck?   measurecampWhy do my AB tests suck?   measurecamp
Why do my AB tests suck? measurecampCraig Sullivan
 
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...Craig Sullivan
 
Craig Sullivan - Oh Boy! These A/B tests look like total bullshit! MKTFEST 2014
Craig Sullivan - Oh Boy! These A/B tests look like total bullshit! MKTFEST 2014Craig Sullivan - Oh Boy! These A/B tests look like total bullshit! MKTFEST 2014
Craig Sullivan - Oh Boy! These A/B tests look like total bullshit! MKTFEST 2014Marketing Festival
 
Why Does My Conversion Rate Suck? Craig Sullivan, Senior Optimisation Consult...
Why Does My Conversion Rate Suck? Craig Sullivan, Senior Optimisation Consult...Why Does My Conversion Rate Suck? Craig Sullivan, Senior Optimisation Consult...
Why Does My Conversion Rate Suck? Craig Sullivan, Senior Optimisation Consult...PRWD
 
eMetrics London - The AB Testing Hype Cycle
eMetrics London - The AB Testing Hype CycleeMetrics London - The AB Testing Hype Cycle
eMetrics London - The AB Testing Hype CycleCraig Sullivan
 
Natural born conversion killers - Conversion Jam
Natural born conversion killers - Conversion JamNatural born conversion killers - Conversion Jam
Natural born conversion killers - Conversion JamCraig Sullivan
 
John lewis lego craig sullivan 1335
John lewis lego craig sullivan  1335John lewis lego craig sullivan  1335
John lewis lego craig sullivan 1335Charlie Lines
 
UXPA UK - Toolkits and Tips for Blending UX, Analytics and CRO
UXPA UK - Toolkits and Tips for Blending UX, Analytics and CROUXPA UK - Toolkits and Tips for Blending UX, Analytics and CRO
UXPA UK - Toolkits and Tips for Blending UX, Analytics and CROCraig Sullivan
 
Talks@Coursera - A/B Testing @ Internet Scale
Talks@Coursera - A/B Testing @ Internet ScaleTalks@Coursera - A/B Testing @ Internet Scale
Talks@Coursera - A/B Testing @ Internet Scalecourseratalks
 

Tendances (20)

Cross Device Optimisation - Google Analytics Shortcuts
Cross Device Optimisation - Google Analytics ShortcutsCross Device Optimisation - Google Analytics Shortcuts
Cross Device Optimisation - Google Analytics Shortcuts
 
Myths, Lies and Illusions of AB and Split Testing
Myths, Lies and Illusions of AB and Split TestingMyths, Lies and Illusions of AB and Split Testing
Myths, Lies and Illusions of AB and Split Testing
 
#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB tests#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB tests
 
Conversion Research in One Hour
Conversion Research in One HourConversion Research in One Hour
Conversion Research in One Hour
 
Interact London - 21 Oct 2015 - Scaling Stupidity
Interact London - 21 Oct 2015 - Scaling StupidityInteract London - 21 Oct 2015 - Scaling Stupidity
Interact London - 21 Oct 2015 - Scaling Stupidity
 
Digital Impact 2014 - Oh Boy These AB tests sure look like Bullshit to me
Digital Impact 2014 - Oh Boy These AB tests sure look like Bullshit to meDigital Impact 2014 - Oh Boy These AB tests sure look like Bullshit to me
Digital Impact 2014 - Oh Boy These AB tests sure look like Bullshit to me
 
12 Things to do Before Your Company Dies : Conversion Conference London - Oct...
12 Things to do Before Your Company Dies : Conversion Conference London - Oct...12 Things to do Before Your Company Dies : Conversion Conference London - Oct...
12 Things to do Before Your Company Dies : Conversion Conference London - Oct...
 
The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014
The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014
The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014
 
#Measurecamp : 18 Simple Ways to F*** up Your AB Testing
#Measurecamp : 18 Simple Ways to F*** up Your AB Testing#Measurecamp : 18 Simple Ways to F*** up Your AB Testing
#Measurecamp : 18 Simple Ways to F*** up Your AB Testing
 
Onboard like a juggernaut - Elite camp 2015
Onboard like a juggernaut - Elite camp 2015Onboard like a juggernaut - Elite camp 2015
Onboard like a juggernaut - Elite camp 2015
 
Mobile presentation - Sydney Online Retailer - 26 Sep 2011
Mobile presentation - Sydney Online Retailer - 26 Sep 2011Mobile presentation - Sydney Online Retailer - 26 Sep 2011
Mobile presentation - Sydney Online Retailer - 26 Sep 2011
 
Why do my AB tests suck? measurecamp
Why do my AB tests suck?   measurecampWhy do my AB tests suck?   measurecamp
Why do my AB tests suck? measurecamp
 
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...
 
Craig Sullivan - Oh Boy! These A/B tests look like total bullshit! MKTFEST 2014
Craig Sullivan - Oh Boy! These A/B tests look like total bullshit! MKTFEST 2014Craig Sullivan - Oh Boy! These A/B tests look like total bullshit! MKTFEST 2014
Craig Sullivan - Oh Boy! These A/B tests look like total bullshit! MKTFEST 2014
 
Why Does My Conversion Rate Suck? Craig Sullivan, Senior Optimisation Consult...
Why Does My Conversion Rate Suck? Craig Sullivan, Senior Optimisation Consult...Why Does My Conversion Rate Suck? Craig Sullivan, Senior Optimisation Consult...
Why Does My Conversion Rate Suck? Craig Sullivan, Senior Optimisation Consult...
 
eMetrics London - The AB Testing Hype Cycle
eMetrics London - The AB Testing Hype CycleeMetrics London - The AB Testing Hype Cycle
eMetrics London - The AB Testing Hype Cycle
 
Natural born conversion killers - Conversion Jam
Natural born conversion killers - Conversion JamNatural born conversion killers - Conversion Jam
Natural born conversion killers - Conversion Jam
 
John lewis lego craig sullivan 1335
John lewis lego craig sullivan  1335John lewis lego craig sullivan  1335
John lewis lego craig sullivan 1335
 
UXPA UK - Toolkits and Tips for Blending UX, Analytics and CRO
UXPA UK - Toolkits and Tips for Blending UX, Analytics and CROUXPA UK - Toolkits and Tips for Blending UX, Analytics and CRO
UXPA UK - Toolkits and Tips for Blending UX, Analytics and CRO
 
Talks@Coursera - A/B Testing @ Internet Scale
Talks@Coursera - A/B Testing @ Internet ScaleTalks@Coursera - A/B Testing @ Internet Scale
Talks@Coursera - A/B Testing @ Internet Scale
 

En vedette

Conversion rate optimisation 101 @ LS Yorkshire Leeds Feb 2014
Conversion rate optimisation 101 @ LS Yorkshire Leeds Feb 2014Conversion rate optimisation 101 @ LS Yorkshire Leeds Feb 2014
Conversion rate optimisation 101 @ LS Yorkshire Leeds Feb 2014Manuel Da Costa
 
Introduction to conversion rate optimization (cro) for ecommerce
Introduction to conversion rate optimization (cro) for ecommerceIntroduction to conversion rate optimization (cro) for ecommerce
Introduction to conversion rate optimization (cro) for ecommerceIn Marketing We Trust
 
Conversion Rate Optimization 101 - Converting Visitors In To Buyers
Conversion Rate Optimization 101 - Converting Visitors In To BuyersConversion Rate Optimization 101 - Converting Visitors In To Buyers
Conversion Rate Optimization 101 - Converting Visitors In To BuyersKothapally Arun
 
Conversion Rate Optimization 101 - Kick-Start Your Growth Engine
Conversion Rate Optimization 101 - Kick-Start Your Growth EngineConversion Rate Optimization 101 - Kick-Start Your Growth Engine
Conversion Rate Optimization 101 - Kick-Start Your Growth EngineKissmetrics on SlideShare
 
Conversion Hotel 2016 - Anna Dahlström
Conversion Hotel 2016 - Anna DahlströmConversion Hotel 2016 - Anna Dahlström
Conversion Hotel 2016 - Anna DahlströmWebanalisten .nl
 
Conversion Hotel 2016 - John Ekman
Conversion Hotel 2016 - John EkmanConversion Hotel 2016 - John Ekman
Conversion Hotel 2016 - John EkmanWebanalisten .nl
 
Conversion Hotel 2016 - Jeffrey Eisenberg
Conversion Hotel 2016 - Jeffrey EisenbergConversion Hotel 2016 - Jeffrey Eisenberg
Conversion Hotel 2016 - Jeffrey EisenbergWebanalisten .nl
 
Nathalie Nahai - 15 psych tips to help you sell more online
Nathalie Nahai - 15 psych tips to help you sell more onlineNathalie Nahai - 15 psych tips to help you sell more online
Nathalie Nahai - 15 psych tips to help you sell more onlineNathalie Nahai
 
Nathalie Nahai - Why aren't women taking the stage in tech?
Nathalie Nahai - Why aren't women taking the stage in tech?Nathalie Nahai - Why aren't women taking the stage in tech?
Nathalie Nahai - Why aren't women taking the stage in tech?Nathalie Nahai
 
Nathalie Nahai - Culture and its influence on websites (part 2)
Nathalie Nahai - Culture and its influence on websites (part 2)Nathalie Nahai - Culture and its influence on websites (part 2)
Nathalie Nahai - Culture and its influence on websites (part 2)Nathalie Nahai
 
Nathalie Nahai - 5 psychological principles of persuasive design
Nathalie Nahai - 5 psychological principles of persuasive designNathalie Nahai - 5 psychological principles of persuasive design
Nathalie Nahai - 5 psychological principles of persuasive designNathalie Nahai
 

En vedette (11)

Conversion rate optimisation 101 @ LS Yorkshire Leeds Feb 2014
Conversion rate optimisation 101 @ LS Yorkshire Leeds Feb 2014Conversion rate optimisation 101 @ LS Yorkshire Leeds Feb 2014
Conversion rate optimisation 101 @ LS Yorkshire Leeds Feb 2014
 
Introduction to conversion rate optimization (cro) for ecommerce
Introduction to conversion rate optimization (cro) for ecommerceIntroduction to conversion rate optimization (cro) for ecommerce
Introduction to conversion rate optimization (cro) for ecommerce
 
Conversion Rate Optimization 101 - Converting Visitors In To Buyers
Conversion Rate Optimization 101 - Converting Visitors In To BuyersConversion Rate Optimization 101 - Converting Visitors In To Buyers
Conversion Rate Optimization 101 - Converting Visitors In To Buyers
 
Conversion Rate Optimization 101 - Kick-Start Your Growth Engine
Conversion Rate Optimization 101 - Kick-Start Your Growth EngineConversion Rate Optimization 101 - Kick-Start Your Growth Engine
Conversion Rate Optimization 101 - Kick-Start Your Growth Engine
 
Conversion Hotel 2016 - Anna Dahlström
Conversion Hotel 2016 - Anna DahlströmConversion Hotel 2016 - Anna Dahlström
Conversion Hotel 2016 - Anna Dahlström
 
Conversion Hotel 2016 - John Ekman
Conversion Hotel 2016 - John EkmanConversion Hotel 2016 - John Ekman
Conversion Hotel 2016 - John Ekman
 
Conversion Hotel 2016 - Jeffrey Eisenberg
Conversion Hotel 2016 - Jeffrey EisenbergConversion Hotel 2016 - Jeffrey Eisenberg
Conversion Hotel 2016 - Jeffrey Eisenberg
 
Nathalie Nahai - 15 psych tips to help you sell more online
Nathalie Nahai - 15 psych tips to help you sell more onlineNathalie Nahai - 15 psych tips to help you sell more online
Nathalie Nahai - 15 psych tips to help you sell more online
 
Nathalie Nahai - Why aren't women taking the stage in tech?
Nathalie Nahai - Why aren't women taking the stage in tech?Nathalie Nahai - Why aren't women taking the stage in tech?
Nathalie Nahai - Why aren't women taking the stage in tech?
 
Nathalie Nahai - Culture and its influence on websites (part 2)
Nathalie Nahai - Culture and its influence on websites (part 2)Nathalie Nahai - Culture and its influence on websites (part 2)
Nathalie Nahai - Culture and its influence on websites (part 2)
 
Nathalie Nahai - 5 psychological principles of persuasive design
Nathalie Nahai - 5 psychological principles of persuasive designNathalie Nahai - 5 psychological principles of persuasive design
Nathalie Nahai - 5 psychological principles of persuasive design
 

Similaire à Product design is Poo - And how to fix it!

Adido do digital better seminar 2011
Adido do digital better seminar 2011Adido do digital better seminar 2011
Adido do digital better seminar 2011Adido
 
Online Trends August 2009
Online Trends August 2009Online Trends August 2009
Online Trends August 2009Bjorn Elmberg
 
Elite Camp 2013 - Estonia
Elite Camp 2013 - EstoniaElite Camp 2013 - Estonia
Elite Camp 2013 - EstoniaCraig Sullivan
 
DIT Boost your International Sales Online
DIT Boost your International Sales Online DIT Boost your International Sales Online
DIT Boost your International Sales Online Sue Beverley
 
Disrupt you! strategies for billion dollar success in the era of endless inn...
Disrupt you!  strategies for billion dollar success in the era of endless inn...Disrupt you!  strategies for billion dollar success in the era of endless inn...
Disrupt you! strategies for billion dollar success in the era of endless inn...Jay Samit
 
The New Cognitive robolution
The New Cognitive robolution The New Cognitive robolution
The New Cognitive robolution Oliver Mitchell
 
Toolkits and tips of the conversion pros v 1.6
Toolkits and tips of the conversion pros v 1.6Toolkits and tips of the conversion pros v 1.6
Toolkits and tips of the conversion pros v 1.6Craig Sullivan
 
Openings keynote Webweek Groningen industrie transformatie door de cloud iot ...
Openings keynote Webweek Groningen industrie transformatie door de cloud iot ...Openings keynote Webweek Groningen industrie transformatie door de cloud iot ...
Openings keynote Webweek Groningen industrie transformatie door de cloud iot ...Vincent Everts
 
Shift Conference 2015 - Mike Butcher (TechCrunch)
Shift Conference 2015 - Mike Butcher (TechCrunch)Shift Conference 2015 - Mike Butcher (TechCrunch)
Shift Conference 2015 - Mike Butcher (TechCrunch)Shift Conference
 
Building the framework for business transformation session sponsored by int...
Building the framework for business transformation   session sponsored by int...Building the framework for business transformation   session sponsored by int...
Building the framework for business transformation session sponsored by int...Amazon Web Services
 
Robotics Overview 2016
Robotics Overview 2016Robotics Overview 2016
Robotics Overview 2016Peter Morgan
 
Robotics Overview 2016
Robotics Overview 2016Robotics Overview 2016
Robotics Overview 2016Peter Morgan
 
Behind the Slow Growth of AI: Failed Moonshots, Unprofitable Startups, Error...
Behind the Slow Growth of AI: Failed Moonshots, Unprofitable Startups, Error...Behind the Slow Growth of AI: Failed Moonshots, Unprofitable Startups, Error...
Behind the Slow Growth of AI: Failed Moonshots, Unprofitable Startups, Error...Jeffrey Funk
 
Issa interclean top 10 innovations
Issa interclean top 10 innovationsIssa interclean top 10 innovations
Issa interclean top 10 innovationsVincent Everts
 
Key aspects of commercialisation & early stage funding - Adam Irvine
Key aspects of commercialisation & early stage funding - Adam IrvineKey aspects of commercialisation & early stage funding - Adam Irvine
Key aspects of commercialisation & early stage funding - Adam IrvineERI CFI
 
SharePoint and Digital Transformation: Is SharePoint Still Transformative
SharePoint and Digital Transformation: Is SharePoint Still TransformativeSharePoint and Digital Transformation: Is SharePoint Still Transformative
SharePoint and Digital Transformation: Is SharePoint Still TransformativeMatthew W. Bowers
 
Mobile Brain Bank links global potential
Mobile Brain Bank links global potentialMobile Brain Bank links global potential
Mobile Brain Bank links global potentialPetra Soderling
 

Similaire à Product design is Poo - And how to fix it! (20)

Creative disruption 4 SMEs
Creative disruption 4 SMEsCreative disruption 4 SMEs
Creative disruption 4 SMEs
 
Adido do digital better seminar 2011
Adido do digital better seminar 2011Adido do digital better seminar 2011
Adido do digital better seminar 2011
 
Online Trends August 2009
Online Trends August 2009Online Trends August 2009
Online Trends August 2009
 
Elite Camp 2013 - Estonia
Elite Camp 2013 - EstoniaElite Camp 2013 - Estonia
Elite Camp 2013 - Estonia
 
Dr. Ronald Day
Dr. Ronald Day Dr. Ronald Day
Dr. Ronald Day
 
DIT Boost your International Sales Online
DIT Boost your International Sales Online DIT Boost your International Sales Online
DIT Boost your International Sales Online
 
Disrupt you! strategies for billion dollar success in the era of endless inn...
Disrupt you!  strategies for billion dollar success in the era of endless inn...Disrupt you!  strategies for billion dollar success in the era of endless inn...
Disrupt you! strategies for billion dollar success in the era of endless inn...
 
Keynote Address to Canada E-Connect 2009
Keynote Address to Canada E-Connect 2009 Keynote Address to Canada E-Connect 2009
Keynote Address to Canada E-Connect 2009
 
The New Cognitive robolution
The New Cognitive robolution The New Cognitive robolution
The New Cognitive robolution
 
Toolkits and tips of the conversion pros v 1.6
Toolkits and tips of the conversion pros v 1.6Toolkits and tips of the conversion pros v 1.6
Toolkits and tips of the conversion pros v 1.6
 
Openings keynote Webweek Groningen industrie transformatie door de cloud iot ...
Openings keynote Webweek Groningen industrie transformatie door de cloud iot ...Openings keynote Webweek Groningen industrie transformatie door de cloud iot ...
Openings keynote Webweek Groningen industrie transformatie door de cloud iot ...
 
Shift Conference 2015 - Mike Butcher (TechCrunch)
Shift Conference 2015 - Mike Butcher (TechCrunch)Shift Conference 2015 - Mike Butcher (TechCrunch)
Shift Conference 2015 - Mike Butcher (TechCrunch)
 
Building the framework for business transformation session sponsored by int...
Building the framework for business transformation   session sponsored by int...Building the framework for business transformation   session sponsored by int...
Building the framework for business transformation session sponsored by int...
 
Robotics Overview 2016
Robotics Overview 2016Robotics Overview 2016
Robotics Overview 2016
 
Robotics Overview 2016
Robotics Overview 2016Robotics Overview 2016
Robotics Overview 2016
 
Behind the Slow Growth of AI: Failed Moonshots, Unprofitable Startups, Error...
Behind the Slow Growth of AI: Failed Moonshots, Unprofitable Startups, Error...Behind the Slow Growth of AI: Failed Moonshots, Unprofitable Startups, Error...
Behind the Slow Growth of AI: Failed Moonshots, Unprofitable Startups, Error...
 
Issa interclean top 10 innovations
Issa interclean top 10 innovationsIssa interclean top 10 innovations
Issa interclean top 10 innovations
 
Key aspects of commercialisation & early stage funding - Adam Irvine
Key aspects of commercialisation & early stage funding - Adam IrvineKey aspects of commercialisation & early stage funding - Adam Irvine
Key aspects of commercialisation & early stage funding - Adam Irvine
 
SharePoint and Digital Transformation: Is SharePoint Still Transformative
SharePoint and Digital Transformation: Is SharePoint Still TransformativeSharePoint and Digital Transformation: Is SharePoint Still Transformative
SharePoint and Digital Transformation: Is SharePoint Still Transformative
 
Mobile Brain Bank links global potential
Mobile Brain Bank links global potentialMobile Brain Bank links global potential
Mobile Brain Bank links global potential
 

Plus de Craig Sullivan

Why does my Mobile Conversion rate suck? 19 Sep 2013 @ Conversion Thursday #...
Why does my Mobile Conversion rate suck?  19 Sep 2013 @ Conversion Thursday #...Why does my Mobile Conversion rate suck?  19 Sep 2013 @ Conversion Thursday #...
Why does my Mobile Conversion rate suck? 19 Sep 2013 @ Conversion Thursday #...Craig Sullivan
 
Confessions of an uber optimiser conversion summit - craig sullivan - v 1.9
Confessions of an uber optimiser   conversion summit - craig sullivan - v 1.9Confessions of an uber optimiser   conversion summit - craig sullivan - v 1.9
Confessions of an uber optimiser conversion summit - craig sullivan - v 1.9Craig Sullivan
 
Conversionista : Conversion manager course - Stockholm 20 march 2013
Conversionista : Conversion manager course  - Stockholm 20 march 2013Conversionista : Conversion manager course  - Stockholm 20 march 2013
Conversionista : Conversion manager course - Stockholm 20 march 2013Craig Sullivan
 
3 Optimisation Decks : WAW Copenhagen - 27 Feb 2013
3 Optimisation Decks : WAW Copenhagen - 27 Feb 20133 Optimisation Decks : WAW Copenhagen - 27 Feb 2013
3 Optimisation Decks : WAW Copenhagen - 27 Feb 2013Craig Sullivan
 
Measure camp tools of the cro rabble
Measure camp   tools of the cro rabbleMeasure camp   tools of the cro rabble
Measure camp tools of the cro rabbleCraig Sullivan
 
5 cro tools that i can't live without
5 cro tools that i can't live without5 cro tools that i can't live without
5 cro tools that i can't live withoutCraig Sullivan
 
eMetrics Stockholm - What the F*** is wrong with my conversion?
eMetrics Stockholm - What the F*** is wrong with my conversion?eMetrics Stockholm - What the F*** is wrong with my conversion?
eMetrics Stockholm - What the F*** is wrong with my conversion?Craig Sullivan
 

Plus de Craig Sullivan (7)

Why does my Mobile Conversion rate suck? 19 Sep 2013 @ Conversion Thursday #...
Why does my Mobile Conversion rate suck?  19 Sep 2013 @ Conversion Thursday #...Why does my Mobile Conversion rate suck?  19 Sep 2013 @ Conversion Thursday #...
Why does my Mobile Conversion rate suck? 19 Sep 2013 @ Conversion Thursday #...
 
Confessions of an uber optimiser conversion summit - craig sullivan - v 1.9
Confessions of an uber optimiser   conversion summit - craig sullivan - v 1.9Confessions of an uber optimiser   conversion summit - craig sullivan - v 1.9
Confessions of an uber optimiser conversion summit - craig sullivan - v 1.9
 
Conversionista : Conversion manager course - Stockholm 20 march 2013
Conversionista : Conversion manager course  - Stockholm 20 march 2013Conversionista : Conversion manager course  - Stockholm 20 march 2013
Conversionista : Conversion manager course - Stockholm 20 march 2013
 
3 Optimisation Decks : WAW Copenhagen - 27 Feb 2013
3 Optimisation Decks : WAW Copenhagen - 27 Feb 20133 Optimisation Decks : WAW Copenhagen - 27 Feb 2013
3 Optimisation Decks : WAW Copenhagen - 27 Feb 2013
 
Measure camp tools of the cro rabble
Measure camp   tools of the cro rabbleMeasure camp   tools of the cro rabble
Measure camp tools of the cro rabble
 
5 cro tools that i can't live without
5 cro tools that i can't live without5 cro tools that i can't live without
5 cro tools that i can't live without
 
eMetrics Stockholm - What the F*** is wrong with my conversion?
eMetrics Stockholm - What the F*** is wrong with my conversion?eMetrics Stockholm - What the F*** is wrong with my conversion?
eMetrics Stockholm - What the F*** is wrong with my conversion?
 

Dernier

『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书
『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书
『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书rnrncn29
 
ETHICAL HACKING dddddddddddddddfnandni.pptx
ETHICAL HACKING dddddddddddddddfnandni.pptxETHICAL HACKING dddddddddddddddfnandni.pptx
ETHICAL HACKING dddddddddddddddfnandni.pptxNIMMANAGANTI RAMAKRISHNA
 
Cybersecurity Threats and Cybersecurity Best Practices
Cybersecurity Threats and Cybersecurity Best PracticesCybersecurity Threats and Cybersecurity Best Practices
Cybersecurity Threats and Cybersecurity Best PracticesLumiverse Solutions Pvt Ltd
 
IP addressing and IPv6, presented by Paul Wilson at IETF 119
IP addressing and IPv6, presented by Paul Wilson at IETF 119IP addressing and IPv6, presented by Paul Wilson at IETF 119
IP addressing and IPv6, presented by Paul Wilson at IETF 119APNIC
 
SCM Symposium PPT Format Customer loyalty is predi
SCM Symposium PPT Format Customer loyalty is prediSCM Symposium PPT Format Customer loyalty is predi
SCM Symposium PPT Format Customer loyalty is predieusebiomeyer
 
TRENDS Enabling and inhibiting dimensions.pptx
TRENDS Enabling and inhibiting dimensions.pptxTRENDS Enabling and inhibiting dimensions.pptx
TRENDS Enabling and inhibiting dimensions.pptxAndrieCagasanAkio
 
Unidad 4 – Redes de ordenadores (en inglés).pptx
Unidad 4 – Redes de ordenadores (en inglés).pptxUnidad 4 – Redes de ordenadores (en inglés).pptx
Unidad 4 – Redes de ordenadores (en inglés).pptxmibuzondetrabajo
 
『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书
『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书
『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书rnrncn29
 
Company Snapshot Theme for Business by Slidesgo.pptx
Company Snapshot Theme for Business by Slidesgo.pptxCompany Snapshot Theme for Business by Slidesgo.pptx
Company Snapshot Theme for Business by Slidesgo.pptxMario
 

Dernier (9)

『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书
『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书
『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书
 
ETHICAL HACKING dddddddddddddddfnandni.pptx
ETHICAL HACKING dddddddddddddddfnandni.pptxETHICAL HACKING dddddddddddddddfnandni.pptx
ETHICAL HACKING dddddddddddddddfnandni.pptx
 
Cybersecurity Threats and Cybersecurity Best Practices
Cybersecurity Threats and Cybersecurity Best PracticesCybersecurity Threats and Cybersecurity Best Practices
Cybersecurity Threats and Cybersecurity Best Practices
 
IP addressing and IPv6, presented by Paul Wilson at IETF 119
IP addressing and IPv6, presented by Paul Wilson at IETF 119IP addressing and IPv6, presented by Paul Wilson at IETF 119
IP addressing and IPv6, presented by Paul Wilson at IETF 119
 
SCM Symposium PPT Format Customer loyalty is predi
SCM Symposium PPT Format Customer loyalty is prediSCM Symposium PPT Format Customer loyalty is predi
SCM Symposium PPT Format Customer loyalty is predi
 
TRENDS Enabling and inhibiting dimensions.pptx
TRENDS Enabling and inhibiting dimensions.pptxTRENDS Enabling and inhibiting dimensions.pptx
TRENDS Enabling and inhibiting dimensions.pptx
 
Unidad 4 – Redes de ordenadores (en inglés).pptx
Unidad 4 – Redes de ordenadores (en inglés).pptxUnidad 4 – Redes de ordenadores (en inglés).pptx
Unidad 4 – Redes de ordenadores (en inglés).pptx
 
『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书
『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书
『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书
 
Company Snapshot Theme for Business by Slidesgo.pptx
Company Snapshot Theme for Business by Slidesgo.pptxCompany Snapshot Theme for Business by Slidesgo.pptx
Company Snapshot Theme for Business by Slidesgo.pptx
 

Product design is Poo - And how to fix it!

  • 1. @OptimiseOrDi e • Growth Optimisation, Lean, Agile • Teams, Culture, Methodology • Split Testing, Analytics, UX • 200M+ visitors tested • 230+ sites, 26 languages • Is it working right? • No? • Sullivac @ gmail.com @OptimiseOrDiecolinski.tumblr.com
  • 2. Why Organisations are the Biggest Conversion Killer and How to Fix it! @OptimiseOrDie
  • 3. Digital Product Design is And we’re all going to die… @OptimiseOrDie
  • 6. You had One F***ing Job to Do! @OptimiseOrDie bit.ly/OneJobToDo
  • 7. From 1994 -> To the Future! @OptimiseOrDie
  • 8. The Depressing Reality of 2016: @OptimiseO
  • 9. Stuff I expected to be HERE: • Artificial Intelligence instead of Forms • Instant Customer Service • Seamless Web and Call Tracking • Microwave dinners that open properly • Flying Cars • Jetpacks • Free Energy • Space Tourism • Learning from past Design Mistakes! • More Usable Products! @OptimiseOrDie
  • 10. Why? Because We are F***ing Stupid! Let me give you a couple of examples… @OptimiseOrDie
  • 11. @OptimiseOrDieAnnual Sales in DE/FR/UK/IT/ES = £4.5Bn (2015) After Millions of Years of Evolution…
  • 14. Quick Calculation: • £4.5Bn Sales @ £3.5 average price • Assume 60% are failures • Costs 90 seconds of wasted time • 72514285714 seconds wasted • 1208571428 minutes • 20142857 hours • 839,285 days of life - wasted on friction! • What about injuries? @OptimiseOrDie
  • 16. A Packaging Manifesto: 1. Packaging should never require a sharp implement to open. 2. Packaging should not require finger control or strength which discriminates against population groups 3. Any packaging must be capable of being returned to its original state to preserve any unused contents @OptimiseOrDie
  • 17. Why? “If it comes off in one, it's gonna be banging! If you’re picking plastic out of your dinner for ten minutes, it's probably gonna taste like shit.” @OptimiseOrDie
  • 18. Why? “Because an experience is only as good as its shittiest part” @OptimiseOrDie
  • 20. Edwardian Hygiene “It was only in the early 1900s that British doctors realised that the housefly could carry disease on its bristly legs. Flies were a major transmitter of both typhoid and summer-sickness, causing thousands of deaths each year. After the hot summer of 1911, there was rising public panic about the high levels of infant mortality from diarrhoea. Medical officers decided that they needed to change the way the British public felt about flies.” @OptimiseOrDie bit.ly/OODfly
  • 21. @OptimiseOrDie “The creation of disgust around flies was a major achievement of the early 20th Century… The Death rate from diarrhoea fell steadily from 1913…” bit.ly/OODfly @OptimiseOrDie
  • 22. @OptimiseOrDie “A 2010 Study found that when swabbed, 28% of London Commuters had faecal bacteria on their hands!” bit.ly/OODfly @OptimiseOrDie
  • 23. Quick Calculation: • Less than 20% of people in the world wash hands • Mainly because they don’t have soap and running water • London is well served for these! • A huge part of UK ‘Food Poisoning’ is actually faecal bacteria • This part costs the economy up to £1.5Bn a year • British travellers get ill on holiday more often than Americans, Australians or Europeans! @OptimiseOrDie
  • 25. Why? Because We are F***ing Stupid! @OptimiseOrDie
  • 26. What can Manufacturing & Retail teach us?
  • 27. @OptimiseOrDie Car Manufacturing Timeline 1893 The Daimler Motor Syndicate formed in Britain 1908 The first Model T rolls off the production line 1930s New innovations in body types – bumpers, closed bodies, boots! 1945 Car Manufacturing takes off in Europe 1959 The Mini comes onto the market! 1961 The first Robot used by General Motors 1960s Japan becomes a major force in manufacturing 1973 Oil Crisis Hits, US market stagnates, Toyota, Nissan, BMW thrive! 1980 Japan becomes 1st in worldwide car production 1980s Use of robots prevalent at virtually all manufacturers
  • 28. @OptimiseOrDie Car Manufacturing Timeline 1983 Chrysler opens new ‘just in sequence’ assembly line 1990 Japanese carmakers nab 28% of the US market 1991 GM and Ford post record losses whilst Japan booms 1997 Toyota launches the Prius Hybrid car 2005 Four of the 10 largest companies are oil, four are car companies! 2006 Chrysler and GM post huge losses and are rescued 2008 Tesla debuts the Roadster 2010 Toyota, GM, VW and Hyundai the biggest companies 2010 GM sells more cars in China than the USA 2015 First mass market hydrogen car
  • 29. @OptimiseOrDie Car Manufacturing Timeline Toyota Production System (1960s ->) Lean Manufacturing (1960s ->) Kanban (1960s ->) Continuous Improvement (1970s ->) Six Sigma (1986 ->) Agile Manufacturing (1990s ->)
  • 30. @OptimiseOrDie 1. Change Growth TrajectoryWhat are these for? • Maintain or Improve Quality • Remove Defects & Waste • Increase Production Capacity • Agility, Flexibility, Rapid Delivery • Continuous and Rapid Change • Roboticisation & Automation • Market, Demand, Resource Planning • Get it very right or death results!
  • 31. @OptimiseOrDie What Can Retail Teach Us? Let’s take some random stuff from online: • The toilets must be clean • All the lights must work • Rails must not be stuffed with clothes • Disturbed clothing must be tidied • All tills must be adequately staffed • Window displays must be changed daily • All doors and lifts must work • Floor surfaces must be spotlessly clean • The air has to smell right! Thousands of little, tiny and very important details!
  • 32. @OptimiseOrDie What Can Retail Teach Us? Let’s try some online stuff: • Checkout fails on Chrome browsers • Contact Us page doesn’t render on iPads • Mobile payment page fails on PayPal • Navigation was built by a Sadist • Search is so poor nobody uses it • Performance unusable on 3G data • Errors on checkout are never noticed • Your basket disappears after 15 minutes • The password reset takes 45 minutes to arrive • Nobody changes the homepage for a bloody year!
  • 33. @OptimiseOrDie 1. Change Growth TrajectoryWindow Displays & Basic Merchandising
  • 34. @OptimiseOrDie Arrogance and Basic Standards • Hiring call with developers • Candidate told me “People are f***ing stupid if they use browsers like Internet Explorer” • I explained using a buggy!
  • 37. @OptimiseOrDie • Clothing 1M per month, 2 bugs • Travel 2M per month, 13 bugs • Telecoms 1.4M per month, 3 bugs • Travel 0.6M per month, 5 bugs • Event Site 2.5M per month, 11 bugs – These were only the first bugs we found – < 5 days time to fix – an ROI of 91,150% – Larger than the annual IT budget for some! How Much do Bugs Cost?
  • 38. Browser Checks www.crossbrowsertesting.com www.browserstack.com www.spoon.net www.saucelabs.com Mobile & Tablet www.appthwack.com www.deviceanywhere.com www.opendevicelab.com Article & Info bit.ly/devicetesting 6: Here is our £84 Million testing rig! @OptimiseOrDie Fix Those Bugs!
  • 39. 6: Here is our £84 Million testing rig! @OptimiseOrDie We Are All Going to Die! • Made by PetNet • “The World’s first Intelligent Pet Feeder” • Links to your smartphone app • Schedule feeding times remotely • Ooops! Server outage! “We are experiencing difficulties with one of our third party servers. You may experience a loss of scheduled feeds and failed remote feedings” WTF! The Pet experiences the loss!
  • 40. 6: Here is our £84 Million testing rig! @OptimiseOrDie Holiday Diet Feature! Before After
  • 41. 6: Here is our £84 Million testing rig! @OptimiseOrDie It’s only just starting! • Cheap devices coming! • Some very good • Some designed by idiots • Most designed by idiots • Never built a digital product • Never designed one • Now we make one • What’s wrong with that? • Access to your Wi-Fi network!
  • 42. 6: Here is our £84 Million testing rig! @OptimiseOrDie Already Hacked! • Cars • Watches • Lightbulbs • Home Security • Phones • Alarms • Music Systems • Baby Monitors • Video surveillance • Power & Utility • Printers • Kettles codecurmudgeon.com/wp/iot-hall-shame/
  • 43. 6: Here is our £84 Million testing rig! @OptimiseOrDie Already Hacked! • No ‘Best Practice’ security for design • No infrastructure for updating or patching product • Needs unfettered access to Wi-Fi network • Allows untrusted computers to connect • No ‘two factor’ authentication “Samsung Toaster Hack Paralyzes Bay Area” “Hungarian Mercedes Hack shuts Uber in Budapest” “Thermostat Worm costs $4Bn and counting” “Search engine available for Hacked Baby Monitors”
  • 44. 6: Here is our £84 Million testing rig! @OptimiseOrDie Read More! bit.ly/iotdeath
  • 45.
  • 46. 16. Ignorance Example “As your Circle of Knowledge grows, as the diameter increases, so does the circumference that’s in contact with all that darkness outside the circle of light.”
  • 47. The Solution to Stupidity? “You Need to Get a Better Quality of Ignorance!” @OptimiseOrDie
  • 48. Rehab for Companies @OptimiseOrDie 1. What are the signs? 2. Burn Down the Silos 3. Startup Growth Team Models 4. Lean Corporate & Optimisation 5. Product Themes / Decoupling 6. Culture of Failure & Velocity
  • 49. 1. “We have analytics – we just don’t use it (properly)” 2. “We have testing – we just don’t learn anything useful” 3. “We have Customer Insight – we just don’t listen or act upon what they tell us” 4. “We do ‘Agile’, but we’re not really agile at all” 5. “We have a Growth Hacker, but they work in a silo” 6. “We apply optimisation but don’t change the organisational structure or management at all” 7. “We have all these tools – but nothing happens” @OptimiseOrDie 1. Signs you need Rehab
  • 50. @OptimiseOrDie • Enough Project Managers and Business Analysts to host your own IT conference. • Silos work on product separately • No ‘One Team’ per product/theme • Non agile, non iterative design • Product is ‘passed around’ • Large teams, unwieldy coordination • Endless meddling and signoff • AB testing usually crippled too! 2. Burn Down the Silos!
  • 51. @OptimiseOrDie 3. Independent Team, by Features Uber Facebook bit.ly/GHmodel
  • 52. @OptimiseOrDie 3. Independent Team, by Metrics Uber Facebook bit.ly/GHmodel
  • 53. @OptimiseOrDie 3. Integrated Product Teams - Functional Pinterest Twitter Linkedin Dropbox BitTorrent Airbnb FT ING Spotify bit.ly/GHmodelbit.ly/ingvideo
  • 54. 4. Lean Optimisation and Lean Corporate @OptimiseOrDie
  • 55. @OptimiseOrDie 4. FT.COM – Example • Small teams (6-15) with direct access to publish • Ability to set and get metrics data directly • Tools, Autonomy, Lack of interference • No Project Managers or Business Analysts • Business defines ‘outcomes’ – teams deliver • No long signoff chain • No pesky meddling fools during execution!
  • 56. @OptimiseOrDie 4. FT.COM – Labs, Beta, Split Testing • 100s of releases a day! • MVP approach • Launch as alpha, beta, pilot, phased rollout • This approach includes split testing to tune, optimize or decide! • Like getting in a shower • Read more at labs.ft.com
  • 57. @OptimiseOrDie 1. Change Growth Trajectory4. Increased Productivity • Most product changes we make are a waste of time! • The Financial Times – 50-70% of product developer time wasted in a siloed organisational structure • Minimum project time was “At least 18 months” for anything • Projects were always late, underperformed, didn’t shift metrics as expected • Post changes, every IT project was under time & budget • Products were iterated to hack their way to success • xxM per annum additional profit after three years
  • 58. @OptimiseOrDie 4. FT.COM – Pesky Meddling & Signoff
  • 59. @OptimiseOrDie 1. Change Growth Trajectory4. A Holistic Approach “Product changes and AB tests are just the same thing to us. Where we’re moving to is measuring and testing everything we do. This approach tells us what works, what doesn’t, what to keep, what to remove and what we need to iterate.” Financial Times – NextFT project
  • 60. #1 Analytics / Quantitative #2 Split Testing #3 UX / Qualitative #4 Agile & Lean #5 Culture & Organisation The Optimisation Barstool
  • 61. @OptimiseOrDie 1. Invest more in Analytics Build your own data layer with tools, people, training, self sufficiency and continual improvement . Invest MORE! 2. Remove wastage and defects By building products more efficiently, cheaply, successfully. Remove experience defects at all stages of the lifecycle. 3. Reform the organisation Set teams free to find the right outcomes and self optimise SUMMARY
  • 62. @OptimiseOrDie 4. AB and MVT Testing Don’t just test stuff. Winners have a process and methodology around discovering, prioritising and running their tests 5. Stop Reading Best Practice Bullshit Their customers, website, data, market are not yours. Stop reading what other people do and start listening to and measuring your customers! 6. Qual AND Quant If you are not measuring customer behaviour (and reaction to experiments) with both, then you’re hosed. Use data and insight to replace Ego, Opinion, Assumption, Cherished Notion or Bullshit SUMMARY
  • 63. • Leicester & Orchestra side 63 Orchestration! You can still be beaten by people without your budget, tech or tools!
  • 65. Hacking efficiency/time/ delight/productivity/fun Tell your friends good Lovable Empathetic Delightful Self actualisation Life changing Rewiring FUNCTIONAL ACCESSIBLE USABLE USEFUL PERSUASIVE COMPELLING TRANSFORMATIONAL Device Browser Mobile Audience Performance Accessibility Platforms Comprehension Affordance Simplicity Relevance Clarity Context Utility Tasks Goals Steps Completion Progression Resonant Authentic Compelling Consistent Benefits Value Trust Social Integration and Proof Habits Nudges Addictions Lifecycle Promotions Personalisation Brand Belonging Trusted Emotive
  • 66. TIME ROI Your Dendritic Future “If we are to survive, we have to stop wasting money on things that don’t work, cause more harm than good or aren’t actually needed.”
  • 67. The Three Horizons of Innovation (bit.ly/3horiz)
  • 70. 70
  • 71. Thank You! Email me sullivac@gmail.com Slides Will be tweeted! LinkedIn linkd.in/pvrg14

Notes de l'éditeur

  1. So – a boring intro bit about me – don’t worry – it’ll be over quickly. You can have a look at your phones for a couple of minutes or just watch David Lynch’s finger instead.
  2. This is how I really feel about this stuff – and I’m angry – because it’s all completely human, stupid and avoidable. So my talk today is about not congratulating ourselves on how advanced we are – it’s realising truly how stupid we are and how badly we design for humans.
  3. So, this is the title of my talk today, but actually, I prefer this one:
  4. So, this is the title of my talk today, but actually, I prefer this one:
  5. So, this is the title of my talk today, but actually, I prefer this one:
  6. So, this is the title of my talk today, but actually, I prefer this one:
  7. So, this is the title of my talk today, but actually, I prefer this one:
  8. So, this is the title of my talk today, but actually, I prefer this one:
  9. So, this is the title of my talk today, but actually, I prefer this one:
  10. So, this is the title of my talk today, but actually, I prefer this one:
  11. So, this is the title of my talk today, but actually, I prefer this one:
  12. So, this is the title of my talk today, but actually, I prefer this one:
  13. So, this is the title of my talk today, but actually, I prefer this one:
  14. So, this is the title of my talk today, but actually, I prefer this one:
  15. So, this is the title of my talk today, but actually, I prefer this one:
  16. So, this is the title of my talk today, but actually, I prefer this one:
  17. So, this is the title of my talk today, but actually, I prefer this one:
  18. So, this is the title of my talk today, but actually, I prefer this one:
  19. So, this is the title of my talk today, but actually, I prefer this one:
  20. So, this is the title of my talk today, but actually, I prefer this one:
  21. I’ve been working on this presentation and thinking about it for over two months now. And this is one of the first graphs I wanted to include, because it represents the hype cycle in AB testing. This is what a lot of companies go through with new technology adoption, so I wanted to show you what the AB testing hype cycle would look like [CLICK]
  22. I’ve been working on this presentation and thinking about it for over two months now. And this is one of the first graphs I wanted to include, because it represents the hype cycle in AB testing. This is what a lot of companies go through with new technology adoption, so I wanted to show you what the AB testing hype cycle would look like [CLICK]
  23. I’ve been working on this presentation and thinking about it for over two months now. And this is one of the first graphs I wanted to include, because it represents the hype cycle in AB testing. This is what a lot of companies go through with new technology adoption, so I wanted to show you what the AB testing hype cycle would look like [CLICK]
  24. And this was the state of my head in 2004. The inability to understand what you can and can’t be confident about – but nobody wants to admit they’re fucking guessing a lot of the time. And it took me a long time to figure out I didn’t know anything really – it was all assumptions and cherished notions. It was pretty crushing to test my way to this realisation but MUCH I’m happier now.
  25. So, this is the title of my talk today, but actually, I prefer this one:
  26. And here are the top 10 reasons – there are about 70 odd ways people manage to break their AB testing but these are the most common mistakes, particularly for companies just starting or scaling up. Let’s run through each one – I’ve included a summary slide of each one, so you’ve got a nice handy checklist to take back to the office.
  27. You need to inhabit the contextual and emotional landscape of the consumer to really shape product or service experience. The only way to do this is have teams and cultures that create a direct and meaningful connection between teams and the customer, in the impact that every change has on the outcome. Every atom of every piece of copy, design, error message, email, website, support, help content, absolutely bloody everything you do - has to be framed within knowledge and empathy with the consumer fears, worries, barriers, pain but also the real problems we solve by designing products not as features but as life enhancing. And this is the best marketing of all, like the IBM ad. Business Model Optimisation requires a watchmakers eye – a complete understanding of the watch from macro to micro - the flow of delight and money that can be shaped inside every customer experience, website, and interaction - at a component and a service design level. Most people have 1 or 2 legs at most. The best companies I've worked with are doing all of these.
  28. And here are the top 10 reasons – there are about 70 odd ways people manage to break their AB testing but these are the most common mistakes, particularly for companies just starting or scaling up. Let’s run through each one – I’ve included a summary slide of each one, so you’ve got a nice handy checklist to take back to the office.
  29. And now a bit about something I call Rumsfeldian Space – exploring the unknowns. This is vital if you want to make your testing bold enough to get great results.
  30. I hope you enjoyed my talk as much I did writing it. All my details are here including the slides, for you to download. Go forth and Optimise!