SlideShare une entreprise Scribd logo
1  sur  26
Télécharger pour lire hors ligne
Why You Should (Not) be Using Automated
Bidding Strategies
Sven O. Wilhelm | SEM Manager
Why am I standing here today?
● Extensive experience with different 3P bidding solutions as well as Google´s
Smart Bidding and other strategies in different environments
● Interesting challenges came up in those years
● Information available online is not always helpful
Session Outcomes (1)
I will answer the following questions:
● What are the implications for account managers in general?
● Is there a substantial increase in performance that would make it
imperative to use automated bidding strategies?
● Which framework is required to use automated bidding strategies
successfully and how to measure success?
● How to avoid common pitfalls?
Session Outcomes (2)
I will not answer:
● How machine learning works for PPC accounts
● How to use Adwords Scripts for bidding
● Which 3P software works best
First encounters (1)
● Marin Search used for account management
● Me: (designated) super user
● My colleague Livia implemented a bid strategy for position bidding for her
most important keywords
● No max cpc limitations suggested for bid strategies by Marin Account
Managers
● So, what happened next...?
First encounters (2)
● Learning phase: bids pushed up to ~15$ max CPC
● Livia freaked out and switched back to manual bidding after a couple of days
Why did she freak out?
● She completely lost control over her most important keywords
● Actions performed by strategy were counter-intuitive
● The initial performance was horrible (It was working well later on.)
Changes in the competitive landscape
● Pressure on advertisers increases to move away from manual bidding
● Choice of strategies is extensive: target CPA*, target ROAS*, maximise
clicks, viewable CPM, maximise conversions, target search page location,
target outranking share, enhanced CPC, monthly spend (in addition, you can
create your own strategies)
*Smart Bidding entails optimization for conversions/revenue
What are the implications for account management? (1)
Interesting questions in this context:
● Will automated bidding solutions redefine the role of PPC account managers?
● Are there actually scenarios where automation doesn´t make sense?
What are the implications for account management? (2)
Will automated bidding solutions redefine the role of PPC account managers?
Yes...
● 3P bidding solutions as well as Google´s internal bidding solutions, Adwords
Express, Dynamic Search Campaigns, Responsive Search Ads, “optimize” ad
rotation settings, etc. are changing how account managers work
● General shift from micro-management towards higher-level strategy
● Time spent on bid management can be used in a better way
...but
● Smaller accounts or low conversion campaigns will still
require skilled manual work for good performance
● Strategy, set-up, copywriting, etc. still essential
What are the implications for account management? (3)
Are there actually scenarios where automated bidding won´t make sense?
Business Goals vs. Bid Strategies
● Leads differ in value, so there is a general conflict between good performance
(through high conversion numbers) and differentiation by business goals
● Segments of your portfolio are too small to run tROAS or tCPA strategies.
● Automated bidding strategies need time to learn. This means that ad-hoc
requests from management to “push these products now” will need to run
outside of the Smart Bidding strategy set-up
What about performance uplift?
Yes, there is a performace uplift, but...
● It makes a difference, if you optimise for tROAS or tCPA
● Biggest performance up-lift in campaigns with high conversion-volume
● Results differed a lot based on campaign type, volume and how portfolios
were put together
● Results also differ based on the amount of care the accounts received in the
past
● If performance remains stable, you still gain valuable time
Case studies
● Case Study #1 – (tROAS) Drastic increase in spending
● Case Study #2 – (tROAS) Shift to certain products in Google Shopping
● Case Study #3 – (tROAS) Increased CPC, decreased traffic
Case Study #1 – (tROAS) Drastic increase in spending (1)
● Target ROAS: 400%
● Great performance for last couple of months
● Accidentally huge sale of 16.6k
● Spending increased dramatically without corresponding
increase in revenue
Case Study #1 – (tROAS) Drastic increase in spending (2)
ERS differs a lot between campaigns in same portfolio strategy
Case Study #1 – (tROAS) Drastic increase in spending (3)
Take aways:
● Outliers in revenue may impact your kpis significantly
● Set budgets tightly to decrease chances for significant and sudden increases
in spending
● Your portfolio strategy balances cost effectively among campaigns
● This could potentially collide with other business goals
Case Study #2 – (tROAS) Shift to certain produtcs in
Google Shopping (1)
Body Text Here
Case Study #2 – (tROAS) Shift to certain produtcs in
Google Shopping (2)
Body Text Here
Case Study #2 – (tROAS) Shift to certain produtcs in
Google Shopping (3)
Body Text Here
Case Study #2 – (tROAS) Shift to certain produtcs in
Google Shopping (4)
Take aways:
● Google will distribute traffic differently between biddable items
● This traffic shift will usually benefit you
● If you need to sell off certain products: Doing it manually might be better
● In the above example: Shift to different products led to more revenue and
lower cost (Other pool tables filled the gap)
Case Study #3 – (tROAS) increased CPC, decreased traffic (1)
Smart Bidding tROAS in a longer-running portfolio:
● clicks: -23%
● avg. CPC: + 48%
● avg. Position: - 8% (lower position)
● revenue: +36%
● cost: +14%
● mobile CVR: +47%
Case Study #3 – (tROAS) increased CPC, decreased traffic (2)
Take aways:
● It is important to look at the right metrics
● Mobile performance may improve
● If you report on traffic figures, make sure to manage expectations before
launching Smart Bidding
Which framework is required to use automated bidding
strategies successfully and how to measure success? (1)
● Do not choose a “one solution fits all“ approach
● Keep in mind: large portfolios allow for better trade-offs
● Split your campaigns by business goals. Do not put campaigns or ad groups
in one strategy that have different CPA or ROAS targets
● Set appropriate target CPA or target ROAS goals, based on historical
performance (usually last 30 days)
● Do not let bid strategies run with budget limitations
● Allow enough time for evaluation of results
Which framework is required to use automated bidding
strategies successfully and how to measure success? (2)
● For Smart Bidding, look at the right metrics (only conversion metrics)
● Keep in mind that some KPIs may go down (like clicks, impressions)
● Consider which attribution model you are using
(Using a last-click attribution model means you are optimizing for last click
performance.)
● Keep an eye on keywords with strong seasonal fluctuation and low volume
(Look-back modeling, clustering, etc. are supposed to solve this.)
● Enrich your campaigns with audiences to provide additional data points for
Smart Bidding strategies (e.g. regular remarketing lists & in-market audiences)
A great pitfall to avoid...
When you switch back from Google´s Smart Bidding to manual bidding, check
your bids J
Action Items
● Leverage automated bidding strategies to achieve better results or save time
● Do not assume that automated bidding strategies will solve all your problems
● Let account managers evaluate and decide which solution works best for their
accounts
● The landscape is changing fast – try out new solutions from time to time
● Start small experiments, especially with Google internal solutions (no
additional cost involved)
● Test 3P providers and let them help you with their knowledge and technology
Thank you J

Contenu connexe

Tendances

Sales presentation2
Sales presentation2Sales presentation2
Sales presentation2Tamil Arasan
 
Sales territory design - aligning to your strategy
Sales territory design - aligning to your strategySales territory design - aligning to your strategy
Sales territory design - aligning to your strategySBI | Sales Benchmark Index
 
Sales quota by sani gandhi, Brcm, surat
Sales quota by sani gandhi, Brcm, suratSales quota by sani gandhi, Brcm, surat
Sales quota by sani gandhi, Brcm, suratSunny Gandhi
 
Demand planning and inventories strategy
Demand planning and inventories strategyDemand planning and inventories strategy
Demand planning and inventories strategyLuis Cabrera
 
Retail sales reporting & analysis
Retail sales reporting & analysisRetail sales reporting & analysis
Retail sales reporting & analysisRetail EDI
 
Sales Forecasting : Definition, benefits, and process.
Sales Forecasting : Definition, benefits, and process.Sales Forecasting : Definition, benefits, and process.
Sales Forecasting : Definition, benefits, and process.Shane Emerson
 
RETAIL SALES FORECASTING : CONCEPT AND ISSUES
RETAIL SALES FORECASTING : CONCEPT AND ISSUESRETAIL SALES FORECASTING : CONCEPT AND ISSUES
RETAIL SALES FORECASTING : CONCEPT AND ISSUESromeo_reet
 
Introducing sales analysis model know your performance
Introducing sales analysis model   know your performanceIntroducing sales analysis model   know your performance
Introducing sales analysis model know your performanceBaby Sirota
 
How to increase the revenues of the hotel with Revenue management?
How to increase the revenues of the hotel with Revenue management?How to increase the revenues of the hotel with Revenue management?
How to increase the revenues of the hotel with Revenue management?Stanislav Ivanov
 
desining a sales territory (Sales management)
desining a sales territory (Sales management) desining a sales territory (Sales management)
desining a sales territory (Sales management) Komal Hambir
 
How Market Mix Modeling Can Impact Cross-Channel Budget and Business Planning
How Market Mix Modeling Can Impact Cross-Channel Budget and Business PlanningHow Market Mix Modeling Can Impact Cross-Channel Budget and Business Planning
How Market Mix Modeling Can Impact Cross-Channel Budget and Business PlanningVivastream
 
Account Based Selling Oil & Gas Industry
Account Based Selling Oil & Gas Industry Account Based Selling Oil & Gas Industry
Account Based Selling Oil & Gas Industry Pat Hinds
 

Tendances (20)

Sales presentation2
Sales presentation2Sales presentation2
Sales presentation2
 
Sales territory design - aligning to your strategy
Sales territory design - aligning to your strategySales territory design - aligning to your strategy
Sales territory design - aligning to your strategy
 
Sales quota by sani gandhi, Brcm, surat
Sales quota by sani gandhi, Brcm, suratSales quota by sani gandhi, Brcm, surat
Sales quota by sani gandhi, Brcm, surat
 
Demand planning and inventories strategy
Demand planning and inventories strategyDemand planning and inventories strategy
Demand planning and inventories strategy
 
Retail sales reporting & analysis
Retail sales reporting & analysisRetail sales reporting & analysis
Retail sales reporting & analysis
 
Sales forecasting & planing training
Sales forecasting & planing trainingSales forecasting & planing training
Sales forecasting & planing training
 
Sales forecasting
Sales forecastingSales forecasting
Sales forecasting
 
Go to-market strategy (gtm)
Go to-market strategy (gtm)Go to-market strategy (gtm)
Go to-market strategy (gtm)
 
Sales budget
Sales budgetSales budget
Sales budget
 
Sales Forecasting : Definition, benefits, and process.
Sales Forecasting : Definition, benefits, and process.Sales Forecasting : Definition, benefits, and process.
Sales Forecasting : Definition, benefits, and process.
 
ARR guidance deck
ARR guidance deckARR guidance deck
ARR guidance deck
 
Sales Mgt
Sales MgtSales Mgt
Sales Mgt
 
RETAIL SALES FORECASTING : CONCEPT AND ISSUES
RETAIL SALES FORECASTING : CONCEPT AND ISSUESRETAIL SALES FORECASTING : CONCEPT AND ISSUES
RETAIL SALES FORECASTING : CONCEPT AND ISSUES
 
Introducing sales analysis model know your performance
Introducing sales analysis model   know your performanceIntroducing sales analysis model   know your performance
Introducing sales analysis model know your performance
 
How to increase the revenues of the hotel with Revenue management?
How to increase the revenues of the hotel with Revenue management?How to increase the revenues of the hotel with Revenue management?
How to increase the revenues of the hotel with Revenue management?
 
desining a sales territory (Sales management)
desining a sales territory (Sales management) desining a sales territory (Sales management)
desining a sales territory (Sales management)
 
How Market Mix Modeling Can Impact Cross-Channel Budget and Business Planning
How Market Mix Modeling Can Impact Cross-Channel Budget and Business PlanningHow Market Mix Modeling Can Impact Cross-Channel Budget and Business Planning
How Market Mix Modeling Can Impact Cross-Channel Budget and Business Planning
 
Account Based Selling Oil & Gas Industry
Account Based Selling Oil & Gas Industry Account Based Selling Oil & Gas Industry
Account Based Selling Oil & Gas Industry
 
Sales Forecasting
Sales ForecastingSales Forecasting
Sales Forecasting
 
S & d mgt
S & d mgtS & d mgt
S & d mgt
 

Similaire à Why You Should (Not) be Using Automated Bidding Strategies: Key Considerations and Case Studies

The Pros and Cons of PPC Bidding
The Pros and Cons of PPC BiddingThe Pros and Cons of PPC Bidding
The Pros and Cons of PPC BiddingHanapin Marketing
 
Google Analytics Konferenz 2019_Attribution: building a model_Martin Frotzler...
Google Analytics Konferenz 2019_Attribution: building a model_Martin Frotzler...Google Analytics Konferenz 2019_Attribution: building a model_Martin Frotzler...
Google Analytics Konferenz 2019_Attribution: building a model_Martin Frotzler...e-dialog GmbH
 
Paid Search Enhanced Bidding Strategies
Paid Search Enhanced Bidding StrategiesPaid Search Enhanced Bidding Strategies
Paid Search Enhanced Bidding StrategiesTinuiti
 
A Wise Approach to Automated Bidding
A Wise Approach to Automated Bidding A Wise Approach to Automated Bidding
A Wise Approach to Automated Bidding Tinuiti
 
HOW TO LEVERAGE GOOGLE’S SMART AD UNITS FOR PROFITABILITY
HOW TO LEVERAGE GOOGLE’S SMART AD UNITS FOR PROFITABILITYHOW TO LEVERAGE GOOGLE’S SMART AD UNITS FOR PROFITABILITY
HOW TO LEVERAGE GOOGLE’S SMART AD UNITS FOR PROFITABILITYTinuiti
 
Windsor marketing attribution_webinar
Windsor marketing attribution_webinarWindsor marketing attribution_webinar
Windsor marketing attribution_webinarnkolster
 
AUTOMATION & CROSS-CHANNEL
AUTOMATION & CROSS-CHANNELAUTOMATION & CROSS-CHANNEL
AUTOMATION & CROSS-CHANNELTinuiti
 
Plot It Audit
Plot It AuditPlot It Audit
Plot It AuditPush
 
Microsoft Automation Bootcamp - London 2 October 2019
Microsoft Automation Bootcamp - London 2 October 2019Microsoft Automation Bootcamp - London 2 October 2019
Microsoft Automation Bootcamp - London 2 October 2019MSFTAdvertising
 
Love Tiki PPC Audit
Love Tiki PPC AuditLove Tiki PPC Audit
Love Tiki PPC AuditPush Monster
 
UNVEILING VALUE-BASED BIDDING SECRETS FOR MAXIMUM EFFICIENCY GAIN.pptx
UNVEILING VALUE-BASED BIDDING SECRETS FOR MAXIMUM EFFICIENCY GAIN.pptxUNVEILING VALUE-BASED BIDDING SECRETS FOR MAXIMUM EFFICIENCY GAIN.pptx
UNVEILING VALUE-BASED BIDDING SECRETS FOR MAXIMUM EFFICIENCY GAIN.pptxDoug Hall
 
"Come sfruttare l'automation in Google Search" Piero Marlia - Google
"Come sfruttare l'automation in Google Search" Piero Marlia - Google"Come sfruttare l'automation in Google Search" Piero Marlia - Google
"Come sfruttare l'automation in Google Search" Piero Marlia - GoogleAdplify
 
Why agencies need marketing automation to succeed
Why agencies need marketing automation to succeed Why agencies need marketing automation to succeed
Why agencies need marketing automation to succeed Vendasta Technologies
 
Google Shopping Campaign Structures: What Ifs and What Nexts
Google Shopping Campaign Structures: What Ifs and What NextsGoogle Shopping Campaign Structures: What Ifs and What Nexts
Google Shopping Campaign Structures: What Ifs and What NextsHanapin Marketing
 
Rapid Optimization Application Development Using Excel and Solver
Rapid Optimization Application Development Using Excel and SolverRapid Optimization Application Development Using Excel and Solver
Rapid Optimization Application Development Using Excel and SolverMichael Mina
 
Adwords Implementation
Adwords ImplementationAdwords Implementation
Adwords Implementationtgr3gory
 
Gianluca Binelli — Advanced PPC: Create Your Own Automated Bid Strategies
Gianluca Binelli — Advanced PPC: Create Your Own Automated Bid StrategiesGianluca Binelli — Advanced PPC: Create Your Own Automated Bid Strategies
Gianluca Binelli — Advanced PPC: Create Your Own Automated Bid StrategiesSemrush
 
Marketing Automation in 2016 with Marketingprofs
Marketing Automation in 2016 with MarketingprofsMarketing Automation in 2016 with Marketingprofs
Marketing Automation in 2016 with MarketingprofsVendasta Technologies
 
Advanced Google Analytics 4.0 by Aviso Digital
Advanced Google Analytics 4.0 by Aviso Digital Advanced Google Analytics 4.0 by Aviso Digital
Advanced Google Analytics 4.0 by Aviso Digital Sumeet Mayor
 
Odoo Experience 2018 - Best Practices to Close Deals
Odoo Experience 2018 - Best Practices to Close DealsOdoo Experience 2018 - Best Practices to Close Deals
Odoo Experience 2018 - Best Practices to Close DealsElínAnna Jónasdóttir
 

Similaire à Why You Should (Not) be Using Automated Bidding Strategies: Key Considerations and Case Studies (20)

The Pros and Cons of PPC Bidding
The Pros and Cons of PPC BiddingThe Pros and Cons of PPC Bidding
The Pros and Cons of PPC Bidding
 
Google Analytics Konferenz 2019_Attribution: building a model_Martin Frotzler...
Google Analytics Konferenz 2019_Attribution: building a model_Martin Frotzler...Google Analytics Konferenz 2019_Attribution: building a model_Martin Frotzler...
Google Analytics Konferenz 2019_Attribution: building a model_Martin Frotzler...
 
Paid Search Enhanced Bidding Strategies
Paid Search Enhanced Bidding StrategiesPaid Search Enhanced Bidding Strategies
Paid Search Enhanced Bidding Strategies
 
A Wise Approach to Automated Bidding
A Wise Approach to Automated Bidding A Wise Approach to Automated Bidding
A Wise Approach to Automated Bidding
 
HOW TO LEVERAGE GOOGLE’S SMART AD UNITS FOR PROFITABILITY
HOW TO LEVERAGE GOOGLE’S SMART AD UNITS FOR PROFITABILITYHOW TO LEVERAGE GOOGLE’S SMART AD UNITS FOR PROFITABILITY
HOW TO LEVERAGE GOOGLE’S SMART AD UNITS FOR PROFITABILITY
 
Windsor marketing attribution_webinar
Windsor marketing attribution_webinarWindsor marketing attribution_webinar
Windsor marketing attribution_webinar
 
AUTOMATION & CROSS-CHANNEL
AUTOMATION & CROSS-CHANNELAUTOMATION & CROSS-CHANNEL
AUTOMATION & CROSS-CHANNEL
 
Plot It Audit
Plot It AuditPlot It Audit
Plot It Audit
 
Microsoft Automation Bootcamp - London 2 October 2019
Microsoft Automation Bootcamp - London 2 October 2019Microsoft Automation Bootcamp - London 2 October 2019
Microsoft Automation Bootcamp - London 2 October 2019
 
Love Tiki PPC Audit
Love Tiki PPC AuditLove Tiki PPC Audit
Love Tiki PPC Audit
 
UNVEILING VALUE-BASED BIDDING SECRETS FOR MAXIMUM EFFICIENCY GAIN.pptx
UNVEILING VALUE-BASED BIDDING SECRETS FOR MAXIMUM EFFICIENCY GAIN.pptxUNVEILING VALUE-BASED BIDDING SECRETS FOR MAXIMUM EFFICIENCY GAIN.pptx
UNVEILING VALUE-BASED BIDDING SECRETS FOR MAXIMUM EFFICIENCY GAIN.pptx
 
"Come sfruttare l'automation in Google Search" Piero Marlia - Google
"Come sfruttare l'automation in Google Search" Piero Marlia - Google"Come sfruttare l'automation in Google Search" Piero Marlia - Google
"Come sfruttare l'automation in Google Search" Piero Marlia - Google
 
Why agencies need marketing automation to succeed
Why agencies need marketing automation to succeed Why agencies need marketing automation to succeed
Why agencies need marketing automation to succeed
 
Google Shopping Campaign Structures: What Ifs and What Nexts
Google Shopping Campaign Structures: What Ifs and What NextsGoogle Shopping Campaign Structures: What Ifs and What Nexts
Google Shopping Campaign Structures: What Ifs and What Nexts
 
Rapid Optimization Application Development Using Excel and Solver
Rapid Optimization Application Development Using Excel and SolverRapid Optimization Application Development Using Excel and Solver
Rapid Optimization Application Development Using Excel and Solver
 
Adwords Implementation
Adwords ImplementationAdwords Implementation
Adwords Implementation
 
Gianluca Binelli — Advanced PPC: Create Your Own Automated Bid Strategies
Gianluca Binelli — Advanced PPC: Create Your Own Automated Bid StrategiesGianluca Binelli — Advanced PPC: Create Your Own Automated Bid Strategies
Gianluca Binelli — Advanced PPC: Create Your Own Automated Bid Strategies
 
Marketing Automation in 2016 with Marketingprofs
Marketing Automation in 2016 with MarketingprofsMarketing Automation in 2016 with Marketingprofs
Marketing Automation in 2016 with Marketingprofs
 
Advanced Google Analytics 4.0 by Aviso Digital
Advanced Google Analytics 4.0 by Aviso Digital Advanced Google Analytics 4.0 by Aviso Digital
Advanced Google Analytics 4.0 by Aviso Digital
 
Odoo Experience 2018 - Best Practices to Close Deals
Odoo Experience 2018 - Best Practices to Close DealsOdoo Experience 2018 - Best Practices to Close Deals
Odoo Experience 2018 - Best Practices to Close Deals
 

Plus de Hanapin Marketing

Last Click is Outdated: Learn to Use Google Analytics’ New Attribution Beta
Last Click is Outdated: Learn to Use Google Analytics’ New Attribution BetaLast Click is Outdated: Learn to Use Google Analytics’ New Attribution Beta
Last Click is Outdated: Learn to Use Google Analytics’ New Attribution BetaHanapin Marketing
 
5 Reasons to Use Amazon DSP in 2020
5 Reasons to Use Amazon DSP in 20205 Reasons to Use Amazon DSP in 2020
5 Reasons to Use Amazon DSP in 2020Hanapin Marketing
 
Identify & Leverage YouTube Audiences for Organic & Paid Growth
Identify & Leverage YouTube Audiences for Organic & Paid GrowthIdentify & Leverage YouTube Audiences for Organic & Paid Growth
Identify & Leverage YouTube Audiences for Organic & Paid GrowthHanapin Marketing
 
Connect the Likes: Tracking Visits to Improve Facebook Ads Performance
Connect the Likes: Tracking Visits to Improve Facebook Ads PerformanceConnect the Likes: Tracking Visits to Improve Facebook Ads Performance
Connect the Likes: Tracking Visits to Improve Facebook Ads PerformanceHanapin Marketing
 
Hiring a Marketing Agency? Critical Questions that Drive the Right Decision
Hiring a Marketing Agency? Critical Questions that Drive the Right DecisionHiring a Marketing Agency? Critical Questions that Drive the Right Decision
Hiring a Marketing Agency? Critical Questions that Drive the Right DecisionHanapin Marketing
 
Diving Deeper into Programmatic: Succeeding Beyond the PPC Landscape
Diving Deeper into Programmatic: Succeeding Beyond the PPC LandscapeDiving Deeper into Programmatic: Succeeding Beyond the PPC Landscape
Diving Deeper into Programmatic: Succeeding Beyond the PPC LandscapeHanapin Marketing
 
The Rise of Conversational Marketing - How to Leverage Chatbots for PPC
The Rise of Conversational Marketing - How to Leverage Chatbots for PPCThe Rise of Conversational Marketing - How to Leverage Chatbots for PPC
The Rise of Conversational Marketing - How to Leverage Chatbots for PPCHanapin Marketing
 
The Untapped Power of Quora Ads
The Untapped Power of Quora AdsThe Untapped Power of Quora Ads
The Untapped Power of Quora AdsHanapin Marketing
 
Google is Getting More Expensive - How to Get Around that with Better Audienc...
Google is Getting More Expensive - How to Get Around that with Better Audienc...Google is Getting More Expensive - How to Get Around that with Better Audienc...
Google is Getting More Expensive - How to Get Around that with Better Audienc...Hanapin Marketing
 
Investing in Brand Campaigns? Post-Click Experience is Key
Investing in Brand Campaigns? Post-Click Experience is KeyInvesting in Brand Campaigns? Post-Click Experience is Key
Investing in Brand Campaigns? Post-Click Experience is KeyHanapin Marketing
 
How to Maximize the Impact of Video Content with Retargeting
How to Maximize the Impact of Video Content with RetargetingHow to Maximize the Impact of Video Content with Retargeting
How to Maximize the Impact of Video Content with RetargetingHanapin Marketing
 
Machine Learning Tech You Could and Should Use Tomorrow
Machine Learning Tech You Could and Should Use TomorrowMachine Learning Tech You Could and Should Use Tomorrow
Machine Learning Tech You Could and Should Use TomorrowHanapin Marketing
 
Create a PPC Playground For Your Clients: How To Co-Create Your Ad Customizers
Create a PPC Playground For Your Clients: How To Co-Create Your Ad CustomizersCreate a PPC Playground For Your Clients: How To Co-Create Your Ad Customizers
Create a PPC Playground For Your Clients: How To Co-Create Your Ad CustomizersHanapin Marketing
 
Building Optimised Post-Click Experiences
Building Optimised Post-Click ExperiencesBuilding Optimised Post-Click Experiences
Building Optimised Post-Click ExperiencesHanapin Marketing
 
Keynote: Using Creativity in Advertising to Stay Ahead
Keynote: Using Creativity in Advertising to Stay AheadKeynote: Using Creativity in Advertising to Stay Ahead
Keynote: Using Creativity in Advertising to Stay AheadHanapin Marketing
 
Keynote: How to Supercharge Your PPC Career
Keynote: How to Supercharge Your PPC CareerKeynote: How to Supercharge Your PPC Career
Keynote: How to Supercharge Your PPC CareerHanapin Marketing
 
Ad Extensions as a Lever for Powerful Text Ads
Ad Extensions as a Lever for Powerful Text AdsAd Extensions as a Lever for Powerful Text Ads
Ad Extensions as a Lever for Powerful Text AdsHanapin Marketing
 
What I Learned In One Year Marketing on Pinterest..Yes It Was Profitable
What I Learned In One Year Marketing on Pinterest..Yes It Was ProfitableWhat I Learned In One Year Marketing on Pinterest..Yes It Was Profitable
What I Learned In One Year Marketing on Pinterest..Yes It Was ProfitableHanapin Marketing
 
YouTube - The Most Valuable Impression on the Web (Creative, Targeting, & Str...
YouTube - The Most Valuable Impression on the Web (Creative, Targeting, & Str...YouTube - The Most Valuable Impression on the Web (Creative, Targeting, & Str...
YouTube - The Most Valuable Impression on the Web (Creative, Targeting, & Str...Hanapin Marketing
 

Plus de Hanapin Marketing (20)

Last Click is Outdated: Learn to Use Google Analytics’ New Attribution Beta
Last Click is Outdated: Learn to Use Google Analytics’ New Attribution BetaLast Click is Outdated: Learn to Use Google Analytics’ New Attribution Beta
Last Click is Outdated: Learn to Use Google Analytics’ New Attribution Beta
 
5 Reasons to Use Amazon DSP in 2020
5 Reasons to Use Amazon DSP in 20205 Reasons to Use Amazon DSP in 2020
5 Reasons to Use Amazon DSP in 2020
 
Identify & Leverage YouTube Audiences for Organic & Paid Growth
Identify & Leverage YouTube Audiences for Organic & Paid GrowthIdentify & Leverage YouTube Audiences for Organic & Paid Growth
Identify & Leverage YouTube Audiences for Organic & Paid Growth
 
Connect the Likes: Tracking Visits to Improve Facebook Ads Performance
Connect the Likes: Tracking Visits to Improve Facebook Ads PerformanceConnect the Likes: Tracking Visits to Improve Facebook Ads Performance
Connect the Likes: Tracking Visits to Improve Facebook Ads Performance
 
Hiring a Marketing Agency? Critical Questions that Drive the Right Decision
Hiring a Marketing Agency? Critical Questions that Drive the Right DecisionHiring a Marketing Agency? Critical Questions that Drive the Right Decision
Hiring a Marketing Agency? Critical Questions that Drive the Right Decision
 
Diving Deeper into Programmatic: Succeeding Beyond the PPC Landscape
Diving Deeper into Programmatic: Succeeding Beyond the PPC LandscapeDiving Deeper into Programmatic: Succeeding Beyond the PPC Landscape
Diving Deeper into Programmatic: Succeeding Beyond the PPC Landscape
 
The Rise of Conversational Marketing - How to Leverage Chatbots for PPC
The Rise of Conversational Marketing - How to Leverage Chatbots for PPCThe Rise of Conversational Marketing - How to Leverage Chatbots for PPC
The Rise of Conversational Marketing - How to Leverage Chatbots for PPC
 
The Untapped Power of Quora Ads
The Untapped Power of Quora AdsThe Untapped Power of Quora Ads
The Untapped Power of Quora Ads
 
Google is Getting More Expensive - How to Get Around that with Better Audienc...
Google is Getting More Expensive - How to Get Around that with Better Audienc...Google is Getting More Expensive - How to Get Around that with Better Audienc...
Google is Getting More Expensive - How to Get Around that with Better Audienc...
 
Investing in Brand Campaigns? Post-Click Experience is Key
Investing in Brand Campaigns? Post-Click Experience is KeyInvesting in Brand Campaigns? Post-Click Experience is Key
Investing in Brand Campaigns? Post-Click Experience is Key
 
How to Maximize the Impact of Video Content with Retargeting
How to Maximize the Impact of Video Content with RetargetingHow to Maximize the Impact of Video Content with Retargeting
How to Maximize the Impact of Video Content with Retargeting
 
Machine Learning Tech You Could and Should Use Tomorrow
Machine Learning Tech You Could and Should Use TomorrowMachine Learning Tech You Could and Should Use Tomorrow
Machine Learning Tech You Could and Should Use Tomorrow
 
Create a PPC Playground For Your Clients: How To Co-Create Your Ad Customizers
Create a PPC Playground For Your Clients: How To Co-Create Your Ad CustomizersCreate a PPC Playground For Your Clients: How To Co-Create Your Ad Customizers
Create a PPC Playground For Your Clients: How To Co-Create Your Ad Customizers
 
Building Optimised Post-Click Experiences
Building Optimised Post-Click ExperiencesBuilding Optimised Post-Click Experiences
Building Optimised Post-Click Experiences
 
Keynote: Using Creativity in Advertising to Stay Ahead
Keynote: Using Creativity in Advertising to Stay AheadKeynote: Using Creativity in Advertising to Stay Ahead
Keynote: Using Creativity in Advertising to Stay Ahead
 
Keynote: How to Supercharge Your PPC Career
Keynote: How to Supercharge Your PPC CareerKeynote: How to Supercharge Your PPC Career
Keynote: How to Supercharge Your PPC Career
 
Ad Extensions as a Lever for Powerful Text Ads
Ad Extensions as a Lever for Powerful Text AdsAd Extensions as a Lever for Powerful Text Ads
Ad Extensions as a Lever for Powerful Text Ads
 
What I Learned In One Year Marketing on Pinterest..Yes It Was Profitable
What I Learned In One Year Marketing on Pinterest..Yes It Was ProfitableWhat I Learned In One Year Marketing on Pinterest..Yes It Was Profitable
What I Learned In One Year Marketing on Pinterest..Yes It Was Profitable
 
Data Driven Advertising
Data Driven AdvertisingData Driven Advertising
Data Driven Advertising
 
YouTube - The Most Valuable Impression on the Web (Creative, Targeting, & Str...
YouTube - The Most Valuable Impression on the Web (Creative, Targeting, & Str...YouTube - The Most Valuable Impression on the Web (Creative, Targeting, & Str...
YouTube - The Most Valuable Impression on the Web (Creative, Targeting, & Str...
 

Dernier

History of JWT by The Knowledge Center.pdf
History of JWT by The Knowledge Center.pdfHistory of JWT by The Knowledge Center.pdf
History of JWT by The Knowledge Center.pdfwilliam charnock
 
The power of SEO-driven market intelligence
The power of SEO-driven market intelligenceThe power of SEO-driven market intelligence
The power of SEO-driven market intelligenceHinde Lamrani
 
Best digital marketing e-book form bignners
Best digital marketing e-book form bignnersBest digital marketing e-book form bignners
Best digital marketing e-book form bignnersmuntasibkhan58
 
5 Digital Marketing Tips | Devherds Software Solutions
5 Digital Marketing Tips | Devherds Software Solutions5 Digital Marketing Tips | Devherds Software Solutions
5 Digital Marketing Tips | Devherds Software SolutionsDevherds Software Solutions
 
Exploring Web 3.0 Growth marketing: Navigating the Future of the Internet
Exploring Web 3.0 Growth marketing: Navigating the Future of the InternetExploring Web 3.0 Growth marketing: Navigating the Future of the Internet
Exploring Web 3.0 Growth marketing: Navigating the Future of the Internetnehapardhi711
 
Understand the Key differences between SMO and SMM
Understand the Key differences between SMO and SMMUnderstand the Key differences between SMO and SMM
Understand the Key differences between SMO and SMMsearchextensionin
 
A Comprehensive Guide to Technical SEO | Banyanbrain
A Comprehensive Guide to Technical SEO | BanyanbrainA Comprehensive Guide to Technical SEO | Banyanbrain
A Comprehensive Guide to Technical SEO | BanyanbrainBanyanbrain
 
Digital Marketing in 5G Era - Digital Transformation in 5G Age
Digital Marketing in 5G Era - Digital Transformation in 5G AgeDigital Marketing in 5G Era - Digital Transformation in 5G Age
Digital Marketing in 5G Era - Digital Transformation in 5G AgeDigiKarishma
 
8 distribution in rural mkts.ppt Rural Marketing
8 distribution in rural mkts.ppt Rural Marketing8 distribution in rural mkts.ppt Rural Marketing
8 distribution in rural mkts.ppt Rural Marketingpshirsat
 
Richard van der Velde, Technical Support Lead for Cookiebot @CMP – “Artificia...
Richard van der Velde, Technical Support Lead for Cookiebot @CMP – “Artificia...Richard van der Velde, Technical Support Lead for Cookiebot @CMP – “Artificia...
Richard van der Velde, Technical Support Lead for Cookiebot @CMP – “Artificia...Associazione Digital Days
 
Master the art of Social Selling to increase sales by fostering relationships...
Master the art of Social Selling to increase sales by fostering relationships...Master the art of Social Selling to increase sales by fostering relationships...
Master the art of Social Selling to increase sales by fostering relationships...VereigenMedia1
 
Digital Marketing Courses In Pune- school Of Internet Marketing
Digital Marketing Courses In Pune- school Of Internet MarketingDigital Marketing Courses In Pune- school Of Internet Marketing
Digital Marketing Courses In Pune- school Of Internet MarketingShauryaBadaya
 
Professional Sales Representative by Sahil Srivastava.pptx
Professional Sales Representative by Sahil Srivastava.pptxProfessional Sales Representative by Sahil Srivastava.pptx
Professional Sales Representative by Sahil Srivastava.pptxSahil Srivastava
 
15 Tactics to Scale Your Trade Show Marketing Strategy
15 Tactics to Scale Your Trade Show Marketing Strategy15 Tactics to Scale Your Trade Show Marketing Strategy
15 Tactics to Scale Your Trade Show Marketing StrategyBlue Atlas Marketing
 
Francesco d’Angela, Service Designer di @HintoGroup- “Oltre la Frontiera Crea...
Francesco d’Angela, Service Designer di @HintoGroup- “Oltre la Frontiera Crea...Francesco d’Angela, Service Designer di @HintoGroup- “Oltre la Frontiera Crea...
Francesco d’Angela, Service Designer di @HintoGroup- “Oltre la Frontiera Crea...Associazione Digital Days
 
Dave Cousin TW-BERT Good for Users, Good for SEOsBrighton SEO Deck
Dave Cousin TW-BERT Good for Users, Good for SEOsBrighton SEO DeckDave Cousin TW-BERT Good for Users, Good for SEOsBrighton SEO Deck
Dave Cousin TW-BERT Good for Users, Good for SEOsBrighton SEO DeckOban International
 
2024's Top PPC Tactics: Triple Your Google Ads Local Leads
2024's Top PPC Tactics: Triple Your Google Ads Local Leads2024's Top PPC Tactics: Triple Your Google Ads Local Leads
2024's Top PPC Tactics: Triple Your Google Ads Local LeadsSearch Engine Journal
 
Agencia Marketing Branding Examen Fundamentals Digital Marketing Google Abril...
Agencia Marketing Branding Examen Fundamentals Digital Marketing Google Abril...Agencia Marketing Branding Examen Fundamentals Digital Marketing Google Abril...
Agencia Marketing Branding Examen Fundamentals Digital Marketing Google Abril...Marketing BRANDING
 
Creating a Successful Digital Marketing Campaign.pdf
Creating a Successful Digital Marketing Campaign.pdfCreating a Successful Digital Marketing Campaign.pdf
Creating a Successful Digital Marketing Campaign.pdfgopzzzin
 
SEO and Digital PR - How to Connect Your Teams to Maximise Success
SEO and Digital PR - How to Connect Your Teams to Maximise SuccessSEO and Digital PR - How to Connect Your Teams to Maximise Success
SEO and Digital PR - How to Connect Your Teams to Maximise SuccessLiv Day
 

Dernier (20)

History of JWT by The Knowledge Center.pdf
History of JWT by The Knowledge Center.pdfHistory of JWT by The Knowledge Center.pdf
History of JWT by The Knowledge Center.pdf
 
The power of SEO-driven market intelligence
The power of SEO-driven market intelligenceThe power of SEO-driven market intelligence
The power of SEO-driven market intelligence
 
Best digital marketing e-book form bignners
Best digital marketing e-book form bignnersBest digital marketing e-book form bignners
Best digital marketing e-book form bignners
 
5 Digital Marketing Tips | Devherds Software Solutions
5 Digital Marketing Tips | Devherds Software Solutions5 Digital Marketing Tips | Devherds Software Solutions
5 Digital Marketing Tips | Devherds Software Solutions
 
Exploring Web 3.0 Growth marketing: Navigating the Future of the Internet
Exploring Web 3.0 Growth marketing: Navigating the Future of the InternetExploring Web 3.0 Growth marketing: Navigating the Future of the Internet
Exploring Web 3.0 Growth marketing: Navigating the Future of the Internet
 
Understand the Key differences between SMO and SMM
Understand the Key differences between SMO and SMMUnderstand the Key differences between SMO and SMM
Understand the Key differences between SMO and SMM
 
A Comprehensive Guide to Technical SEO | Banyanbrain
A Comprehensive Guide to Technical SEO | BanyanbrainA Comprehensive Guide to Technical SEO | Banyanbrain
A Comprehensive Guide to Technical SEO | Banyanbrain
 
Digital Marketing in 5G Era - Digital Transformation in 5G Age
Digital Marketing in 5G Era - Digital Transformation in 5G AgeDigital Marketing in 5G Era - Digital Transformation in 5G Age
Digital Marketing in 5G Era - Digital Transformation in 5G Age
 
8 distribution in rural mkts.ppt Rural Marketing
8 distribution in rural mkts.ppt Rural Marketing8 distribution in rural mkts.ppt Rural Marketing
8 distribution in rural mkts.ppt Rural Marketing
 
Richard van der Velde, Technical Support Lead for Cookiebot @CMP – “Artificia...
Richard van der Velde, Technical Support Lead for Cookiebot @CMP – “Artificia...Richard van der Velde, Technical Support Lead for Cookiebot @CMP – “Artificia...
Richard van der Velde, Technical Support Lead for Cookiebot @CMP – “Artificia...
 
Master the art of Social Selling to increase sales by fostering relationships...
Master the art of Social Selling to increase sales by fostering relationships...Master the art of Social Selling to increase sales by fostering relationships...
Master the art of Social Selling to increase sales by fostering relationships...
 
Digital Marketing Courses In Pune- school Of Internet Marketing
Digital Marketing Courses In Pune- school Of Internet MarketingDigital Marketing Courses In Pune- school Of Internet Marketing
Digital Marketing Courses In Pune- school Of Internet Marketing
 
Professional Sales Representative by Sahil Srivastava.pptx
Professional Sales Representative by Sahil Srivastava.pptxProfessional Sales Representative by Sahil Srivastava.pptx
Professional Sales Representative by Sahil Srivastava.pptx
 
15 Tactics to Scale Your Trade Show Marketing Strategy
15 Tactics to Scale Your Trade Show Marketing Strategy15 Tactics to Scale Your Trade Show Marketing Strategy
15 Tactics to Scale Your Trade Show Marketing Strategy
 
Francesco d’Angela, Service Designer di @HintoGroup- “Oltre la Frontiera Crea...
Francesco d’Angela, Service Designer di @HintoGroup- “Oltre la Frontiera Crea...Francesco d’Angela, Service Designer di @HintoGroup- “Oltre la Frontiera Crea...
Francesco d’Angela, Service Designer di @HintoGroup- “Oltre la Frontiera Crea...
 
Dave Cousin TW-BERT Good for Users, Good for SEOsBrighton SEO Deck
Dave Cousin TW-BERT Good for Users, Good for SEOsBrighton SEO DeckDave Cousin TW-BERT Good for Users, Good for SEOsBrighton SEO Deck
Dave Cousin TW-BERT Good for Users, Good for SEOsBrighton SEO Deck
 
2024's Top PPC Tactics: Triple Your Google Ads Local Leads
2024's Top PPC Tactics: Triple Your Google Ads Local Leads2024's Top PPC Tactics: Triple Your Google Ads Local Leads
2024's Top PPC Tactics: Triple Your Google Ads Local Leads
 
Agencia Marketing Branding Examen Fundamentals Digital Marketing Google Abril...
Agencia Marketing Branding Examen Fundamentals Digital Marketing Google Abril...Agencia Marketing Branding Examen Fundamentals Digital Marketing Google Abril...
Agencia Marketing Branding Examen Fundamentals Digital Marketing Google Abril...
 
Creating a Successful Digital Marketing Campaign.pdf
Creating a Successful Digital Marketing Campaign.pdfCreating a Successful Digital Marketing Campaign.pdf
Creating a Successful Digital Marketing Campaign.pdf
 
SEO and Digital PR - How to Connect Your Teams to Maximise Success
SEO and Digital PR - How to Connect Your Teams to Maximise SuccessSEO and Digital PR - How to Connect Your Teams to Maximise Success
SEO and Digital PR - How to Connect Your Teams to Maximise Success
 

Why You Should (Not) be Using Automated Bidding Strategies: Key Considerations and Case Studies

  • 1. Why You Should (Not) be Using Automated Bidding Strategies Sven O. Wilhelm | SEM Manager
  • 2. Why am I standing here today? ● Extensive experience with different 3P bidding solutions as well as Google´s Smart Bidding and other strategies in different environments ● Interesting challenges came up in those years ● Information available online is not always helpful
  • 3. Session Outcomes (1) I will answer the following questions: ● What are the implications for account managers in general? ● Is there a substantial increase in performance that would make it imperative to use automated bidding strategies? ● Which framework is required to use automated bidding strategies successfully and how to measure success? ● How to avoid common pitfalls?
  • 4. Session Outcomes (2) I will not answer: ● How machine learning works for PPC accounts ● How to use Adwords Scripts for bidding ● Which 3P software works best
  • 5. First encounters (1) ● Marin Search used for account management ● Me: (designated) super user ● My colleague Livia implemented a bid strategy for position bidding for her most important keywords ● No max cpc limitations suggested for bid strategies by Marin Account Managers ● So, what happened next...?
  • 6. First encounters (2) ● Learning phase: bids pushed up to ~15$ max CPC ● Livia freaked out and switched back to manual bidding after a couple of days Why did she freak out? ● She completely lost control over her most important keywords ● Actions performed by strategy were counter-intuitive ● The initial performance was horrible (It was working well later on.)
  • 7. Changes in the competitive landscape ● Pressure on advertisers increases to move away from manual bidding ● Choice of strategies is extensive: target CPA*, target ROAS*, maximise clicks, viewable CPM, maximise conversions, target search page location, target outranking share, enhanced CPC, monthly spend (in addition, you can create your own strategies) *Smart Bidding entails optimization for conversions/revenue
  • 8. What are the implications for account management? (1) Interesting questions in this context: ● Will automated bidding solutions redefine the role of PPC account managers? ● Are there actually scenarios where automation doesn´t make sense?
  • 9. What are the implications for account management? (2) Will automated bidding solutions redefine the role of PPC account managers? Yes... ● 3P bidding solutions as well as Google´s internal bidding solutions, Adwords Express, Dynamic Search Campaigns, Responsive Search Ads, “optimize” ad rotation settings, etc. are changing how account managers work ● General shift from micro-management towards higher-level strategy ● Time spent on bid management can be used in a better way ...but ● Smaller accounts or low conversion campaigns will still require skilled manual work for good performance ● Strategy, set-up, copywriting, etc. still essential
  • 10. What are the implications for account management? (3) Are there actually scenarios where automated bidding won´t make sense? Business Goals vs. Bid Strategies ● Leads differ in value, so there is a general conflict between good performance (through high conversion numbers) and differentiation by business goals ● Segments of your portfolio are too small to run tROAS or tCPA strategies. ● Automated bidding strategies need time to learn. This means that ad-hoc requests from management to “push these products now” will need to run outside of the Smart Bidding strategy set-up
  • 11. What about performance uplift? Yes, there is a performace uplift, but... ● It makes a difference, if you optimise for tROAS or tCPA ● Biggest performance up-lift in campaigns with high conversion-volume ● Results differed a lot based on campaign type, volume and how portfolios were put together ● Results also differ based on the amount of care the accounts received in the past ● If performance remains stable, you still gain valuable time
  • 12. Case studies ● Case Study #1 – (tROAS) Drastic increase in spending ● Case Study #2 – (tROAS) Shift to certain products in Google Shopping ● Case Study #3 – (tROAS) Increased CPC, decreased traffic
  • 13. Case Study #1 – (tROAS) Drastic increase in spending (1) ● Target ROAS: 400% ● Great performance for last couple of months ● Accidentally huge sale of 16.6k ● Spending increased dramatically without corresponding increase in revenue
  • 14. Case Study #1 – (tROAS) Drastic increase in spending (2) ERS differs a lot between campaigns in same portfolio strategy
  • 15. Case Study #1 – (tROAS) Drastic increase in spending (3) Take aways: ● Outliers in revenue may impact your kpis significantly ● Set budgets tightly to decrease chances for significant and sudden increases in spending ● Your portfolio strategy balances cost effectively among campaigns ● This could potentially collide with other business goals
  • 16. Case Study #2 – (tROAS) Shift to certain produtcs in Google Shopping (1) Body Text Here
  • 17. Case Study #2 – (tROAS) Shift to certain produtcs in Google Shopping (2) Body Text Here
  • 18. Case Study #2 – (tROAS) Shift to certain produtcs in Google Shopping (3) Body Text Here
  • 19. Case Study #2 – (tROAS) Shift to certain produtcs in Google Shopping (4) Take aways: ● Google will distribute traffic differently between biddable items ● This traffic shift will usually benefit you ● If you need to sell off certain products: Doing it manually might be better ● In the above example: Shift to different products led to more revenue and lower cost (Other pool tables filled the gap)
  • 20. Case Study #3 – (tROAS) increased CPC, decreased traffic (1) Smart Bidding tROAS in a longer-running portfolio: ● clicks: -23% ● avg. CPC: + 48% ● avg. Position: - 8% (lower position) ● revenue: +36% ● cost: +14% ● mobile CVR: +47%
  • 21. Case Study #3 – (tROAS) increased CPC, decreased traffic (2) Take aways: ● It is important to look at the right metrics ● Mobile performance may improve ● If you report on traffic figures, make sure to manage expectations before launching Smart Bidding
  • 22. Which framework is required to use automated bidding strategies successfully and how to measure success? (1) ● Do not choose a “one solution fits all“ approach ● Keep in mind: large portfolios allow for better trade-offs ● Split your campaigns by business goals. Do not put campaigns or ad groups in one strategy that have different CPA or ROAS targets ● Set appropriate target CPA or target ROAS goals, based on historical performance (usually last 30 days) ● Do not let bid strategies run with budget limitations ● Allow enough time for evaluation of results
  • 23. Which framework is required to use automated bidding strategies successfully and how to measure success? (2) ● For Smart Bidding, look at the right metrics (only conversion metrics) ● Keep in mind that some KPIs may go down (like clicks, impressions) ● Consider which attribution model you are using (Using a last-click attribution model means you are optimizing for last click performance.) ● Keep an eye on keywords with strong seasonal fluctuation and low volume (Look-back modeling, clustering, etc. are supposed to solve this.) ● Enrich your campaigns with audiences to provide additional data points for Smart Bidding strategies (e.g. regular remarketing lists & in-market audiences)
  • 24. A great pitfall to avoid... When you switch back from Google´s Smart Bidding to manual bidding, check your bids J
  • 25. Action Items ● Leverage automated bidding strategies to achieve better results or save time ● Do not assume that automated bidding strategies will solve all your problems ● Let account managers evaluate and decide which solution works best for their accounts ● The landscape is changing fast – try out new solutions from time to time ● Start small experiments, especially with Google internal solutions (no additional cost involved) ● Test 3P providers and let them help you with their knowledge and technology