SlideShare a Scribd company logo
1 of 36
Download to read offline
ARCHITECTING
HIGHLY AVAILABLE
CLOUD INTEGRATIONS
Richard Seroter
@rseroter
HAVE YOU EVER
BUILT A MODEL PLANE?
A GOOD MODEL DEPENDS
ON STRONG GLUE.
WE WANT A DURABLE
CONNECTIONS BETWEEN
OUR “THINGS.”
1 CORE PATTERNS
2 CONFIGURING FOR AVAILABILITY
3 PUTTING IT ALL TOGETHER
1 CORE PATTERNS
2 CONFIGURING FOR AVAILABILITY
3 PUTTING IT ALL TOGETHER
TEMPORARY HICCUP IN NETWORK,
DATABASE, SERVICE, OR ELSEWHERE
OFTEN RESOLVED THROUGH RETRIES
MAY BE HANDLED GRACEFULLY FOR
YOU BY PLATFORM OR SDK
CONSIDERATIONS FOR BUSINESS
NEED, CONTINUED FAILURE,
TRANSACTIONS
RETRY TRANSIENT
FAILURES
SCALE OUT VIA MORE INSTANCES
ABOUT ACTIVELY USING (HEALTHY)
NODES TO SHARE WORK
APPLIES TO COMPUTE, MESSAGING,
EVENT STREAMING, DATA AND EVEN
NETWORKING
IDEALLY, THIS IS BUILT IN
AUTOSCALING MAKES THIS FEEL
MORE SEAMLESS
LOAD BALANCE
REDUNDANT
INSTANCES
REPLICATE YOUR
DATA
BOTH TRANSACTIONAL AND
METADATA
CONSIDER HOW YOU READ AND
WRITE DATA
CROSS-REGION REPLICATION IS
POWERFUL, BUT LAGS DUE TO
LATENCY
MAY BE AS MUCH ABOUT DISASTER
RECOVERY AS HIGH AVAILABILITY
THROTTLE SOME
OF YOUR USERS
ONE USER’S LOAD CAN IMPACT ALL
OTHER INTEGRATION TENANTS
MAY REJECT REQUESTS OR PROVIDE
LOWER QUALITY RESULTS
SHOULD BE DONE IN A VISIBLE WAY
INTRODUCE
LOAD LEVELING
PROTECTS BACKEND SYSTEMS
MIDDLEWARE GETS BEAT UP, NOT
TARGET SYSTEMS
CAN SAVE YOU FROM NON-STOP
AUTOSCALING
SECURE WITH
LEAST PRIVILEGE,
ACCESS SHOULD BE AS RESTRICTIVE
AS POSSIBLE
TURN ON ENCRYPTION WITH EVERY
POSSIBLE SERVICE
STAY ONLINE BY PROTECTING
AGAINST DDOS ATTACKS
AND ANTI-DDOS
ENCRYPTION,
AUTOMATE
BUILD AND
THIS HELPS YOU QUICKLY RESTORE
SERVICE IN A SECONDARY REGION
PROVISION USING REPEATABLE
TEMPLATES AND SCRIPTS
UPDATE STAGES
1 CORE PATTERNS
2 CONFIGURING FOR AVAILABILITY
3 PUTTING IT ALL TOGETHER
AZURE STORAGE
SERVICES
WHAT IT DOES FOR YOU
GET FILE, DISK, BLOB STORAGE
FOUR REPLICATION OPTIONS
LOCALLY-REDUNDANT
ZONE-REDUNDANT
GEO-REDUNDANT
READ-ACCESS GEO-REDUNDANT
OFFERS ENCRYPTION AT REST
WHAT YOU HAVE TO DO
SET REPLICATION OPTION
CREATE STRATEGY FOR ACCESSING
SECONDARY STORAGE
DECIDE ON SERVER AND/OR
CLIENT-SIDE ENCRYPTION
AZURE STORAGE SERVICES
AZURE SQL
DATABASE
WHAT IT DOES FOR YOU
USES HIGHLY AVAILABLE STORAGE
ABILITY TO SCALE UP OR OUT
EASILY CREATE (AND CHAIN) READ
REPLICAS
BUILT IN BACKUP AND RESTORE
INCLUDES THREAT DETECTION
WHAT YOU HAVE TO DO
CREATE REPLICAS
DECIDE WHEN TO SCALE
HORIZONTALLY OR VERTICALLY
RESTORE DATABASE FROM
BACKUP
TURN ON THREAT DETECTION
AZURE SQL DATABASE
AZURE COSMOS
DB
WHAT IT DOES FOR YOU
99.999% AVAILABILITY FOR READS
AUTOMATICALLY PARTITIONS
DATA, REPLICATES IT
SUPPORTS MULTIPLE
CONSISTENCY LEVELS
AUTOMATIC AND MANUAL
FAILOVER
WHAT YOU HAVE TO DO
DEFINE PARTITION KEY,
THROUGHPUT, REPLICATION
POLICIES
CONFIGURE REGIONS FOR READ,
WRITE, OR READ/WRITE
CHOOSE CONSISTENCY FOR DB,
INDIVIDUAL REQUESTS
DECIDE TO TRIGGER A MANUAL
FAILOVER
AZURE COSMOS DB
AZURE SERVICE
BUS
WHAT IT DOES FOR YOU
RESILIENCE WITHIN A REGION
INITIATES THROTTLING TO
PREVENT OVERLOAD
AUTOMATIC PARTITIONING
OFFERS GEO-DISASTER RECOVERY
WHAT YOU HAVE TO DO
SELECT MESSAGE RETENTION TIME
CHOOSE TO USE PARTITIONING
USE PREMIUM MESSAGING FOR
RESOURCE ISOLATION
CONFIGURE GEO-DISASTER
RECOVERY
AZURE SERVICE BUS
AZURE EVENT
HUBS
WHAT IT DOES FOR YOU
HANDLES MASSIVE INGEST LOAD
BUILT-IN PARTITIONING SUPPORT
AUTO-INFLATE ADDS THROUGHPUT
UNITS TO MEET NEED
SUPPORTS GEO-DISASTER
RECOVERY
WHAT YOU HAVE TO DO
CONFIGURE INITIAL THROUGHPUT
UNITS
DEFINE YOUR PARTITION COUNT
CONFIGURE GEO-DISASTER
RECOVERY
AZURE EVENT HUBS
AZURE LOGIC
APPS
WHAT IT DOES FOR YOU
IN-REGION HA IS BUILT IN
IMPOSE LIMITS ON TIMEOUT,
MESSAGE SIZE
SUPPORTS SYNCHRONIZING B2B
RESOURCES TO ANOTHER REGION
WHAT YOU HAVE TO DO
CONFIGURE B2B RESOURCE
SYNCHRONIZATION
CONFIGURE INTEGRATIONS TO
HIGHLY AVAILABLE ENDPOINTS
DUPLICATE LOGIC APP IN OTHER
REGIONS
AZURE LOGIC APPS
AZURE FUNCTIONS
WHAT IT DOES FOR YOU
SCALES UNDERLYING RESOURCES
AUTOMATICALLY WITH
CONSUMPTION PLAN
SCALE VMS AUTOMATICALLY OR
MANUALLY IN APP SERVICE PLAN
BASIC UPTIME SLA AT THIS TIME
WHAT YOU HAVE TO DO
CHOOSE PLAN TYPE
SET SCALING POLICIES WHEN
USING APP SERVICE PLAN
REPLICATE FUNCTIONS TO OTHER
REGIONS
AZURE FUNCTIONS
AZURE VPN
GATEWAY
WHAT IT DOES FOR YOU
DEPLOYS ACTIVE-STANDBY
INSTANCES BY DEFAULT
RUN AS A MANAGED SERVICE AND
YOU NEVER ACCESS UNDERLYING
VIRTUAL MACHINES
WHAT YOU HAVE TO DO
RESIZE AS NEEDED
CONFIGURE REDUNDANT ON-PREM
VPN DEVICES
CREATE ACTIVE-ACTIVE VPN
GATEWAY CONFIGURATIONS
SETUP ACTIVE-ACTIVE ON BOTH
SIDES
AZURE VPN GATEWAY
1 CORE PATTERNS
2 CONFIGURING FOR AVAILABILITY
3 PUTTING IT ALL TOGETHER
ONLY INTEGRATE WITH
HIGHLY AVAILABLE ENDPOINTS
CLEARLY UNDERSTAND
WHAT SERVICES
FAILOVER TOGETHER
REGULARLY PERFORM
CHAOS TESTING
1 CORE PATTERNS
2 CONFIGURING FOR AVAILABILITY
3 PUTTING IT ALL TOGETHER
RESOURCES
NEW PLURALSIGHT COURSE (https://bit.ly/2sJtzuj)
MICROSOFT H/A GUIDES (https://bit.ly/2r2m7Iu)
@RSEROTER

More Related Content

What's hot

More Than Monitoring: How Observability Takes You From Firefighting to Fire P...
More Than Monitoring: How Observability Takes You From Firefighting to Fire P...More Than Monitoring: How Observability Takes You From Firefighting to Fire P...
More Than Monitoring: How Observability Takes You From Firefighting to Fire P...DevOps.com
 
SplunkLive! Zurich 2017 - Advanced Analytics / Machine Learning
SplunkLive! Zurich 2017 - Advanced Analytics / Machine LearningSplunkLive! Zurich 2017 - Advanced Analytics / Machine Learning
SplunkLive! Zurich 2017 - Advanced Analytics / Machine LearningSplunk
 
SplunkLive! Customer Presentation - Cardinal Health
SplunkLive! Customer Presentation - Cardinal HealthSplunkLive! Customer Presentation - Cardinal Health
SplunkLive! Customer Presentation - Cardinal HealthSplunk
 
How PagerDuty Achieved End-to-End Visibility with Splunk and AWS Webinar Deck
How PagerDuty Achieved End-to-End Visibility with Splunk and AWS Webinar DeckHow PagerDuty Achieved End-to-End Visibility with Splunk and AWS Webinar Deck
How PagerDuty Achieved End-to-End Visibility with Splunk and AWS Webinar DeckAmazon Web Services
 
Financial Services Forum_New York, May 17, 2017
Financial Services Forum_New York, May 17, 2017Financial Services Forum_New York, May 17, 2017
Financial Services Forum_New York, May 17, 2017Splunk
 
Splunk and Multicloud
Splunk and Multicloud Splunk and Multicloud
Splunk and Multicloud Splunk
 
SplunkLive! Zurich 2017 - The Power of SPL
SplunkLive! Zurich 2017 - The Power of SPLSplunkLive! Zurich 2017 - The Power of SPL
SplunkLive! Zurich 2017 - The Power of SPLSplunk
 
SplunkLive! Zurich 2017 - Build a Security Portfolio That Strengthens Your Se...
SplunkLive! Zurich 2017 - Build a Security Portfolio That Strengthens Your Se...SplunkLive! Zurich 2017 - Build a Security Portfolio That Strengthens Your Se...
SplunkLive! Zurich 2017 - Build a Security Portfolio That Strengthens Your Se...Splunk
 
Best practices for automating cloud security processes with Evident.io and AWS
Best practices for automating cloud security processes with Evident.io and AWSBest practices for automating cloud security processes with Evident.io and AWS
Best practices for automating cloud security processes with Evident.io and AWSAmazon Web Services
 
Building The Next Generation Workplace
Building The Next Generation Workplace Building The Next Generation Workplace
Building The Next Generation Workplace Cisco Canada
 
The Hitchhiker's Guide to Service Intelligence
The Hitchhiker's Guide to Service IntelligenceThe Hitchhiker's Guide to Service Intelligence
The Hitchhiker's Guide to Service IntelligenceSplunk
 
SplunkLive! Zurich 2017 - Splunk Add-ons and Alerts
SplunkLive! Zurich 2017 - Splunk Add-ons and AlertsSplunkLive! Zurich 2017 - Splunk Add-ons and Alerts
SplunkLive! Zurich 2017 - Splunk Add-ons and AlertsSplunk
 
SplunkLive! London 2017 - Splunk Enterprise for IT Troubleshooting
SplunkLive! London 2017 - Splunk Enterprise for IT TroubleshootingSplunkLive! London 2017 - Splunk Enterprise for IT Troubleshooting
SplunkLive! London 2017 - Splunk Enterprise for IT TroubleshootingSplunk
 
SplunkLive! London 2017 - DevOps Powered by Splunk
SplunkLive! London 2017 - DevOps Powered by SplunkSplunkLive! London 2017 - DevOps Powered by Splunk
SplunkLive! London 2017 - DevOps Powered by SplunkSplunk
 
Splunk Forum Frankfurt - 15th Nov 2017 - Threat Hunting
Splunk Forum Frankfurt - 15th Nov 2017 - Threat HuntingSplunk Forum Frankfurt - 15th Nov 2017 - Threat Hunting
Splunk Forum Frankfurt - 15th Nov 2017 - Threat HuntingSplunk
 
Splunk live! customer presentation – zoosk
Splunk live! customer presentation – zooskSplunk live! customer presentation – zoosk
Splunk live! customer presentation – zooskSplunk
 
Automate Yourself Out of a Job: Safely Delegate the Management of your Azure...
Automate Yourself Out of a Job:  Safely Delegate the Management of your Azure...Automate Yourself Out of a Job:  Safely Delegate the Management of your Azure...
Automate Yourself Out of a Job: Safely Delegate the Management of your Azure...Rundeck
 
Do You Trust Your DevSecOps Pipeline?
Do You Trust Your DevSecOps Pipeline?Do You Trust Your DevSecOps Pipeline?
Do You Trust Your DevSecOps Pipeline?DevOps.com
 
SplunkLive! Customer Presentation - Penn State Hershey Medical Center
SplunkLive! Customer Presentation - Penn State Hershey Medical CenterSplunkLive! Customer Presentation - Penn State Hershey Medical Center
SplunkLive! Customer Presentation - Penn State Hershey Medical CenterSplunk
 

What's hot (20)

More Than Monitoring: How Observability Takes You From Firefighting to Fire P...
More Than Monitoring: How Observability Takes You From Firefighting to Fire P...More Than Monitoring: How Observability Takes You From Firefighting to Fire P...
More Than Monitoring: How Observability Takes You From Firefighting to Fire P...
 
SplunkLive! Zurich 2017 - Advanced Analytics / Machine Learning
SplunkLive! Zurich 2017 - Advanced Analytics / Machine LearningSplunkLive! Zurich 2017 - Advanced Analytics / Machine Learning
SplunkLive! Zurich 2017 - Advanced Analytics / Machine Learning
 
SplunkLive! Customer Presentation - Cardinal Health
SplunkLive! Customer Presentation - Cardinal HealthSplunkLive! Customer Presentation - Cardinal Health
SplunkLive! Customer Presentation - Cardinal Health
 
How PagerDuty Achieved End-to-End Visibility with Splunk and AWS Webinar Deck
How PagerDuty Achieved End-to-End Visibility with Splunk and AWS Webinar DeckHow PagerDuty Achieved End-to-End Visibility with Splunk and AWS Webinar Deck
How PagerDuty Achieved End-to-End Visibility with Splunk and AWS Webinar Deck
 
Financial Services Forum_New York, May 17, 2017
Financial Services Forum_New York, May 17, 2017Financial Services Forum_New York, May 17, 2017
Financial Services Forum_New York, May 17, 2017
 
Splunk and Multicloud
Splunk and Multicloud Splunk and Multicloud
Splunk and Multicloud
 
SplunkLive! Zurich 2017 - The Power of SPL
SplunkLive! Zurich 2017 - The Power of SPLSplunkLive! Zurich 2017 - The Power of SPL
SplunkLive! Zurich 2017 - The Power of SPL
 
SplunkLive! Zurich 2017 - Build a Security Portfolio That Strengthens Your Se...
SplunkLive! Zurich 2017 - Build a Security Portfolio That Strengthens Your Se...SplunkLive! Zurich 2017 - Build a Security Portfolio That Strengthens Your Se...
SplunkLive! Zurich 2017 - Build a Security Portfolio That Strengthens Your Se...
 
Best practices for automating cloud security processes with Evident.io and AWS
Best practices for automating cloud security processes with Evident.io and AWSBest practices for automating cloud security processes with Evident.io and AWS
Best practices for automating cloud security processes with Evident.io and AWS
 
Building The Next Generation Workplace
Building The Next Generation Workplace Building The Next Generation Workplace
Building The Next Generation Workplace
 
The Hitchhiker's Guide to Service Intelligence
The Hitchhiker's Guide to Service IntelligenceThe Hitchhiker's Guide to Service Intelligence
The Hitchhiker's Guide to Service Intelligence
 
SplunkLive! Zurich 2017 - Splunk Add-ons and Alerts
SplunkLive! Zurich 2017 - Splunk Add-ons and AlertsSplunkLive! Zurich 2017 - Splunk Add-ons and Alerts
SplunkLive! Zurich 2017 - Splunk Add-ons and Alerts
 
SplunkLive! London 2017 - Splunk Enterprise for IT Troubleshooting
SplunkLive! London 2017 - Splunk Enterprise for IT TroubleshootingSplunkLive! London 2017 - Splunk Enterprise for IT Troubleshooting
SplunkLive! London 2017 - Splunk Enterprise for IT Troubleshooting
 
SplunkLive! London 2017 - DevOps Powered by Splunk
SplunkLive! London 2017 - DevOps Powered by SplunkSplunkLive! London 2017 - DevOps Powered by Splunk
SplunkLive! London 2017 - DevOps Powered by Splunk
 
Splunk Forum Frankfurt - 15th Nov 2017 - Threat Hunting
Splunk Forum Frankfurt - 15th Nov 2017 - Threat HuntingSplunk Forum Frankfurt - 15th Nov 2017 - Threat Hunting
Splunk Forum Frankfurt - 15th Nov 2017 - Threat Hunting
 
Splunk live! customer presentation – zoosk
Splunk live! customer presentation – zooskSplunk live! customer presentation – zoosk
Splunk live! customer presentation – zoosk
 
Automate Yourself Out of a Job: Safely Delegate the Management of your Azure...
Automate Yourself Out of a Job:  Safely Delegate the Management of your Azure...Automate Yourself Out of a Job:  Safely Delegate the Management of your Azure...
Automate Yourself Out of a Job: Safely Delegate the Management of your Azure...
 
Do You Trust Your DevSecOps Pipeline?
Do You Trust Your DevSecOps Pipeline?Do You Trust Your DevSecOps Pipeline?
Do You Trust Your DevSecOps Pipeline?
 
Amazon cloud service
Amazon cloud serviceAmazon cloud service
Amazon cloud service
 
SplunkLive! Customer Presentation - Penn State Hershey Medical Center
SplunkLive! Customer Presentation - Penn State Hershey Medical CenterSplunkLive! Customer Presentation - Penn State Hershey Medical Center
SplunkLive! Customer Presentation - Penn State Hershey Medical Center
 

Similar to Architecting Highly Available Cloud Integrations

#GeodeSummit - Design Tradeoffs in Distributed Systems
#GeodeSummit - Design Tradeoffs in Distributed Systems#GeodeSummit - Design Tradeoffs in Distributed Systems
#GeodeSummit - Design Tradeoffs in Distributed SystemsPivotalOpenSourceHub
 
A SCALABLE AND RELIABLE MATCHING SERVICE FOR CONTENT-BASED PUBLISH/SUBSCRIBE ...
A SCALABLE AND RELIABLE MATCHING SERVICE FOR CONTENT-BASED PUBLISH/SUBSCRIBE ...A SCALABLE AND RELIABLE MATCHING SERVICE FOR CONTENT-BASED PUBLISH/SUBSCRIBE ...
A SCALABLE AND RELIABLE MATCHING SERVICE FOR CONTENT-BASED PUBLISH/SUBSCRIBE ...I3E Technologies
 
Advantages and disadvantages of DBMS
Advantages and disadvantages of DBMSAdvantages and disadvantages of DBMS
Advantages and disadvantages of DBMSMohit Singhal
 
Design Tradeoffs in Distributed Systems- How Southwest Airlines Uses Geode
Design Tradeoffs in Distributed Systems- How Southwest Airlines Uses Geode Design Tradeoffs in Distributed Systems- How Southwest Airlines Uses Geode
Design Tradeoffs in Distributed Systems- How Southwest Airlines Uses Geode VMware Tanzu
 
Move your on-premises data today with Buurst
Move your on-premises data today with BuurstMove your on-premises data today with Buurst
Move your on-premises data today with BuurstMH Riad
 
Best pratices reliability & scalability on Azure
Best pratices reliability & scalability on AzureBest pratices reliability & scalability on Azure
Best pratices reliability & scalability on AzureAlex Danvy
 
3 Reasons Why The Host Rules Intrusion Detection in The Cloud
3 Reasons Why The Host Rules Intrusion Detection in The Cloud 3 Reasons Why The Host Rules Intrusion Detection in The Cloud
3 Reasons Why The Host Rules Intrusion Detection in The Cloud Threat Stack
 
Mmckeown hadr that_conf
Mmckeown hadr that_confMmckeown hadr that_conf
Mmckeown hadr that_confMike McKeown
 
Move your Data Center to the Cloud
Move your Data Center to the CloudMove your Data Center to the Cloud
Move your Data Center to the CloudRedZone Technologies
 
Cidr11 paper32
Cidr11 paper32Cidr11 paper32
Cidr11 paper32jujukoko
 
Megastore providing scalable, highly available storage for interactive services
Megastore providing scalable, highly available storage for interactive servicesMegastore providing scalable, highly available storage for interactive services
Megastore providing scalable, highly available storage for interactive servicesJoão Gabriel Lima
 
Modeling data and best practices for the Azure Cosmos DB.
Modeling data and best practices for the Azure Cosmos DB.Modeling data and best practices for the Azure Cosmos DB.
Modeling data and best practices for the Azure Cosmos DB.Mohammad Asif
 
Azure Cosmos DB + Gremlin API in Action
Azure Cosmos DB + Gremlin API in ActionAzure Cosmos DB + Gremlin API in Action
Azure Cosmos DB + Gremlin API in ActionDenys Chamberland
 
ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Databa...
ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Databa...ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Databa...
ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Databa...Amazon Web Services
 
2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole
2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole
2020 Cloud Data Lake Platforms Buyers Guide - White paper | QuboleVasu S
 

Similar to Architecting Highly Available Cloud Integrations (20)

#GeodeSummit - Design Tradeoffs in Distributed Systems
#GeodeSummit - Design Tradeoffs in Distributed Systems#GeodeSummit - Design Tradeoffs in Distributed Systems
#GeodeSummit - Design Tradeoffs in Distributed Systems
 
A SCALABLE AND RELIABLE MATCHING SERVICE FOR CONTENT-BASED PUBLISH/SUBSCRIBE ...
A SCALABLE AND RELIABLE MATCHING SERVICE FOR CONTENT-BASED PUBLISH/SUBSCRIBE ...A SCALABLE AND RELIABLE MATCHING SERVICE FOR CONTENT-BASED PUBLISH/SUBSCRIBE ...
A SCALABLE AND RELIABLE MATCHING SERVICE FOR CONTENT-BASED PUBLISH/SUBSCRIBE ...
 
Advantages and disadvantages of DBMS
Advantages and disadvantages of DBMSAdvantages and disadvantages of DBMS
Advantages and disadvantages of DBMS
 
Design Tradeoffs in Distributed Systems- How Southwest Airlines Uses Geode
Design Tradeoffs in Distributed Systems- How Southwest Airlines Uses Geode Design Tradeoffs in Distributed Systems- How Southwest Airlines Uses Geode
Design Tradeoffs in Distributed Systems- How Southwest Airlines Uses Geode
 
My sql
My sqlMy sql
My sql
 
Move your on-premises data today with Buurst
Move your on-premises data today with BuurstMove your on-premises data today with Buurst
Move your on-premises data today with Buurst
 
Best pratices reliability & scalability on Azure
Best pratices reliability & scalability on AzureBest pratices reliability & scalability on Azure
Best pratices reliability & scalability on Azure
 
3 Reasons Why The Host Rules Intrusion Detection in The Cloud
3 Reasons Why The Host Rules Intrusion Detection in The Cloud 3 Reasons Why The Host Rules Intrusion Detection in The Cloud
3 Reasons Why The Host Rules Intrusion Detection in The Cloud
 
Mmckeown hadr that_conf
Mmckeown hadr that_confMmckeown hadr that_conf
Mmckeown hadr that_conf
 
Move your Data Center to the Cloud
Move your Data Center to the CloudMove your Data Center to the Cloud
Move your Data Center to the Cloud
 
Disaster recovery toolkit final version
Disaster recovery toolkit final versionDisaster recovery toolkit final version
Disaster recovery toolkit final version
 
Cidr11 paper32
Cidr11 paper32Cidr11 paper32
Cidr11 paper32
 
Megastore providing scalable, highly available storage for interactive services
Megastore providing scalable, highly available storage for interactive servicesMegastore providing scalable, highly available storage for interactive services
Megastore providing scalable, highly available storage for interactive services
 
Modeling data and best practices for the Azure Cosmos DB.
Modeling data and best practices for the Azure Cosmos DB.Modeling data and best practices for the Azure Cosmos DB.
Modeling data and best practices for the Azure Cosmos DB.
 
Azure Cosmos DB + Gremlin API in Action
Azure Cosmos DB + Gremlin API in ActionAzure Cosmos DB + Gremlin API in Action
Azure Cosmos DB + Gremlin API in Action
 
ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Databa...
ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Databa...ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Databa...
ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Databa...
 
DAG
DAGDAG
DAG
 
PAAS Architecture Strategy for cloud Business Intelligence Solution
PAAS Architecture Strategy for cloud Business Intelligence SolutionPAAS Architecture Strategy for cloud Business Intelligence Solution
PAAS Architecture Strategy for cloud Business Intelligence Solution
 
Cloud Strategy Architecture for multi country deployment
Cloud Strategy Architecture for multi country deploymentCloud Strategy Architecture for multi country deployment
Cloud Strategy Architecture for multi country deployment
 
2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole
2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole
2020 Cloud Data Lake Platforms Buyers Guide - White paper | Qubole
 

More from Richard Seroter

What NASA’s Voyager mission teaches us about building distributed systems
What NASA’s Voyager mission teaches us about building distributed systemsWhat NASA’s Voyager mission teaches us about building distributed systems
What NASA’s Voyager mission teaches us about building distributed systemsRichard Seroter
 
What "good at software" looks like
What "good at software" looks likeWhat "good at software" looks like
What "good at software" looks likeRichard Seroter
 
An agile approach to cloud infrastructure
An agile approach to cloud infrastructureAn agile approach to cloud infrastructure
An agile approach to cloud infrastructureRichard Seroter
 
The Future of Application integration
The Future of Application integrationThe Future of Application integration
The Future of Application integrationRichard Seroter
 
Integration techniques for SaaS CRM applications
Integration techniques for SaaS CRM applicationsIntegration techniques for SaaS CRM applications
Integration techniques for SaaS CRM applicationsRichard Seroter
 
Cloud integration patterns, technologies & trends
Cloud integration patterns, technologies & trendsCloud integration patterns, technologies & trends
Cloud integration patterns, technologies & trendsRichard Seroter
 
Using the Force.com Integration APIs
Using the Force.com Integration APIsUsing the Force.com Integration APIs
Using the Force.com Integration APIsRichard Seroter
 
Platform-as-a-Service (PaaS) Overview
Platform-as-a-Service (PaaS) OverviewPlatform-as-a-Service (PaaS) Overview
Platform-as-a-Service (PaaS) OverviewRichard Seroter
 

More from Richard Seroter (9)

What NASA’s Voyager mission teaches us about building distributed systems
What NASA’s Voyager mission teaches us about building distributed systemsWhat NASA’s Voyager mission teaches us about building distributed systems
What NASA’s Voyager mission teaches us about building distributed systems
 
What "good at software" looks like
What "good at software" looks likeWhat "good at software" looks like
What "good at software" looks like
 
DevOps Explained
DevOps ExplainedDevOps Explained
DevOps Explained
 
An agile approach to cloud infrastructure
An agile approach to cloud infrastructureAn agile approach to cloud infrastructure
An agile approach to cloud infrastructure
 
The Future of Application integration
The Future of Application integrationThe Future of Application integration
The Future of Application integration
 
Integration techniques for SaaS CRM applications
Integration techniques for SaaS CRM applicationsIntegration techniques for SaaS CRM applications
Integration techniques for SaaS CRM applications
 
Cloud integration patterns, technologies & trends
Cloud integration patterns, technologies & trendsCloud integration patterns, technologies & trends
Cloud integration patterns, technologies & trends
 
Using the Force.com Integration APIs
Using the Force.com Integration APIsUsing the Force.com Integration APIs
Using the Force.com Integration APIs
 
Platform-as-a-Service (PaaS) Overview
Platform-as-a-Service (PaaS) OverviewPlatform-as-a-Service (PaaS) Overview
Platform-as-a-Service (PaaS) Overview
 

Recently uploaded

Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 

Recently uploaded (20)

Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 

Architecting Highly Available Cloud Integrations

  • 2. HAVE YOU EVER BUILT A MODEL PLANE?
  • 3. A GOOD MODEL DEPENDS ON STRONG GLUE.
  • 4. WE WANT A DURABLE CONNECTIONS BETWEEN OUR “THINGS.”
  • 5. 1 CORE PATTERNS 2 CONFIGURING FOR AVAILABILITY 3 PUTTING IT ALL TOGETHER
  • 6. 1 CORE PATTERNS 2 CONFIGURING FOR AVAILABILITY 3 PUTTING IT ALL TOGETHER
  • 7. TEMPORARY HICCUP IN NETWORK, DATABASE, SERVICE, OR ELSEWHERE OFTEN RESOLVED THROUGH RETRIES MAY BE HANDLED GRACEFULLY FOR YOU BY PLATFORM OR SDK CONSIDERATIONS FOR BUSINESS NEED, CONTINUED FAILURE, TRANSACTIONS RETRY TRANSIENT FAILURES
  • 8. SCALE OUT VIA MORE INSTANCES ABOUT ACTIVELY USING (HEALTHY) NODES TO SHARE WORK APPLIES TO COMPUTE, MESSAGING, EVENT STREAMING, DATA AND EVEN NETWORKING IDEALLY, THIS IS BUILT IN AUTOSCALING MAKES THIS FEEL MORE SEAMLESS LOAD BALANCE REDUNDANT INSTANCES
  • 9. REPLICATE YOUR DATA BOTH TRANSACTIONAL AND METADATA CONSIDER HOW YOU READ AND WRITE DATA CROSS-REGION REPLICATION IS POWERFUL, BUT LAGS DUE TO LATENCY MAY BE AS MUCH ABOUT DISASTER RECOVERY AS HIGH AVAILABILITY
  • 10. THROTTLE SOME OF YOUR USERS ONE USER’S LOAD CAN IMPACT ALL OTHER INTEGRATION TENANTS MAY REJECT REQUESTS OR PROVIDE LOWER QUALITY RESULTS SHOULD BE DONE IN A VISIBLE WAY
  • 11. INTRODUCE LOAD LEVELING PROTECTS BACKEND SYSTEMS MIDDLEWARE GETS BEAT UP, NOT TARGET SYSTEMS CAN SAVE YOU FROM NON-STOP AUTOSCALING
  • 12. SECURE WITH LEAST PRIVILEGE, ACCESS SHOULD BE AS RESTRICTIVE AS POSSIBLE TURN ON ENCRYPTION WITH EVERY POSSIBLE SERVICE STAY ONLINE BY PROTECTING AGAINST DDOS ATTACKS AND ANTI-DDOS ENCRYPTION,
  • 13. AUTOMATE BUILD AND THIS HELPS YOU QUICKLY RESTORE SERVICE IN A SECONDARY REGION PROVISION USING REPEATABLE TEMPLATES AND SCRIPTS UPDATE STAGES
  • 14. 1 CORE PATTERNS 2 CONFIGURING FOR AVAILABILITY 3 PUTTING IT ALL TOGETHER
  • 16. WHAT IT DOES FOR YOU GET FILE, DISK, BLOB STORAGE FOUR REPLICATION OPTIONS LOCALLY-REDUNDANT ZONE-REDUNDANT GEO-REDUNDANT READ-ACCESS GEO-REDUNDANT OFFERS ENCRYPTION AT REST WHAT YOU HAVE TO DO SET REPLICATION OPTION CREATE STRATEGY FOR ACCESSING SECONDARY STORAGE DECIDE ON SERVER AND/OR CLIENT-SIDE ENCRYPTION AZURE STORAGE SERVICES
  • 18. WHAT IT DOES FOR YOU USES HIGHLY AVAILABLE STORAGE ABILITY TO SCALE UP OR OUT EASILY CREATE (AND CHAIN) READ REPLICAS BUILT IN BACKUP AND RESTORE INCLUDES THREAT DETECTION WHAT YOU HAVE TO DO CREATE REPLICAS DECIDE WHEN TO SCALE HORIZONTALLY OR VERTICALLY RESTORE DATABASE FROM BACKUP TURN ON THREAT DETECTION AZURE SQL DATABASE
  • 20. WHAT IT DOES FOR YOU 99.999% AVAILABILITY FOR READS AUTOMATICALLY PARTITIONS DATA, REPLICATES IT SUPPORTS MULTIPLE CONSISTENCY LEVELS AUTOMATIC AND MANUAL FAILOVER WHAT YOU HAVE TO DO DEFINE PARTITION KEY, THROUGHPUT, REPLICATION POLICIES CONFIGURE REGIONS FOR READ, WRITE, OR READ/WRITE CHOOSE CONSISTENCY FOR DB, INDIVIDUAL REQUESTS DECIDE TO TRIGGER A MANUAL FAILOVER AZURE COSMOS DB
  • 22. WHAT IT DOES FOR YOU RESILIENCE WITHIN A REGION INITIATES THROTTLING TO PREVENT OVERLOAD AUTOMATIC PARTITIONING OFFERS GEO-DISASTER RECOVERY WHAT YOU HAVE TO DO SELECT MESSAGE RETENTION TIME CHOOSE TO USE PARTITIONING USE PREMIUM MESSAGING FOR RESOURCE ISOLATION CONFIGURE GEO-DISASTER RECOVERY AZURE SERVICE BUS
  • 24. WHAT IT DOES FOR YOU HANDLES MASSIVE INGEST LOAD BUILT-IN PARTITIONING SUPPORT AUTO-INFLATE ADDS THROUGHPUT UNITS TO MEET NEED SUPPORTS GEO-DISASTER RECOVERY WHAT YOU HAVE TO DO CONFIGURE INITIAL THROUGHPUT UNITS DEFINE YOUR PARTITION COUNT CONFIGURE GEO-DISASTER RECOVERY AZURE EVENT HUBS
  • 26. WHAT IT DOES FOR YOU IN-REGION HA IS BUILT IN IMPOSE LIMITS ON TIMEOUT, MESSAGE SIZE SUPPORTS SYNCHRONIZING B2B RESOURCES TO ANOTHER REGION WHAT YOU HAVE TO DO CONFIGURE B2B RESOURCE SYNCHRONIZATION CONFIGURE INTEGRATIONS TO HIGHLY AVAILABLE ENDPOINTS DUPLICATE LOGIC APP IN OTHER REGIONS AZURE LOGIC APPS
  • 28. WHAT IT DOES FOR YOU SCALES UNDERLYING RESOURCES AUTOMATICALLY WITH CONSUMPTION PLAN SCALE VMS AUTOMATICALLY OR MANUALLY IN APP SERVICE PLAN BASIC UPTIME SLA AT THIS TIME WHAT YOU HAVE TO DO CHOOSE PLAN TYPE SET SCALING POLICIES WHEN USING APP SERVICE PLAN REPLICATE FUNCTIONS TO OTHER REGIONS AZURE FUNCTIONS
  • 30. WHAT IT DOES FOR YOU DEPLOYS ACTIVE-STANDBY INSTANCES BY DEFAULT RUN AS A MANAGED SERVICE AND YOU NEVER ACCESS UNDERLYING VIRTUAL MACHINES WHAT YOU HAVE TO DO RESIZE AS NEEDED CONFIGURE REDUNDANT ON-PREM VPN DEVICES CREATE ACTIVE-ACTIVE VPN GATEWAY CONFIGURATIONS SETUP ACTIVE-ACTIVE ON BOTH SIDES AZURE VPN GATEWAY
  • 31. 1 CORE PATTERNS 2 CONFIGURING FOR AVAILABILITY 3 PUTTING IT ALL TOGETHER
  • 32. ONLY INTEGRATE WITH HIGHLY AVAILABLE ENDPOINTS
  • 35. 1 CORE PATTERNS 2 CONFIGURING FOR AVAILABILITY 3 PUTTING IT ALL TOGETHER
  • 36. RESOURCES NEW PLURALSIGHT COURSE (https://bit.ly/2sJtzuj) MICROSOFT H/A GUIDES (https://bit.ly/2r2m7Iu) @RSEROTER