In the cloud, modern apps are decoupled into independent building blocks, called microservices, which are easier to develop, deploy, and maintain. Messaging is a central tool used to connect and coordinate these microservices. AWS offers multiple messaging services, which address a variety of use cases. In this session, learn how to choose the service that’s best for your use case as we present the key technical features of each. We pay special attention to integrating messaging services with serverless technology. We cover Amazon Kinesis, Amazon SQS, and Amazon SNS in detail with discussion of other services as appropriate.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Choosing the Right Messaging
Service for Your Distributed App
Kuba Wojciak
Principal Software Dev Eng
AWS
A P I 3 0 5
Sidhartha Chauhan
Solutions Architect
AWS

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Key takeaways
Importance of messaging platforms
Different messaging use cases
AWS messaging platforms and differences
Demo

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“If your application is cloud-native, or large-scale,
or distributed, and doesn’t include a messaging
component, that’s probably a bug”

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Microservices make integration a priority

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Modern apps
Compute Database
Messaging
Storage

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Message

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
JSON message
{
"bookingId": "456ab773-dccb-4bc9-87b7-322ff5c29eab",
"bookingNumber": "CDG-64453",
"locationId": "563890",
"customer": {
"id": "8943",
"email": "jacque@example.com"
},
"stayStart": "2018-11-27",
"stayEnd": "2018-12-01",
"price": {
"amount": "67.80",
"currency": "EUR"
}
}

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
XML message
<booking>
<bookingId>456ab773-dccb-4bc9-87b7-322ff5c29eab</bookingId>
<bookingNumber>CDG-64453</bookingNumber>
<locationId>563890</locationId>
<customer>
<id>8943</id>
<email>jacque@example.com</email>
</customer>
<stayStart>2018-11-27</stayStart>
<stayEnd>2018-12-01</stayEnd>
<price>
<amount>67.80</amount>
<currency>EUR</currency>
</price>
</booking>

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Payload and attributes
 Key/value pairs
 With business meaning:
 CustomerId=6445
 MessageType=NewBooking
 With technical meaning:
 SourceHost=ip-192-168-5-7.us-west-2.compute.internal
 ProgramName=WebServer-PID:9989

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS messaging services
Queues Topics Message brokers
For born-in-the-cloud apps
Simple APIs
Unlimited throughput
API-compatible
Feature-rich
Standard protocols
Modern application development App migration
Amazon Kinesis
Streams

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer use cases

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer use case—Amazon Fresh

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer use case – Amazon Fresh

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture requirements
retail/purchase systems

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture requirements
retail/purchase systems

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C
A

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C
A

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C
A

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C
A
B

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C
A
B

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C
A
B

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C
A
B
B

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C
A
B
B

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS standard queues
P
P
C
C
C

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Demo

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture
Retail/purchase systems

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture
Retail/purchase systems

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture
Retail/purchase systems

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer use case—Comcast

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer use case
- Changes to customer products
& devices
- Customer’s ordering
information
- Changes to technician/work
order related information

43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer requirements

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer requirements
—

45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3
A
G2

47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3
A
G2

48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3
A

49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3
A
B
G3

50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3
A
B
G3

51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3
A
B

52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3
A
BB
G3

53. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3
A
B
B
G3
5
mins

54. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3
A
B
B
G3

55. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3
A
B

56. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

57. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

58. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

59. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

60. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

61. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

62. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

63. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

64. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

65. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

66. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

67. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

68. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SQS FIFO queues
P
P
C
C
C
G1
G2
G3

69. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Demo

70. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture

71. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture
G1
G2
G3
G4

72. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer use case—Okta

73. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture requirements
user behavior,
authentication events,
AWS SSO events

74. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture requirements
user behavior,
authentication events,
AWS SSO events

75. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C

76. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
P2

77. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
P2

78. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
CA
P2

79. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
CA
P2
[0000 7FFF]
[8000 FFFF]

80. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
CA
P2 [62C3]
[0000 7FFF]
[8000 FFFF]

81. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
P2 [62C3]
[0000 7FFF]
[8000 FFFF]

82. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A

83. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
B
P5

84. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
B
P5

85. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
B
P5

86. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
B
P5
[0000 7FFF]
[8000 FFFF]

87. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
B
P5
[0000 7FFF]
[8000 FFFF]
[E177]

88. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
B
P5
[0000 7FFF]
[8000 FFFF]
[E177]

89. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
B

90. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
B
B
P5

91. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
B
B
P5

92. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
B
B
P5

93. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
A
BB

94. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
[0000 7FFF]
[8000 FFFF]

95. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C
[0000 7FFF]
[C000 FFFF]
[8000 BFFF]

96. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C

97. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C

98. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C

99. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C

100. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C

101. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C

102. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C

103. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C

104. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C

105. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C

106. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kinesis Data Streams
P
P
C
C
C

107. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Demo

108. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture
user behavior,
authentication events,
AWS SSO events

109. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture
user behavior,
authentication events,
AWS SSO events

110. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture
user behavior,
authentication events,
AWS SSO events

111. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer use case—Edmunds

112. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture requirements
Car dealers, OEM, franchises

113. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P

114. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
Amazon SQS

115. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
Amazon SQS
AWS Lambda

116. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
Amazon SQS
AWS Lambda
HTTP/S

117. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
Amazon SQS
AWS Lambda
HTTP/S
Mobile app
SMS
e-mail

118. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
f(x)
f(x)

119. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
A
f(x)
f(x)

120. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
A
f(x)
f(x)

121. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
A
f(x)
f(x)

122. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
A
f(x)
f(x)

123. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
A
A
A
A
A
f(x)
f(x)

124. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
A
A
A
A
A
f(x)
f(x)

125. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
A
f(x)
f(x)

126. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
A
B
f(x)
f(x)

127. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
A
B
f(x)
f(x)

128. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
A
B
f(x)
f(x)

129. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
A
B
f(x)
f(x)

130. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SNS topics
P
P
AB
B
B
B
B
f(x)
f(x)

131. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Messaging platform
Car dealers, OEM, franchises

132. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Messaging platform
Car dealers, OEM, franchises
Amazon SQS
Amazon SQS
Amazon SQS
Amazon
SNS topic

133. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Lambda integration with Amazon SQS
Amazon SQS
Amazon SQS
Amazon SQS

134. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Messaging platform
Car dealers, OEM, franchises
Amazon SQS
Amazon SQS
Amazon SQS
Amazon
SNS topic

135. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Messaging platform + serverless functions
Car dealers, OEM, franchises
Amazon SQS
Amazon SQS
Amazon SQS
Amazon
SNS topic

136. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer architecture
Car dealers, OEM, franchises
Amazon SQS
Amazon SQS
Amazon SQS
Amazon
SNS topic

137. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Re-cap
G1
G2
G3

138. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

139. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.