From the 1966 creation of SHAKEY, the first modern mobile robot, to the 2007 creation of ROS, the most common robot development framework, university classrooms and research labs have created the leading hardware platforms, algorithms, tools, and best practices for robot development. In this session, learn how educators use AWS RoboMaker, a service that makes it easy to develop, test, and deploy intelligent robotics applications at scale, to help train the next generation of roboticists, and to enable research labs to continue developing state of the art robotics capabilities.

1. P U B L I C S E C T O R
S U M M I T
Washington DC

2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Developing & Teaching Robotics
with AWS RoboMaker
Douglas Fulop
Sr. Product Manager
AWS Robotics and Autonomous Services
2 9 5 5 0 1
Yinong Chen
Principal Lecturer
School of Computing, Informatics, and
Decision Systems Engineering
Arizona State University

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Agenda
Robotics today
How you can develop robots with AWS RoboMaker
Teaching robotics at Arizona State University

4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Robotic Arms
International Space Station
Drones
Education
Water
Home
Self-Driving Vehicles
Autonomous Walker
Rover
Robot landscape

5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Robotics trends in 2019
Source: IDTechEx
• Logistics
• Construction
• Retail
• Hospitality
• Healthcare
Robots are being put to work every
day across many industries
• Agriculture
• Energy Management
• Oil and Gas
• Facilities Management
• Household chores
By 2030, 70% of all mobile material
handling equipment will be autonomous

6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
What is a robot?
ActComputeSense

7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Introducing AWS RoboMaker
A service that makes it easy
for developers to develop,
test, and deploy robotics
applications, as well as build
intelligent robotics functions
using cloud services

8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Enables development best practices…
3) Develop
robotics
application
2) Select
software and
hardware
5) Deploy
and manage
application
4) Test and
simulate
application
New application release and update
1) Define the
product

9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Built on top of Robot Operating System (ROS)
GazeboROS

10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
AWS RoboMaker service suite
Development
Environment
SimulationCloud Extensions for
ROS
Fleet
Management

11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
AWS RoboMaker Architecture
ROS/ROS2
Development
Environment
Simulation
Fleet
Management
Cloud Extensions
for ROS
BuildTool
CloudDevelopment
Environment
Debug
MLModelTraining
Iterative
Simulation
Regression
Testing
Registration
Deployment
Monitoring
Management
AmazonLex
AmazonPolly
AmazonRekognition
AmazonKinesisVideo
Streams
AmazonCloudWatchMetrics
AmazonCloudWatchLogs
MetricandLogging

12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
AWS RoboMaker
Cloud Extensions for ROS
AMAZON
LEX
speech
recognition
AMAZON
POLLY
speech
generation
KINESIS
VIDEO
STREAMS
video streams
AMAZON
REKOGNITION
image and video
analysis
CLOUDWATCH
logging and
monitoring

13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
AWS RoboMaker
Development Environment
 Start developing your application with one click

14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
AWS RoboMaker
Simulation
 Use pre-built virtual 3D worlds or bring your own
customer environment
 Zero infrastructure to provision, configure, or
manage

15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
AWS RoboMaker
Fleet Management
 Integrated with AWS IoT Greengrass
 Deploy robotics application over-the-air

16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
AWS RoboMaker
Sample Robot Applications
Hello World Navigation and
Person Recognition
Voice
Commands
Robot
Monitoring
Object-following using
Reinforcement Learning
Self-driving using
Reinforcement Learning

17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
AWS RoboMaker helps you get to market faster
Accelerated
development timelines
Intelligence
out of the box
Zero infrastructure
provisioning
Lifecycle
management

18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Customer Story: Elderly Care
“AWS RoboMaker exponentially increases the capabilities of Lea,
an autonomous robot assistant for the elderly and disabled. Lea is
interactive, keeps elderly safe and active, while it can talk to you,
navigate around your house and keep you connected with family
and doctors.”
—Dimitrios Chronopoulos, Lead Mobility Engineer, Robot Care
Systems

20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Customer Story: Inspection
“With AWS RoboMaker, we are able to easily test the
robotics related software applications in a cloud
environment, and rapidly generate synthetic imaging data
to train our 3D site model creation algorithms. AWS
RoboMaker also provides the ideal fleet management
solution for use on ground vehicles and drones.”
—Hamid Montazeri, VP of SW Engineering and Robotics
at Stanley Black & Decker

21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Customer Story: Concierge Service Robot
“As a new AWS customer, the sample applications provided us
with exactly what we needed to get started. With the
acceleration of development time we expect to gain from AWS
and AWS RoboMaker, we now have new ideas and
possibilities for market expansion.”
—Dr. SeKyong Song, Founder and CEO, Future Robot

22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Get Started!
Think Big
• What problems in your organization can be solved with robotics?
Start small
• Learn ROS – The Robot Ignite Academy and Udacity
• Learn AWS RoboMaker – Students & Educators sign up for AWS
Educate to access credits & training materials!
Build quickly & Iterate
• Use existing open source packages in your projects
• Leverage code from AWS RoboMaker Sample Applications

23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
AWS RoboMaker’s Academic Program
 Partnership with AWS Educate
 Individual Student & Educator Accounts
 AWS RoboMaker Classroom
 AWS RoboMaker Badge (Just Launched!)

24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Benefits of AWS RoboMaker for Education
Over-the-air deployment
and fleet management
ROS workspace out
of the box
Use cloud resources for
resource intensive work
Safe simulations in
multiple scenarios
Low cost robotics
innovation

25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Education Partners

26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T

27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Teaching Robotics at ASU
Projects
Full Stack Robotics Development with a Robot Guide Dog
Teach Human-Robot Interaction with Alexa
Teach Reinforcement Learning for racecars and drones
Next steps

29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Robot Guide Dog: Introduce the robotics stack
Wi-Fi Bluetooth
Wi-Fi
Wi-Fi
Wi-Fi 4G
Mobile
Phone as
Wi-Fi AP
Intel Up Squared
Camera WIFI AP
Amazon Echo
Wheel chairSensors
& motors
ASU VIPLE on Notebook
Amazon Elastic Compute
Cloud Instance
TensorFlow
Python 3
Amazon Simple
Storage Service
Public IP Address:
54.***.***.**:8888
TRAINING_DATA
EVALUATION_DATA
ML_MODEL
Future sensors
Amazon
Cloud

30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Human Robot Interaction with Alexa

31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Reinforcement Learning: Racecars
• Goal: Train the robot to race around a
physical track using simulation
• Optimize a reward function for
complex situation handling
• Tune hyperparameters
• Upload trained models to physical robot and
test on a physical track
• Interpret and use data collected from sensors
• Add new capabilities
• e.g., Avoid obstacles

32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Reinforcement Learning: Racecar

33. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Reinforcement Learning: Drones
Goal: Build a flight data collection and processing system
System consists of:
A physical drone, VIPLE programs,
data collection, feature extraction,
model (classifier) training, and
Multirotor Activity Recognition (MAR)
AWS Cloud Services for model training
and development
33

34. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
TensorFlow
Data Labeling
[
{index, “up”},
{index, “down”},
{index, “neutral”},
{index, “forwards”},
{index, “backwards”},
{index, “left”},
{index, “right”}
]
Feature Extraction
ML MODEL
Training
IMU Data
34
Training a flight model

35. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
TensorFlow
Data Labeling
[
{index, “up”},
{index, “down”},
{index, “neutral”},
{index, “forwards”},
{index, “backwards”},
{index, “left”},
{index, “right”}
]
Feature Extraction
ML MODEL
Flight Recognition
[
{“up”},
{“neutral”},
{“backwards”},
{“right”}
{“down”}
{“forwards”},
{“left”},
]
Recognition
Training
IMU Data
35
Training a flight model

36. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Next Steps
Expanding curriculum to include
• Hosting web services class in AWS (CSE445)
• Expanding AWS free tier services in web application development class
(CSE445)
• Using AWS RoboMaker in robotics experiments (FSE 100)
New course work enabled by AWS RoboMaker
• Program an autonomous driving vehicle using AWS RoboMaker
and AWS DeepRacer

37. Thank you!
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
Douglas Fulop
dfulop@amazon.com
Yinong Chen
yinong.chen@asu.edu
Academics: aws-robomaker-academics@amazon.com
Government & Non-Profits: robomaker-bd@amazon.com

38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T

39. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R
S U M M I T
AWS RoboMaker
architecture
AWS Cloud
Robot
applications
Simulation
Log Files
Developers
Deploy
application
Robot
Rviz
Gazebo
Rqt