Presented at the Zurich Frontend Conference (http://2014.frontendconf.ch/) on August 29th, 2014. Here I presented ideas on the integration of user experience in the growing trends of Internet of Things (IoT) devices and wearable sensors.

1. Wearable Sensors and UX
Development
Mark Melnykowycz
Frontend Conference 2014
August 29th 2014
Zurich, Switzerland
mark@idezo.ch / @idezo_ch / @americanpeyote

2. Idea Flow
Trends
Science to
Society
Evolution of
Materials
IC Design / Production
Material Library
Influence on wearables
Evolution of
Computing
Sensor use
Wearables landscape
Sensors
Flexible sensors
Future applications
Prototyping
@idezo_ch #fec14

3. Products and Innovation Pipeline
Characterize and communicate
how the world/universe work
Putting science into something
we can build things with
Translating technology into something
which people interact with
@idezo_ch #fec14

4. Ubiquitous Computer
Internet of
Things (IoT)
Web of
Things (WoT)
Wearable
Computing
@idezo_ch #fec14

5. Connected Device Evolution
50 Billion
By 2020*
Quantified User
Quantified Self
IoT
@idezo_ch *http://share.cisco.com/internet-of-things.html
#fec14

6. Computing Evolution Trends
UX Patterns Increase with Devices
Defined UX
Space
Distributed UX
@idezo_ch #fec14

7. Separate Devices: Closed UX design spaces
Devices Interactivity User patterns are learned and establish “easy to use”
psychology
@idezo_ch #fec14

8. Technology and User Experience
“The reason OS X has a different interface than iOS isn’t because one came
after the other or because this one’s old and this one’s new,” Federighi said.
Instead, it’s because using a mouse and keyboard just isn’t the same as tapping
with your finger. “This device,” Federighi said, pointing at a MacBook Air screen,
“has been honed over 30 years to be optimal” for keyboards and mice.*
-Apple senior vice president of software engineering Craig Federighi
@idezo_ch *http://www.macworld.com/article/2090829/apple-executives-on-the-mac-at-30-the-mac-keeps-going-forever.html
#fec14
iOS OSX
Windows 8.1

9. Device vs Ecosystem UX
Designing for one
device UX is easier
Designing for an ecosystem
offers more opportunity
@idezo_ch #fec14

10. Wearables / IoT: Open UX Design Ecosystem
Many
Devices
Some
Devices Talk
Multiple
Interaction
Patterns
Openness of
ecosystem
defines UX
design space
@idezo_ch #fec14

11. Quantified
User
Quantified
Self
Device Tracking and Data
Interpretation
Self-Tracking and Data
Analysis
Data Trends
Low/Medium Accuracy
Data Ingestion
Data Interpretation
Continuous Tracking
Sensor Fusion
User Data Profile
Low/Medium/High Accuracy
Smart Apps
User is the
Data Scientist
App is the
Data Scientist
@idezo_ch #fec14

12. Quantified
User
User Tracking and Data
Interpretation
Total Data Profile
The user is a person and
an ecosystem of data
Design UX based on
data context
@idezo_ch #fec14

13. User State Determination / Context
Location
Time
Heart Rate
Position
…?
Sensor
Inputs/Fusion
User State
Application
User Experience
Sensor Hub
@idezo_ch #fec14

14. Product Development
Does Wearable
make the difference?
Data
Wearable Computing
User
Experience
Sensors /
Actuators
Application
Development
@idezo_ch #fec14

15. Current Single Device UX Design Trends
Personal
Tracking
2nd/3rd
Screen
Notifications
Minimal Interactions
Data Profile Creation
@idezo_ch #fec14

16. Wrist-band Form Factor
@idezo_ch #fec14

17. Wearable Sensors
Wearable
Activity Tracking
Quantified Self
http://amiigo.co/
ION Glasses
Angel
Acoustical
Optical
Acceleration
Temperature
Heart rate
Skin temp.
Blood oxygen
Physical activity
Fitbit
@idezo_ch #fec14

18. Sensors Basics
Time
Acceleration
GPS
Compass
…
Direction/Amplitude
Global Position
Orientation
Speed
…
Sensors
Output
Translates physical interaction into electrical signal
@idezo_ch #fec14

19. Sensor Materials Evolution
Integrated Circuits
Layered designs
Vapor deposition / etching
Hard materials
Silicon
PVD / Metals
Doped Oxides
Ceramics PZT
Quartz
Surface
micromachining
Acceleration Sensor Pressure Sensor
@idezo_ch #fec14

20. Smart Phone Sensor Anatomy
Environment Sensing
Connectivity Imaging
Thermal Imaging
Depth Sensing
Motion
GPS
Acceleration Coprocessor
Compass
Motion
Profile
@idezo_ch #fec14

21. Near Future: Thermal Imaging Uses
Metaio Thermal Touch Emotion Recognition?
Nummenmaa L et al. PNAS 2014;111:646-651
Separate UI from device Visualize emotions
@idezo_ch #fec14

22. Focus on Solving One User Problem
Value for the
User?
Often good UX means solving
one (or a few) problems really,
really well in one product
Don’t get lost in
the ecosystem
@idezo_ch #fec14

23. @idezo_ch 11th Wearable Technologies Conference 2014 I Europe #fec14

24. Business Modeling for Wearable Tech / IoT
User
Experience
Application /
Experience
Development
Sensors /
Actuators
Data
Who What How
@idezo_ch #fec14

25. Moticon (moticon.com)
User
Data Profile
Remote Research
Separation of UX, data profile
and user value
The ideal wearables UX is
invisible
@idezo_ch #fec14

26. Samsung Gear S Smart Watch
Accelerometer Gyroscope Heart Rate UV
Compass Barometer Ambient Light 3G
Wide range of sensors and connectivity
@idezo_ch #fec14

27. User – Data Pipeline
API
Sensors /
Actuators
Data
Data Digestion /
Algorithms
Interpretation
@idezo_ch #fec14

28. Wearables and IoT Development
IoT / Hardware
Tools
Trends: Society
vs. Technology
Solution
Idea
@idezo_ch #fec14

29. Wearables Development Example: eHealth
Sensor
Technology Use Cases
Acceleration
Patient
Temperature
Light / Radiation
Orientation
Electrical Impulse
Empowerment
Self-Diagnosis
Remote
Monitoring
Rehabilitation
…
@idezo_ch #fec14

30. Patient Empowerment UX
Learning about their medical situation and
understanding which actions can influence it
Learn /
Understand
Act
Quantify
Taking steps and enacting
change in their lives to affect
their medical situation
Gathering specific information on their
condition, which can be used to influence it
Patient
@idezo_ch #fec14

31. Data Types
Quantify
Gathering specific information on their
condition, which can be used to influence it
Quantified
Based on asking questions
Depends on observations of a
patient on how they feel
Effective in building historical
profiles of user states, emotions,
etc.
Measured data from an
instrument (reproducible)
Passively with wearable sensors
or IoT devices
Actively with specific tools
@idezo_ch #fec14

32. Hardware Prototyping for eHealth
Easy testing of medical parameters with
Arduino / Raspberry Pi
Flexible toolkit of basic
sensors
Open hardware platform
Convert physical
elements into digital
signals
@idezo_ch #fec14

33. Multiple Sensor Connections
@idezo_ch #fec14

34. Flexible Data Delivery iOS / Android App
API
@idezo_ch #fec14

35. Wearables and User Experience
Value for the
User?
Solve a user problem
Look at the device ecosystem
Be aware of sensor function
UI and device may be separate
The best solution might be invisible
@idezo_ch #fec14

36. Contact / Questions
mark@idezo.ch
@idezo_ch / @americanpeyote
@idezo_ch #fec14