Stephen Aponte Jr.'s presentation from CEWIT2013 is now present online through slideshare! Learn more about voice driven user interface design by reading his slides or you can contact Intelligent Product Solutions at www.intelligentproductsolutions.com for any questions you may have.

1. CEWIT 2013
Visual Computing – Voice Driven Computing User Interface Design

2. Intelligent Product Solutions
WHO ARE WE?
UNRELENTING DEDICATION
TO GREAT PRODUCT DESIGN.
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.
THOUGHT THROUGH.
REALLY.
JUST STRAIGHT TALK.

3. Wearable Computing Market Trends
“ABI Research forecasts the wearable computing device market will grow to 485 million annual device shipments by 2018.”
(ABIresearch, 2013)
“According to IMS Research, the wearables market is poised to grow from 14 million devices shipped in 2011 to as many as
171 million units shipped by 2016.” (Ballve, 2013)
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.

4. Evolution of Head Mounted Computers
1980’s
Present
Motorola HC1
Vuzix Smart Glasses M100
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.

5. Evolution of Voice Driven Applications
• Automobiles
• Phone functions
• GPS navigation
• Media controls
• Radio controls
• General purpose computing for those in need
• Example: Voice activated GPS systems for the blind
• Smart phones
• Siri
• Google Voice
• Wearable computers
• Replaces mouse and keyboard
• Televisions?
• Replaces clunky remote
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.

6. Two Major Challenges w/ Speech Enabled UI
1. What are the features and are they obvious??
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.
2. Phrasing

7. Voice Enabled UI on a Head Mounted Computer - Challenges
•
•
•
•
•
•
•
•
Speech recognition engine personality
Environmental issues (Noise)
Varying accents
Processing different vocabulary
Visual cues to commands – “What do I say?”
Application layout & UI
Voice optimized application workflow
Security
“Item 7”
“View Library”
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.
“Item 2”

8. SR Personality, Environmental (Noise), Accents, & Vocabulary
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.

9. Visual Cues – “What Do I Say”?
1. Speech icon
2. Global Commands
•
•
•
•
•
•
•
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.
“Main Menu”
“View Library”
“Get Message”
“Camera Feed”
“Request Expert”
“Logout”
“Quit Application”
3. “My Computer Help

10. Application Layout & UI Design Methods – UX Storyboarding
Storyboards
Storyboardsare
used to consider
are used to
the system from
consider the
a human system from a
centered
human - point of
view.
centered
point of view.
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.

11. Application Layout & UI Design Methods – UX Workflows
CAMERA
Workflows
are used to
fully think
the UI
experience
through
LIBRARY
LOG IN
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.
EXPERT
SESSION

12. Application Layout & UI Design Methods – UX Behavioral & Flow
The user
The user
experience is is
experience
carefully
carefully
considered by by
considered
creating specific
creating
detailed use
specific
cases for real
detailed use
user goals. real
cases for
user goals.
Library: Levels 1-4
Search by Voice
Main Menu
“Alpha, Chapter…”
Final Selection
“View Document”
Content Specific
“Item 3, Item 7,
Item 5, Item 3…”
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.
“View Document”

13. Application Layout & UI Design Methods – UX System Logic: Speech Recognition
Session workflow
from the HC1
perspective.
Start
Program
Verify
connectivity
to server
Connection
successful
Pick
machine to
view
“Quit
application”
View
Media
Log in to
server
Online &
waiting for
“View command
Library”
“Item X”
“Request Expert”
Wait for
expert to
connect
Expert
voice
connect
View
Document
“Take
snapshot”
“Camera
feed”
“Video
record”
Snapshot
Saved
Real Time
Session
Expert Active
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.
“Log out”
Video
Recording
Video
Streaming
Viewing
Camera
Camera Active

14. Security
Creating a
method to
log into the
system
with voice
as your
only input
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.

15. Maturing The UI Over Time
ORIGINAL
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.
INTERMIDIATE
FINAL

16. Developing A Model That Spans Across Industries & Markets
MANUFACTURING
UTILITIES
ABC COMPANY
Category A (3)
Category A (3)
Category G (5)
Category B (2)
Category B (2)
Category H (11)
Category C (5)
Category C (5)
Category I (3)
Category D (13)
Category D (13)
Category J (6)
Category E (1)
Category E (1)
Category K (8)
Category F (22)
Category F (22)
Category L (16)
MILITARY MRO
EMERGENCY MEDICINE
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.
VEHICLE REPAIR
HOSPITAL

17. References
ABIresearch (2013). “Wearable Computing Devices, Like Apple’s iWatch, W ill Exceed 485 Million Annual Shipments by 2018.” Online. Available:
https://www.abiresearch.com/press/wearable-computing-devices-like-apples-iwatch-will
Ballve, M. (2013). “WEARABLE COMPUTING: Inside The New Mobile Market That Is Taking Shape.” Online. Available:
http://www.businessinsider.com/wearables-create-new-mobile-markets-2013-9
IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS.
Disclosure of the information contained herein to any third party is strictly prohibited.