11. Voice &
Sound
Voice control
Use of language creates an efficient way to access a large set of
commands.
Conversational agent
Users can interact with a system without prior knowledge of the system’s
commands.
Audio security
Voice signature shifts the burden of identification away from the user to
the system.
New data channels
Utilizing audio channels opens up additional ways to transmit data.
Thursday,August 23, 12
Thursday, October 25, 12
12. Unlock your mobile phone or computer
using your voice.
Voice &
Sound
Thursday, October 25, 12
13. Voice &
Sound
Ask Siri any question,
she’ll try to help you
answer it.
Thursday, October 25, 12
14. 1.If you don’t have an iPhone 4S, buddy up or use
the phone on the table
2.Launch Siri, by press and holding the home key
3.Tap the Siri icon
4.Ask Siri a Question
• What's on my calendar for Friday?
• Wake me up tomorrow at 7am
• How do I get home?
• Note that I spent $12 on lunch
• How many days until Christmas?
• How much wood would a woodchuck chuck?
Voice &
Sound
Thursday, October 25, 12
16. Augmented reality
Additional intelligence layered on top of natural life.
Visual security
Shifts the burden of identification away from the user to the system.
Emotion tracking
The system proactively reads the user and can adapt in a natural way.
Sight
Thursday, October 25, 12
17. Explore the world around using with help
fromYelp and augmented reality
Sight
Thursday, October 25, 12
19. 1.Hold the phone in portrait mode
2.Try Word Lens Demo or the phone on the table
3.Launch Word Lens
4.Hold word lens up to the sample text
5.Watch word lens translate from English to Spanish
Sight
Thursday, October 25, 12
20. Automatically measure an entire room’s
dimension and generate a blue print.
Sight
Thursday, October 25, 12
23. Touch &
Gestures
Powerful collaboration
Users share control over the interface in a way not possible with single input
devices. (mouse, keyboard, remote control, etc)
Utilizing three dimensions
Traditional inputs track X/Y coordinates. NUI’s create a more direct
connection to content by taking advantage of depth in movement.
Affordances
The digital representation of a physical object (book) allows the user to take
advantage of all the things a user already knows about how to use the object.
Thursday, October 25, 12
26. Touch &
Gestures
1.Launch Dolphin Browser
2.Tap the on the bottom tool bar
3.Draw a Capital G (to go to Google)
4.Tap the on the bottom tool bar
5.Draw a Capital N (open a new browser tab)
1.Tap the on the bottom tool bar
2.Draw a Capital M (to go to Mint)
Thursday, October 25, 12
27. Using the camera
users can swipe to
turn pages.Avoiding
sticky hands on the
screen.
Touch &
Gestures
Thursday, October 25, 12
28. Using the camera to capture body size to
shop for clothing online.
Touch &
Gestures
Thursday, October 25, 12
31. Location &
Motion
Physical controls
Physical inputs (weight, tile, rotation) are translated into digital outputs.
Relational awareness
Devices know where you are in relation to other people and act as an agent
for the user.
Monitor physical
movements
This additional source of information can be used to help systems (and users)
understand more about themselves in order to learn and adapt.
Thursday, October 25, 12
32. Perform CPR the correct
way to save a life.
Location &
Motion
Thursday, October 25, 12
33. 1.Launch PocketCPR
2.Tap Start CPR Hands-Only
3.Tap right arrow to advance tutorial
4.Practice CPR using pillow
Location &
Motion
Thursday, October 25, 12
34. Users can track their jump height and
energy levels.
Location &
Motion
Thursday, October 25, 12
36. Biometrics
Haptics
Digitial feedback can mimic physical sensations, creating a wide
range of experiences from a single device.
Body monitoring
Systems can start to “read” body language as an input.
Gestures can move beyond the hand and finger.
Biometric security
Shifts the burden of identification away from the user to the
system. Users don’t need to remember their password, they simply
Thursday, October 25, 12
37. A revolutionary way to
check your heart rate
using the phone’s camera
Biometrics
Thursday, October 25, 12
38. 1.Launch Instant Heart Rate **
2.Select Get Started
3.Cover entire camera lens using your finger tip
Don’t press too hard.
4.Wait until app reads heart rate
Biometrics
Thursday, October 25, 12
39. All your sleep information
monitored and tracked
using your iPhone
Biometrics
Thursday, October 25, 12
40. Emotiv lets you control an interface
using just a thought.
Biometrics
Thursday, October 25, 12