How is Computer vision, machine learning, and mixed reality designed into innovative software built on the latest and greatest emerging experiences? Join Tim Huckaby in a keynote focused on the power of Computer Vision: Designing, developing, and putting interactive vision based software systems into production. This keynote will explain the components of computer vision like machine learning and demonstrate the use cases where computer vision solutions are happening. In addition, those coming in the immediate future. Moreover, speculate on the computer vision solutions of the future. This demo-heavy keynote will show you a number of real interactive solutions in the realm of 2D & 3D cameras in addition to mixed reality devices that produce interactive holographic experiences.

1. @ITCAMPRO #ITCAMP17Community Conference for IT Professionals
The Vision of Computer Vision: The bold
promise of teaching computers to understand the
visual world
Tim Huckaby
InterKnowlogy, Founder / Chairman
VSBLTY Founder / CTO
Microsoft Worldwide RD
Microsoft MVP, Artificial Intelligence
A lap around the
Microsoft Cognitive Services Vision API

2. @ITCAMPRO #ITCAMP17Community Conference for IT Professionals
Many thanks to our sponsors & partners!
GOLD
SILVER
PARTNERS
PLATINUM
POWERED BY

3. User Interface Innovation: What’s on the Horizon?Delivering the Art of Software
A Little Bit About Me and Why We I am Here…

4. https://binged.it/2qpYCvF
A THINK TANK OF MAKERS WHO CREATE FOR
ALL DIGITAL SURFACES

5. Who we work for...that we are
allowed to talk about...

6. Delivering the Art of Software
interknowlogy.com
1525 Faraday Ave, Suite 250, Carlsbad CA 92008
curious@interknowlogy.com

7. User Interface Innovation: What’s on the Horizon?Delivering the Art of Software
Computer Vision in Cognitive Services, Machine Learning and Artificial Intelligence
With Computer Vision, comes responsibility…
Objectives And Agenda
Using Machine Learning without being an expert
Where We have Been in Compuer Vision and Where We are Going
How to get started
Demos, Demos, Demos...

8. Bing
Image
API
Face API
Emotion
API
Computer
Vision API
Custom
Vision
Cognitive
Toolkit
U-SQL Gesture
Reco
Video
Indexer
Content
Moderator

9. Microsoft
Cognitive
Services
Give your apps
a human side

10. Microsoft
Cognitive
Services
Give your apps
a human side

11. Microsoft
Cognitive
Services
Give your apps
a human side

12. Roll your own with REST APIs
Simple to add: just a few lines
of code required
Make the same API code call on iOS,
Android, and Windows
Integrate into the language and
platform of your choice
Bring your own data for your custom
experience
Built by experts in their field from
Microsoft Research, Bing, and Azure
Machine Learning
Quality documentation, sample code,
and community support
Easy Flexible Tested
Why Microsoft Cognitive Services ?

13. Why?
The Seeing AI App
Computer Vision, Image, Speech Recognition, NLP,
and ML from Microsoft Cognitive Services
Watch Video HereRead Blog Here

14. Bing
Image
API
Face API
Emotion
API
Computer
Vision API
Custom
Vision
Cognitive
Toolkit
U-SQL Gesture
Reco
Video
Indexer
Content
Moderator

15. Bing
Image
API
Face API
Emotion
API
Computer
Vision API
Custom
Vision
Cognitive
Toolkit
U-SQL Gesture
Reco
Video
Indexer
Content
Moderator

16. Bing
Image
API
Face API
Emotion
API
Computer
Vision API
Custom
Vision
Cognitive
Toolkit
U-SQL Gesture
Reco
Video
Indexer
Content
Moderator

17. Face API
Tim Huckaby
• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI

18. Bing
Image
API
Face API
Emotion
API
Computer
Vision API
Custom
Vision
Cognitive
Toolkit
U-SQL Gesture
Reco
Video
Indexer
Content
Moderator

19. Tim Huckaby
• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI

20. VisionCaptor™
VisionCaptor™ marries high impact, engaging motion graphics
and interactive brand messaging on glass display at point-of-
sale in retail environments including supermarkets and c-store.
VSBLTY’s “first of its kind”, built-in facial recognition and data
capture technology delivers real time demographic analytics,
emotion detection, and other important KPI’s. Applications range
from informational display to dynamic video and advertising to
dynamic way finding.
DataCaptor™
DataCaptor™ soley uses the optics and analytics technology
and can be embedded into an end cap display in retail,
traditional out of home applications, and existing POS screens to
capture analytics and provide campaign measurement.

21. The engine behind the VSBLTY:
“GoldenTrout”
Tim Huckaby
• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI

22. Intelligent Kiosk: Real Time Crowd Insights
Tim Huckaby
• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI

23. Bing
Image
API
Face API
Emotion
API
Computer
Vision API
Custom
Vision
Cognitive
Toolkit
U-SQL Gesture
Reco
Video
Indexer
Content
Moderator

24. Computer Vision API
Content of Image:
Categories v0: [{ “name”: “animal”, “score”: 0.9765625 }]
V1: [{ "name": "grass", "confidence": 0.9999992847442627 },
{ "name": "outdoor", "confidence": 0.9999072551727295 },
{ "name": "cow", "confidence": 0.99954754114151 },
{ "name": "field", "confidence": 0.9976195693016052 },
{ "name": "brown", "confidence": 0.988935649394989 },
{ "name": "animal", "confidence": 0.97904372215271 },
{ "name": "standing", "confidence": 0.9632768630981445 },
{ "name": "mammal", "confidence": 0.9366017580032349,
"hint": "animal" },
{ "name": "wire", "confidence": 0.8946959376335144 },
{ "name": "green", "confidence": 0.8844101428985596 },
{ "name": "pasture", "confidence": 0.8332059383392334 },
{ "name": "bovine", "confidence": 0.5618471503257751,
"hint": "animal" },
{ "name": "grassy", "confidence": 0.48627158999443054 },
{ "name": "lush", "confidence": 0.1874018907546997 },
{ "name": "staring", "confidence": 0.165890634059906 }]
Describe
0.975 "a brown cow standing on top of a lush green field“
0.974 “a cow standing on top of a lush green field”
0.965 “a large brown cow standing on top of a lush green field”

25. Intelligent Kiosk – Vision API Explorer
Tim Huckaby
• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI

26. Bing
Image
API
Face API
Emotion
API
Computer
Vision API
Custom
Vision
Cognitive
Toolkit
U-SQL Gesture
Reco
Video
Indexer
Content
Moderator

27. U-SQL
Tim Huckaby
• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI

28. Bing
Image
API
Face API
Emotion
API
Computer
Vision API
Custom
Vision
Cognitive
Toolkit
U-SQL Gesture
Reco
Video
Indexer
Content
Moderator

29. Custom Vision Portal (IRIS)
Tim Huckaby
• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI

30. Object Recognition: “RoosterFish”
Tim Huckaby
• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI

31. Bing
Image
API
Face API
Emotion
API
Computer
Vision API
Custom
Vision
Cognitive
Toolkit
U-SQL Gesture
Reco
Video
Indexer
Content
Moderator

32. Microsoft
Cognitive
Toolkit
https://github.com/Microsoft/CNTK
Microsoft Cognitive Toolkit, CNTK

33. Bing
Image
API
Face API
Emotion
API
Computer
Vision API
Custom
Vision
Cognitive
Toolkit
U-SQL Gesture
Reco
Video
Indexer
Content
Moderator

35. Video Indexer: vi.microsoft.com
Tim Huckaby
• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI

36. Samples and Documentation:
https://azure.microsoft.com/en-us/services/cognitive-services/
How to Sign Up:
https://azure.microsoft.com/en-us/try/cognitive-services/
SDK:
https://github.com/Microsoft/ProjectOxford-ClientSDK
Samples in Github:
https://github.com/search?o=desc&p=1&q=org%3AMicrosoft+cognitive&s=updated&type
=Repositories
(from Github search on: org:Microsoft cognitive)

37. The Engaging User Experience & the Natural User InterfaceDelivering the Art of Software
More info on InterKnowlogy:
◦www.InterKnowlogy.com
◦http://ikeurope.com/
◦www.vimeo.com/InterKnowlogy
More info on VSBLTY:
◦www.VSBLTY.net
About Tim Huckaby…
• Founder/Chairman, InterKnowlogy, Actus Software, VSBLTY
• Microsoft® Global Regional Director
• Microsoft® AppDev Partner Advisory Council Founder /
Member
• Microsoft® MVP – Emerging Experiences
• Accomplished Author & Speaker
• Board Member: Facial Networks, Crespi Carmelite, San
Diego Fly Fishers
www.TimHuckaby.com
Contact Tim:
E-mail: TimHuck@InterKnowlogy.com
THuckaby@VSBLTY.net
Phone:
Office: 760-683-9650
Mobile:: 619 990 9200
Blog:
http://team.interknowlogy.com/blogs/timhuckaby
FaceBook:
http://www.facebook.com/Tim.Huckaby.Carlsbad
LinkedIn:
http://www.linkedin.com/in/timhuckaby
Twitter: @TimHuckaby
Tim Huckaby