SlideShare une entreprise Scribd logo
1  sur  28
Télécharger pour lire hors ligne
GETTING REAL ABOUT AR
Mark Billinghurst
mark.billinghurst@unisa.edu.au
August 26th 2015
50 Years of Progress
• From lab to living room
• AR devices in every pocket
1998 vs. 2008
CPU: 300 Mhz
HDD; 9GB
RAM: 512 mb
Camera: VGA 30fps
Graphics: 500K poly/sec
1998: SGI O2 2008: Nokia N95
CPU: 332 Mhz
HDD; 8GB
RAM: 128 mb
Camera: VGA 30 fps
Graphics: 2m poly/sec
AR Business Today
• Around $600 Million USD in 2014 (>$2B 2015)
• > 80% Games and Marketing applications
Market Projections
cf. 2014 computer game market = $84 Billion
Crossing the Chasm
http://www.gartner.com/newsroom/id/3114217
Getting from Here to There
• New markets
• Medical, Education, Industry
• New types of applications
• Training, Information Presentation, Collaboration
• New devices/platforms
• Head mounted displays, projected AR
• New Interaction Techniques
• Gesture based, empathic interfaces, multimodal
2012 – Iron Man 2
AR for Industrial Training
• Potential Benefits
•  Training on target equipment
•  Showing spatial information in place
•  Allow worker to remain focused on work site
•  Able to view content from any angle
Case Study 1: Vehicle Maintenance
•  Using AR for armoured vehicle maintence
Henderson, S. J., & Feiner, S. (2009, October). Evaluating the benefits of augmented reality for task localization
in maintenance of an armored personnel carrier turret. In ISMAR 2009. 8th IEEE International Symposium on
(pp. 135-144). IEEE.
Current System
• Electronic Manual on laptop computer
• 2D images, pdf, fixed views
Interfaces
• Three display conditions
• AR, HUD, LCD panel
• Using stereo video-see through AR HMD system
AR HUD LCD
Experiment
• 6 Mechanics as subjects
• Subjects completed 18 common tasks
• Installing fasteners, connecting cables, etc
• Measured
• Performance time, localisation time
• Errors made
• Head movement, exertion
• Subjective feedback (satisfaction, intuitiveness)
Key Results
• No difference in times between AR & LCD
• But LCD (34.5s) faster than HUD (55.2s)
• AR able to locate task areas faster
• 4.9s in AR, vs 9.2s in LCD, vs. 11.1s in HUD
• Fewer head motions in AR
• Typically 50% less motions than other conditions
• AR rated as good as LCD in satisfaction
• AR rated as most intuitive of conditions
Case Study 2: Boeing & Iowa State
•  Work instructions presented in 3 conditions
•  Desktop interface
•  Tablet interface
•  Tablet AR interface
T. Richardson, S. Gilbert, J. Holub, F. Thompson, A. MacAllister, R. Radkowski, E. Winer, P. Davies, and S.
Terry. "Fusing Self-Reported and Sensor Data from Mixed-Reality Training."
Desktop Interface Tablet AR Interface
Experiment Design
•  Reproduced industrial work cell
•  Task
•  Subjects completed a five-step physical assembly process
•  Data Collected
•  User motion, activity analysis
•  Task performance (accuracy, completion time)
•  Time looking at instructions, moving between work areas
•  Subjective feedback
Results
•  Users liked AR condition the best
•  Fewer errors in AR condition, faster performance time
•  AR has 30% faster performance, 90% few errors
Performance Time Errors
Commercial Systems
• Ngrain
• http://www.ngrain.com/
• Training authoring tool
• Model based AR tracking
• ScopeAR
• http://www.scopear.com/
• Remote assistance
• Image based tracking
Ngrain
IntelligentTraining
• Most AR systems stupid
• Don’t recognize user behaviour
• Don’t provide feedback
• Don’t adapt to user
• Especially important for training
• Scaffolded learning
• Moving beyond check-lists of actions
Intelligent Interfaces
• AR interface + intelligent tutoring system
•  ASPIRE constraint based system (from UC)
•  Constraints
•  relevance cond., satisfaction cond., feedback
Westerfield, G., Mitrovic, A., & Billinghurst, M. (2013). Intelligent Augmented
Reality Training for Assembly Tasks. In Artificial Intelligence in Education (pp.
542-551). Springer Berlin Heidelberg.
Domain Ontology
Intelligent Feedback
•  Actively monitors user behaviour
•  Implicit vs. explicit interaction
•  Provides corrective feedback
Evaluation Results
• 16 subjects, with and without ITS
• Improved task completion
• Improved learning
IntelligentAgents
• AR characters
• Virtual embodiment of system
• Multimodal input/output
• Examples
• AR Lego,Welbo, etc
• MrVirtuoso
•  AR character more real, more fun
•  On-screen 3D and AR similar in usefulness
Wagner, D., Billinghurst, M., & Schmalstieg, D. (2006). How real should virtual
characters be?. In Proceedings of the 2006 ACM SIGCHI international
conference on Advances in computer entertainment technology (p. 57). ACM.
Conclusions
• AR is becoming commonly available
• In order to achieve significant growth AR needs to
•  Expand into new markets
•  Move onto new platforms
•  Create new types of applications
• AR for Training is a particularly promising area
•  Spatial skills, intelligent interfaces
www.empathiccomputing.org
@marknb00
mark.billinghurst@unisa.edu.au

Contenu connexe

Tendances

2013 426 Lecture 1: Introduction to Augmented Reality
2013 426 Lecture 1: Introduction to Augmented Reality2013 426 Lecture 1: Introduction to Augmented Reality
2013 426 Lecture 1: Introduction to Augmented RealityMark Billinghurst
 
2016 AR Summer School - Lecture 5
2016 AR Summer School - Lecture 52016 AR Summer School - Lecture 5
2016 AR Summer School - Lecture 5Mark Billinghurst
 
COMP 4010 Lecture9 AR Displays
COMP 4010 Lecture9 AR DisplaysCOMP 4010 Lecture9 AR Displays
COMP 4010 Lecture9 AR DisplaysMark Billinghurst
 
Future Directions for Augmented Reality
Future Directions for Augmented RealityFuture Directions for Augmented Reality
Future Directions for Augmented RealityMark Billinghurst
 
Collaborative Immersive Analytics
Collaborative Immersive AnalyticsCollaborative Immersive Analytics
Collaborative Immersive AnalyticsMark Billinghurst
 
Ubiquitous Computer Vision in IoT
Ubiquitous Computer Vision in IoTUbiquitous Computer Vision in IoT
Ubiquitous Computer Vision in IoTnazlitemu
 
A Survey of Augmented Reality
A Survey of Augmented RealityA Survey of Augmented Reality
A Survey of Augmented RealityMark Billinghurst
 
COMP 4010 - Lecture1 Introduction to Virtual Reality
COMP 4010 - Lecture1 Introduction to Virtual RealityCOMP 4010 - Lecture1 Introduction to Virtual Reality
COMP 4010 - Lecture1 Introduction to Virtual RealityMark Billinghurst
 
Interaction Design
Interaction DesignInteraction Design
Interaction DesignKajsa Gren
 
COMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented RealityCOMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented RealityMark Billinghurst
 
Virtual Reality
Virtual RealityVirtual Reality
Virtual Realityrenoy reji
 
COMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented RealityCOMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented RealityMark Billinghurst
 
Mobile AR Lecture 3 - Prototyping
Mobile AR Lecture 3 - PrototypingMobile AR Lecture 3 - Prototyping
Mobile AR Lecture 3 - PrototypingMark Billinghurst
 
COMP 4010 - Lecture 8 AR Technology
COMP 4010 - Lecture 8 AR TechnologyCOMP 4010 - Lecture 8 AR Technology
COMP 4010 - Lecture 8 AR TechnologyMark Billinghurst
 
STEM Camp Virtual Reality
STEM Camp Virtual RealitySTEM Camp Virtual Reality
STEM Camp Virtual RealityTomasz Bednarz
 
Mobile AR Lecture 8 - AR Panoramas
Mobile AR Lecture 8 - AR PanoramasMobile AR Lecture 8 - AR Panoramas
Mobile AR Lecture 8 - AR PanoramasMark Billinghurst
 
COMP 4010 Lecture6 - Virtual Reality Input Devices
COMP 4010 Lecture6 - Virtual Reality Input DevicesCOMP 4010 Lecture6 - Virtual Reality Input Devices
COMP 4010 Lecture6 - Virtual Reality Input DevicesMark Billinghurst
 
COSC 426 Lecture 1: Introduction to Augmented Reality
COSC 426 Lecture 1: Introduction to Augmented RealityCOSC 426 Lecture 1: Introduction to Augmented Reality
COSC 426 Lecture 1: Introduction to Augmented RealityMark Billinghurst
 

Tendances (20)

2013 426 Lecture 1: Introduction to Augmented Reality
2013 426 Lecture 1: Introduction to Augmented Reality2013 426 Lecture 1: Introduction to Augmented Reality
2013 426 Lecture 1: Introduction to Augmented Reality
 
2016 AR Summer School - Lecture 5
2016 AR Summer School - Lecture 52016 AR Summer School - Lecture 5
2016 AR Summer School - Lecture 5
 
COMP 4010 Lecture9 AR Displays
COMP 4010 Lecture9 AR DisplaysCOMP 4010 Lecture9 AR Displays
COMP 4010 Lecture9 AR Displays
 
Future Directions for Augmented Reality
Future Directions for Augmented RealityFuture Directions for Augmented Reality
Future Directions for Augmented Reality
 
Collaborative Immersive Analytics
Collaborative Immersive AnalyticsCollaborative Immersive Analytics
Collaborative Immersive Analytics
 
Ubiquitous Computer Vision in IoT
Ubiquitous Computer Vision in IoTUbiquitous Computer Vision in IoT
Ubiquitous Computer Vision in IoT
 
A Survey of Augmented Reality
A Survey of Augmented RealityA Survey of Augmented Reality
A Survey of Augmented Reality
 
COMP 4010 - Lecture1 Introduction to Virtual Reality
COMP 4010 - Lecture1 Introduction to Virtual RealityCOMP 4010 - Lecture1 Introduction to Virtual Reality
COMP 4010 - Lecture1 Introduction to Virtual Reality
 
Interaction Design
Interaction DesignInteraction Design
Interaction Design
 
COMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented RealityCOMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented Reality
 
ARE 2011 AR Authoring
ARE 2011 AR AuthoringARE 2011 AR Authoring
ARE 2011 AR Authoring
 
Virtual Reality
Virtual RealityVirtual Reality
Virtual Reality
 
2013 Lecture3: AR Tracking
2013 Lecture3: AR Tracking 2013 Lecture3: AR Tracking
2013 Lecture3: AR Tracking
 
COMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented RealityCOMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented Reality
 
Mobile AR Lecture 3 - Prototyping
Mobile AR Lecture 3 - PrototypingMobile AR Lecture 3 - Prototyping
Mobile AR Lecture 3 - Prototyping
 
COMP 4010 - Lecture 8 AR Technology
COMP 4010 - Lecture 8 AR TechnologyCOMP 4010 - Lecture 8 AR Technology
COMP 4010 - Lecture 8 AR Technology
 
STEM Camp Virtual Reality
STEM Camp Virtual RealitySTEM Camp Virtual Reality
STEM Camp Virtual Reality
 
Mobile AR Lecture 8 - AR Panoramas
Mobile AR Lecture 8 - AR PanoramasMobile AR Lecture 8 - AR Panoramas
Mobile AR Lecture 8 - AR Panoramas
 
COMP 4010 Lecture6 - Virtual Reality Input Devices
COMP 4010 Lecture6 - Virtual Reality Input DevicesCOMP 4010 Lecture6 - Virtual Reality Input Devices
COMP 4010 Lecture6 - Virtual Reality Input Devices
 
COSC 426 Lecture 1: Introduction to Augmented Reality
COSC 426 Lecture 1: Introduction to Augmented RealityCOSC 426 Lecture 1: Introduction to Augmented Reality
COSC 426 Lecture 1: Introduction to Augmented Reality
 

Similaire à Getting Real About AR's Potential for Industrial Training

Augmented reality applications in manufacturing and maintenance
Augmented reality applications in manufacturing and maintenance Augmented reality applications in manufacturing and maintenance
Augmented reality applications in manufacturing and maintenance Jeffrey Funk
 
COMP 4010 Lecture 9 AR Interaction
COMP 4010 Lecture 9 AR InteractionCOMP 4010 Lecture 9 AR Interaction
COMP 4010 Lecture 9 AR InteractionMark Billinghurst
 
5 vuforia studio intro sales presentation
5 vuforia studio intro sales presentation5 vuforia studio intro sales presentation
5 vuforia studio intro sales presentationSenthilkumar R
 
Augmented Reality: The Next 20 Years
Augmented Reality: The Next 20 YearsAugmented Reality: The Next 20 Years
Augmented Reality: The Next 20 YearsMark Billinghurst
 
AI in the Enterprise: Past, Present & Future - StampedeCon AI Summit 2017
AI in the Enterprise: Past,  Present &  Future - StampedeCon AI Summit 2017AI in the Enterprise: Past,  Present &  Future - StampedeCon AI Summit 2017
AI in the Enterprise: Past, Present & Future - StampedeCon AI Summit 2017StampedeCon
 
Demystifying AR_VR_MR
Demystifying AR_VR_MRDemystifying AR_VR_MR
Demystifying AR_VR_MRPK Mishra
 
COMP 4010 Lecture12 - Research Directions in AR and VR
COMP 4010 Lecture12 - Research Directions in AR and VRCOMP 4010 Lecture12 - Research Directions in AR and VR
COMP 4010 Lecture12 - Research Directions in AR and VRMark Billinghurst
 
COMP 4010 Lecture10 AR/VR Research Directions
COMP 4010 Lecture10 AR/VR Research DirectionsCOMP 4010 Lecture10 AR/VR Research Directions
COMP 4010 Lecture10 AR/VR Research DirectionsMark Billinghurst
 
Dr. Jian Liang (HiScene): AR for Industry in China: From Concepts to Real App...
Dr. Jian Liang (HiScene): AR for Industry in China: From Concepts to Real App...Dr. Jian Liang (HiScene): AR for Industry in China: From Concepts to Real App...
Dr. Jian Liang (HiScene): AR for Industry in China: From Concepts to Real App...AugmentedWorldExpo
 
Immersive technology in_manufacturing for Academic Writing
Immersive technology in_manufacturing for Academic WritingImmersive technology in_manufacturing for Academic Writing
Immersive technology in_manufacturing for Academic WritingGowriShankarR04
 
UX for Connected Products: EuroIA16
UX for Connected Products: EuroIA16UX for Connected Products: EuroIA16
UX for Connected Products: EuroIA16Claire Rowland
 
2014 COSC 426 Lecture 2: Augmented Reality Technology
2014 COSC 426 Lecture 2: Augmented Reality Technology2014 COSC 426 Lecture 2: Augmented Reality Technology
2014 COSC 426 Lecture 2: Augmented Reality TechnologyMark Billinghurst
 
Application in Augmented and Virtual Reality
Application in Augmented and Virtual RealityApplication in Augmented and Virtual Reality
Application in Augmented and Virtual RealityMark Billinghurst
 
Workshop: AR Glasses and their Peculiarities
Workshop: AR Glasses and their PeculiaritiesWorkshop: AR Glasses and their Peculiarities
Workshop: AR Glasses and their PeculiaritiesMartin Lechner
 
Think Big | Enterprise Artificial Intelligence
Think Big | Enterprise Artificial IntelligenceThink Big | Enterprise Artificial Intelligence
Think Big | Enterprise Artificial IntelligenceData Science Milan
 
Augview presentation GE user conference bali 2014 - MIke Bundock
Augview presentation GE user conference bali 2014 - MIke BundockAugview presentation GE user conference bali 2014 - MIke Bundock
Augview presentation GE user conference bali 2014 - MIke BundockGeo AR Games
 
Augmented reality in E-commerce
Augmented reality in E-commerceAugmented reality in E-commerce
Augmented reality in E-commerceAshwin P
 
"Deep Learning for Manufacturing Inspection Applications," a Presentation fro...
"Deep Learning for Manufacturing Inspection Applications," a Presentation fro..."Deep Learning for Manufacturing Inspection Applications," a Presentation fro...
"Deep Learning for Manufacturing Inspection Applications," a Presentation fro...Edge AI and Vision Alliance
 

Similaire à Getting Real About AR's Potential for Industrial Training (20)

Augmented reality applications in manufacturing and maintenance
Augmented reality applications in manufacturing and maintenance Augmented reality applications in manufacturing and maintenance
Augmented reality applications in manufacturing and maintenance
 
COMP 4010 Lecture 9 AR Interaction
COMP 4010 Lecture 9 AR InteractionCOMP 4010 Lecture 9 AR Interaction
COMP 4010 Lecture 9 AR Interaction
 
5 vuforia studio intro sales presentation
5 vuforia studio intro sales presentation5 vuforia studio intro sales presentation
5 vuforia studio intro sales presentation
 
Augmented Reality: The Next 20 Years
Augmented Reality: The Next 20 YearsAugmented Reality: The Next 20 Years
Augmented Reality: The Next 20 Years
 
AI in the Enterprise: Past, Present & Future - StampedeCon AI Summit 2017
AI in the Enterprise: Past,  Present &  Future - StampedeCon AI Summit 2017AI in the Enterprise: Past,  Present &  Future - StampedeCon AI Summit 2017
AI in the Enterprise: Past, Present & Future - StampedeCon AI Summit 2017
 
Demystifying AR_VR_MR
Demystifying AR_VR_MRDemystifying AR_VR_MR
Demystifying AR_VR_MR
 
COMP 4010 Lecture12 - Research Directions in AR and VR
COMP 4010 Lecture12 - Research Directions in AR and VRCOMP 4010 Lecture12 - Research Directions in AR and VR
COMP 4010 Lecture12 - Research Directions in AR and VR
 
COMP 4010 Lecture10 AR/VR Research Directions
COMP 4010 Lecture10 AR/VR Research DirectionsCOMP 4010 Lecture10 AR/VR Research Directions
COMP 4010 Lecture10 AR/VR Research Directions
 
Dr. Jian Liang (HiScene): AR for Industry in China: From Concepts to Real App...
Dr. Jian Liang (HiScene): AR for Industry in China: From Concepts to Real App...Dr. Jian Liang (HiScene): AR for Industry in China: From Concepts to Real App...
Dr. Jian Liang (HiScene): AR for Industry in China: From Concepts to Real App...
 
Immersive technology in_manufacturing for Academic Writing
Immersive technology in_manufacturing for Academic WritingImmersive technology in_manufacturing for Academic Writing
Immersive technology in_manufacturing for Academic Writing
 
UX for Connected Products: EuroIA16
UX for Connected Products: EuroIA16UX for Connected Products: EuroIA16
UX for Connected Products: EuroIA16
 
2014 COSC 426 Lecture 2: Augmented Reality Technology
2014 COSC 426 Lecture 2: Augmented Reality Technology2014 COSC 426 Lecture 2: Augmented Reality Technology
2014 COSC 426 Lecture 2: Augmented Reality Technology
 
Application in Augmented and Virtual Reality
Application in Augmented and Virtual RealityApplication in Augmented and Virtual Reality
Application in Augmented and Virtual Reality
 
Workshop: AR Glasses and their Peculiarities
Workshop: AR Glasses and their PeculiaritiesWorkshop: AR Glasses and their Peculiarities
Workshop: AR Glasses and their Peculiarities
 
CHI 2013 DARE Course
CHI 2013 DARE CourseCHI 2013 DARE Course
CHI 2013 DARE Course
 
Think Big | Enterprise Artificial Intelligence
Think Big | Enterprise Artificial IntelligenceThink Big | Enterprise Artificial Intelligence
Think Big | Enterprise Artificial Intelligence
 
X10 shop
X10 shopX10 shop
X10 shop
 
Augview presentation GE user conference bali 2014 - MIke Bundock
Augview presentation GE user conference bali 2014 - MIke BundockAugview presentation GE user conference bali 2014 - MIke Bundock
Augview presentation GE user conference bali 2014 - MIke Bundock
 
Augmented reality in E-commerce
Augmented reality in E-commerceAugmented reality in E-commerce
Augmented reality in E-commerce
 
"Deep Learning for Manufacturing Inspection Applications," a Presentation fro...
"Deep Learning for Manufacturing Inspection Applications," a Presentation fro..."Deep Learning for Manufacturing Inspection Applications," a Presentation fro...
"Deep Learning for Manufacturing Inspection Applications," a Presentation fro...
 

Plus de Mark Billinghurst

Future Research Directions for Augmented Reality
Future Research Directions for Augmented RealityFuture Research Directions for Augmented Reality
Future Research Directions for Augmented RealityMark Billinghurst
 
Evaluation Methods for Social XR Experiences
Evaluation Methods for Social XR ExperiencesEvaluation Methods for Social XR Experiences
Evaluation Methods for Social XR ExperiencesMark Billinghurst
 
Empathic Computing: Delivering the Potential of the Metaverse
Empathic Computing: Delivering  the Potential of the MetaverseEmpathic Computing: Delivering  the Potential of the Metaverse
Empathic Computing: Delivering the Potential of the MetaverseMark Billinghurst
 
Empathic Computing: Capturing the Potential of the Metaverse
Empathic Computing: Capturing the Potential of the MetaverseEmpathic Computing: Capturing the Potential of the Metaverse
Empathic Computing: Capturing the Potential of the MetaverseMark Billinghurst
 
Talk to Me: Using Virtual Avatars to Improve Remote Collaboration
Talk to Me: Using Virtual Avatars to Improve Remote CollaborationTalk to Me: Using Virtual Avatars to Improve Remote Collaboration
Talk to Me: Using Virtual Avatars to Improve Remote CollaborationMark Billinghurst
 
Empathic Computing: Designing for the Broader Metaverse
Empathic Computing: Designing for the Broader MetaverseEmpathic Computing: Designing for the Broader Metaverse
Empathic Computing: Designing for the Broader MetaverseMark Billinghurst
 
2022 COMP 4010 Lecture 7: Introduction to VR
2022 COMP 4010 Lecture 7: Introduction to VR2022 COMP 4010 Lecture 7: Introduction to VR
2022 COMP 4010 Lecture 7: Introduction to VRMark Billinghurst
 
2022 COMP4010 Lecture 6: Designing AR Systems
2022 COMP4010 Lecture 6: Designing AR Systems2022 COMP4010 Lecture 6: Designing AR Systems
2022 COMP4010 Lecture 6: Designing AR SystemsMark Billinghurst
 
Novel Interfaces for AR Systems
Novel Interfaces for AR SystemsNovel Interfaces for AR Systems
Novel Interfaces for AR SystemsMark Billinghurst
 
2022 COMP4010 Lecture5: AR Prototyping
2022 COMP4010 Lecture5: AR Prototyping2022 COMP4010 Lecture5: AR Prototyping
2022 COMP4010 Lecture5: AR PrototypingMark Billinghurst
 
2022 COMP4010 Lecture4: AR Interaction
2022 COMP4010 Lecture4: AR Interaction2022 COMP4010 Lecture4: AR Interaction
2022 COMP4010 Lecture4: AR InteractionMark Billinghurst
 
2022 COMP4010 Lecture3: AR Technology
2022 COMP4010 Lecture3: AR Technology2022 COMP4010 Lecture3: AR Technology
2022 COMP4010 Lecture3: AR TechnologyMark Billinghurst
 
2022 COMP4010 Lecture2: Perception
2022 COMP4010 Lecture2: Perception2022 COMP4010 Lecture2: Perception
2022 COMP4010 Lecture2: PerceptionMark Billinghurst
 
2022 COMP4010 Lecture1: Introduction to XR
2022 COMP4010 Lecture1: Introduction to XR2022 COMP4010 Lecture1: Introduction to XR
2022 COMP4010 Lecture1: Introduction to XRMark Billinghurst
 
Empathic Computing and Collaborative Immersive Analytics
Empathic Computing and Collaborative Immersive AnalyticsEmpathic Computing and Collaborative Immersive Analytics
Empathic Computing and Collaborative Immersive AnalyticsMark Billinghurst
 
Empathic Computing: Developing for the Whole Metaverse
Empathic Computing: Developing for the Whole MetaverseEmpathic Computing: Developing for the Whole Metaverse
Empathic Computing: Developing for the Whole MetaverseMark Billinghurst
 
Research Directions in Transitional Interfaces
Research Directions in Transitional InterfacesResearch Directions in Transitional Interfaces
Research Directions in Transitional InterfacesMark Billinghurst
 
Comp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research DirectionsComp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research DirectionsMark Billinghurst
 

Plus de Mark Billinghurst (20)

Future Research Directions for Augmented Reality
Future Research Directions for Augmented RealityFuture Research Directions for Augmented Reality
Future Research Directions for Augmented Reality
 
Evaluation Methods for Social XR Experiences
Evaluation Methods for Social XR ExperiencesEvaluation Methods for Social XR Experiences
Evaluation Methods for Social XR Experiences
 
Empathic Computing: Delivering the Potential of the Metaverse
Empathic Computing: Delivering  the Potential of the MetaverseEmpathic Computing: Delivering  the Potential of the Metaverse
Empathic Computing: Delivering the Potential of the Metaverse
 
Empathic Computing: Capturing the Potential of the Metaverse
Empathic Computing: Capturing the Potential of the MetaverseEmpathic Computing: Capturing the Potential of the Metaverse
Empathic Computing: Capturing the Potential of the Metaverse
 
Talk to Me: Using Virtual Avatars to Improve Remote Collaboration
Talk to Me: Using Virtual Avatars to Improve Remote CollaborationTalk to Me: Using Virtual Avatars to Improve Remote Collaboration
Talk to Me: Using Virtual Avatars to Improve Remote Collaboration
 
Empathic Computing: Designing for the Broader Metaverse
Empathic Computing: Designing for the Broader MetaverseEmpathic Computing: Designing for the Broader Metaverse
Empathic Computing: Designing for the Broader Metaverse
 
2022 COMP 4010 Lecture 7: Introduction to VR
2022 COMP 4010 Lecture 7: Introduction to VR2022 COMP 4010 Lecture 7: Introduction to VR
2022 COMP 4010 Lecture 7: Introduction to VR
 
2022 COMP4010 Lecture 6: Designing AR Systems
2022 COMP4010 Lecture 6: Designing AR Systems2022 COMP4010 Lecture 6: Designing AR Systems
2022 COMP4010 Lecture 6: Designing AR Systems
 
ISS2022 Keynote
ISS2022 KeynoteISS2022 Keynote
ISS2022 Keynote
 
Novel Interfaces for AR Systems
Novel Interfaces for AR SystemsNovel Interfaces for AR Systems
Novel Interfaces for AR Systems
 
2022 COMP4010 Lecture5: AR Prototyping
2022 COMP4010 Lecture5: AR Prototyping2022 COMP4010 Lecture5: AR Prototyping
2022 COMP4010 Lecture5: AR Prototyping
 
2022 COMP4010 Lecture4: AR Interaction
2022 COMP4010 Lecture4: AR Interaction2022 COMP4010 Lecture4: AR Interaction
2022 COMP4010 Lecture4: AR Interaction
 
2022 COMP4010 Lecture3: AR Technology
2022 COMP4010 Lecture3: AR Technology2022 COMP4010 Lecture3: AR Technology
2022 COMP4010 Lecture3: AR Technology
 
2022 COMP4010 Lecture2: Perception
2022 COMP4010 Lecture2: Perception2022 COMP4010 Lecture2: Perception
2022 COMP4010 Lecture2: Perception
 
2022 COMP4010 Lecture1: Introduction to XR
2022 COMP4010 Lecture1: Introduction to XR2022 COMP4010 Lecture1: Introduction to XR
2022 COMP4010 Lecture1: Introduction to XR
 
Empathic Computing and Collaborative Immersive Analytics
Empathic Computing and Collaborative Immersive AnalyticsEmpathic Computing and Collaborative Immersive Analytics
Empathic Computing and Collaborative Immersive Analytics
 
Metaverse Learning
Metaverse LearningMetaverse Learning
Metaverse Learning
 
Empathic Computing: Developing for the Whole Metaverse
Empathic Computing: Developing for the Whole MetaverseEmpathic Computing: Developing for the Whole Metaverse
Empathic Computing: Developing for the Whole Metaverse
 
Research Directions in Transitional Interfaces
Research Directions in Transitional InterfacesResearch Directions in Transitional Interfaces
Research Directions in Transitional Interfaces
 
Comp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research DirectionsComp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research Directions
 

Dernier

Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkPixlogix Infotech
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
A Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxA Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxAna-Maria Mihalceanu
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
Accelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with PlatformlessAccelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with PlatformlessWSO2
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
Infrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platformsInfrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platformsYoss Cohen
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Kaya Weers
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
4. Cobus Valentine- Cybersecurity Threats and Solutions for the Public Sector
4. Cobus Valentine- Cybersecurity Threats and Solutions for the Public Sector4. Cobus Valentine- Cybersecurity Threats and Solutions for the Public Sector
4. Cobus Valentine- Cybersecurity Threats and Solutions for the Public Sectoritnewsafrica
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observabilityitnewsafrica
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...itnewsafrica
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 

Dernier (20)

Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App Framework
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
A Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxA Glance At The Java Performance Toolbox
A Glance At The Java Performance Toolbox
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
Accelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with PlatformlessAccelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with Platformless
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
Infrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platformsInfrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platforms
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
4. Cobus Valentine- Cybersecurity Threats and Solutions for the Public Sector
4. Cobus Valentine- Cybersecurity Threats and Solutions for the Public Sector4. Cobus Valentine- Cybersecurity Threats and Solutions for the Public Sector
4. Cobus Valentine- Cybersecurity Threats and Solutions for the Public Sector
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 

Getting Real About AR's Potential for Industrial Training

  • 1. GETTING REAL ABOUT AR Mark Billinghurst mark.billinghurst@unisa.edu.au August 26th 2015
  • 2. 50 Years of Progress • From lab to living room • AR devices in every pocket
  • 3. 1998 vs. 2008 CPU: 300 Mhz HDD; 9GB RAM: 512 mb Camera: VGA 30fps Graphics: 500K poly/sec 1998: SGI O2 2008: Nokia N95 CPU: 332 Mhz HDD; 8GB RAM: 128 mb Camera: VGA 30 fps Graphics: 2m poly/sec
  • 4. AR Business Today • Around $600 Million USD in 2014 (>$2B 2015) • > 80% Games and Marketing applications
  • 5. Market Projections cf. 2014 computer game market = $84 Billion
  • 7. Getting from Here to There • New markets • Medical, Education, Industry • New types of applications • Training, Information Presentation, Collaboration • New devices/platforms • Head mounted displays, projected AR • New Interaction Techniques • Gesture based, empathic interfaces, multimodal
  • 9. AR for Industrial Training • Potential Benefits •  Training on target equipment •  Showing spatial information in place •  Allow worker to remain focused on work site •  Able to view content from any angle
  • 10. Case Study 1: Vehicle Maintenance •  Using AR for armoured vehicle maintence Henderson, S. J., & Feiner, S. (2009, October). Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret. In ISMAR 2009. 8th IEEE International Symposium on (pp. 135-144). IEEE.
  • 11. Current System • Electronic Manual on laptop computer • 2D images, pdf, fixed views
  • 12. Interfaces • Three display conditions • AR, HUD, LCD panel • Using stereo video-see through AR HMD system AR HUD LCD
  • 13. Experiment • 6 Mechanics as subjects • Subjects completed 18 common tasks • Installing fasteners, connecting cables, etc • Measured • Performance time, localisation time • Errors made • Head movement, exertion • Subjective feedback (satisfaction, intuitiveness)
  • 14. Key Results • No difference in times between AR & LCD • But LCD (34.5s) faster than HUD (55.2s) • AR able to locate task areas faster • 4.9s in AR, vs 9.2s in LCD, vs. 11.1s in HUD • Fewer head motions in AR • Typically 50% less motions than other conditions • AR rated as good as LCD in satisfaction • AR rated as most intuitive of conditions
  • 15. Case Study 2: Boeing & Iowa State •  Work instructions presented in 3 conditions •  Desktop interface •  Tablet interface •  Tablet AR interface T. Richardson, S. Gilbert, J. Holub, F. Thompson, A. MacAllister, R. Radkowski, E. Winer, P. Davies, and S. Terry. "Fusing Self-Reported and Sensor Data from Mixed-Reality Training." Desktop Interface Tablet AR Interface
  • 16. Experiment Design •  Reproduced industrial work cell •  Task •  Subjects completed a five-step physical assembly process •  Data Collected •  User motion, activity analysis •  Task performance (accuracy, completion time) •  Time looking at instructions, moving between work areas •  Subjective feedback
  • 17. Results •  Users liked AR condition the best •  Fewer errors in AR condition, faster performance time •  AR has 30% faster performance, 90% few errors Performance Time Errors
  • 18. Commercial Systems • Ngrain • http://www.ngrain.com/ • Training authoring tool • Model based AR tracking • ScopeAR • http://www.scopear.com/ • Remote assistance • Image based tracking
  • 20. IntelligentTraining • Most AR systems stupid • Don’t recognize user behaviour • Don’t provide feedback • Don’t adapt to user • Especially important for training • Scaffolded learning • Moving beyond check-lists of actions
  • 21. Intelligent Interfaces • AR interface + intelligent tutoring system •  ASPIRE constraint based system (from UC) •  Constraints •  relevance cond., satisfaction cond., feedback Westerfield, G., Mitrovic, A., & Billinghurst, M. (2013). Intelligent Augmented Reality Training for Assembly Tasks. In Artificial Intelligence in Education (pp. 542-551). Springer Berlin Heidelberg.
  • 23. Intelligent Feedback •  Actively monitors user behaviour •  Implicit vs. explicit interaction •  Provides corrective feedback
  • 24.
  • 25. Evaluation Results • 16 subjects, with and without ITS • Improved task completion • Improved learning
  • 26. IntelligentAgents • AR characters • Virtual embodiment of system • Multimodal input/output • Examples • AR Lego,Welbo, etc • MrVirtuoso •  AR character more real, more fun •  On-screen 3D and AR similar in usefulness Wagner, D., Billinghurst, M., & Schmalstieg, D. (2006). How real should virtual characters be?. In Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology (p. 57). ACM.
  • 27. Conclusions • AR is becoming commonly available • In order to achieve significant growth AR needs to •  Expand into new markets •  Move onto new platforms •  Create new types of applications • AR for Training is a particularly promising area •  Spatial skills, intelligent interfaces