Touching More than 3 Dimensions Research Into Novel Interfaces – three dimensions and above
•Télécharger en tant que PPTX, PDF•
5 j'aime•1,543 vues
Work on interactive tabletops and surfaces has focused mostly on two-dimensional issues, such as multi-finger gestures and tangible interaction. Interesting as it is, however this picture is missing several dimensions. I will describe work on 2D and 3D semi-immersive environments and present novel on-and-above-the-surface techniques based on bi-manual models to take advantage of the continuous interaction space for creating and editing 3D models in stereoscopic environments. I will also discuss means to allow for more expressive interactions, including novel uses of sound and combining hand and finger tracking in the space above the table with multitouch gestures on its surface continuously. These combinations can provide alternative design environments and allow novel interaction modalities.
Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (20)
En vedette
Similaire à Touching More than 3 Dimensions Research Into Novel Interfaces – three dimensions and above
Similaire à Touching More than 3 Dimensions Research Into Novel Interfaces – three dimensions and above (20)
Plus de Joaquim Jorge
Plus de Joaquim Jorge (20)
Dernier
Dernier (20)
Touching More than 3 Dimensions Research Into Novel Interfaces – three dimensions and above
- 1. Touching More than 3 Dimensions Research Into Novel Interfaces – three dimensions and above Joaquim Jorge INESC-ID & IST / U Lisboa Portugal IP / Leiria Nov 2015
- 2. Joaquim Jorge Instituto Superior Técnico Universidade de Lisboa Visualization and Multimodal Interfaces @ INESC-ID Lisboa http://web.ist.utl.pt/jorgej ACM/SIGGRAPH Small Conferences Committee Chair Editor Computers & GraphicsResearch Interests: Calligraphic Interaction, Multimodal Interfaces, Graphical Modeling
- 3. IS TONY STARK HOME IS TONY STARK HOME ?
- 4. WE HAVE SEEN THE FUTURE…
- 7. NATURAL INTERACTION Ivan Sutherland – 52 years ago
- 8. Ivan Sutherland SketchPad Video youtube.com/watch?v=495nCzxM9PI
- 9. Beyond 2D + Space Continuous Above + Hands Bimanual Interactions + Dimensions 3D UIs + Expressiveness Sound, Kicking + Proxemics Eery Space
- 10. INTERACT 2011 Interaction Techniques Unifying Touch and Gesture On and Above a Digital Surface
- 11. The Continuous Interaction Space Video http://youtu.be/A8kb7BV7j1Y
- 12. Exploring Bimanual Interaction on a TableTop www.shapeshop3d.com
- 13. Pedro Lopes, Daniel Mendes, Bruno Araújo, Joaquim A. Jorge Combining bimanual manipulation and pen-based input for 3D modeling, SBIM 2011
- 14. Key Points Table Architecture Combining Pen and Gestures Asymetric Guiard Model
- 18. Evaluation More sketching, less camera
- 19. Evaluation Camera operations: more fluid (seconds) 44% faster
- 20. Evaluation Hand Role Distribution 9% 91% 3% 80% 17%
- 21. Evaluation Users prefer touch for all manipulations Imagem e benefits of direct vs indirect
- 23. Observations Bimanual workspace and hand role
- 24. Observations Natural resting position of NDH
- 25. Observations Pen-only often forces re-arrangement
- 26. Observations Pen-only causes too much DH motion
- 27. Observations Rotate gesture was frail, swapped pen to NDH
- 28. Observations Combined gestures were naturally used
- 29. Getting it together: Mockup Builder
- 30. Setup Multitouch 120Hz Touch 16.25 DPI 3D SVGA 120Hz Active Stereo Kinect (30Hz) Gametrak (120Hz)
- 31. Gametrak
- 32. User Model Active User Kinect Head Position Kinect Hand Position (Right/Left) Kinect Finger touches Table 4 Fingers tracked in Space (Gametrak) Finger X from Hand Y on or above the surface from user Z
- 33. BIMANUAL Asymmetric DH : SketchingNDH : Manipulation Modes Hands (WIMP)
- 35. NDH: Context Menus DH: Selects
- 36. ON & ABOVE THE SURFACE Snapping Discrete Constraint Continuous Constraints On the fly Active as long as needed
- 37. Preliminary Results expert architect Rhino3D 5’20” 2’45” 5’41” 3’46” xpert User our modeler
- 38. Touching The 3D Dimension, Dagstuhl Feb. 2012 Modeling On and Above a Stereoscopic Multitouch Display, (3DCHI): May, 2012. Mockup Builder: Direct 3D Modeling On and Above the Surface in a Continuous Interaction Space (GI'2012), May 28 - May 30, 2012. Special Section C&G (January 2013) ACM Spatial User Interfaces Symposia (SUI)
- 39. Adding Sound to Multimodal Interfaces ITS 2011
- 40. Take-Home message Touch signature Impact Intensity Interaction space Tangibles
- 41. Take-Home message Touch signature Impact Intensity Interaction space Tangibles
- 42. Take-Home message Touch signature Impact Intensity Interaction space Tangibles
- 43. Take-Home message Touch signature Impact Intensity Interaction space Tangibles
- 50. Acoustic Sensing Conclusions Understand impact (amplitude)
- 51. Acoustic Sensing Conclusions Recognize contact parts (timbre)
- 54. Let’s Kick It CHI 2014 Exploring New Interaction Space Large Scale Displays Interacting with the bottom of the screen
- 55. Beyond Situated Displays Eery Space
- 56. Remote Proxemics: Person to Device Interactions
- 58. Proxemics Distances [Hall, 1966]
- 59. Eery Space
- 60. Providing Awareness: Floor Circles
- 61. Issues Working / Virtual Space Simple Operators / Dialogues Implicit Mode Changes Continuous Transition Asymmetric Bimanual Modes
- 62. Take Home Message Extending Touch With Other Modalities Bimanual Interaction Explore Surface Above Table Use Sound in Novel Ways Explore New Modalities Proxemics as tool for implicit interactions
- 63. Research Issues
- 64. Content Creation in VEs Sketch Interpretation (3D) New Modalities Self Disclosure (Not!) Understandability
- 65. Thank You! Joaquim Jorge http://web.ist.utl.pt/jorgej Bruno Rodrigues De Araújo Maurício de Sousa Ricardo Jorge Jota Costa Pedro Lopes Daniel Mendes
Notes de l'éditeur
- ACRESCENTAR VIDEO MINORITY REPORT
- Pinter accao natural 3D Modelling should rely on more natural interaction techniques and take more advantage of virtual environments not only for visualization Ambientes Virtuais e Estereo mas não so para visualizacao Mas tambem para modelacao O conteudo virtual deveria libertar restricoes fisicas das maquetes
- The Continuous Interaction Space: Interaction Techniques Unifying Touch and Gesture On and Above a Digital Surface
- Questionnaire Analysis
- Questionnaire Analysis
- Implicit Switch between creation and manipulation DH : Sketching NDH : Manipulation (T R S 1 or 2 fingers/hands)
- On and Above Surface Interaction On surface: Sketch Based Modeling Interface Above the surface: Push and Pull Modelling Metaphor Shapes created by extrusion Topological Features (Vertex, Edge, Faces) Movable Curvilinear Extrusion
- Contextual Simple Menu (2D layer) Selection DH Menu Location NDH Only Visible if NDH close to surface Fading Effect Dynamic Moving
- DH Modelling NDH Operation Attribute complement DH NDH Operation mode Snapping Clonning Constraint Snapping Switch between surface and space Discrete Constraint Position of Clonning Activate Mirror Plane for Sketches Limit Extrusion while Extruding Continuous Constraint Scaling Profile Factor while extruding (cone, frustum...) Constraint Definition
- Working/Virtual Space Co-location Simple Operators and Dialogues Data Fusion from several devices Benefits of on and above interaction Continuous transition surface and space Asymmetric Bimanual Interaction Implicit Mode Switch Good Not error prone for non familiar users Some relaxation needed Button vs Pinch gesture vs other modalities Physics Initially considered for Modeling Sketch based Beautification (measures needed)
- Also, As prof-of-concept for person to device interactions, We devised the role of the moderator of the meeting, when in close proximity to a wall display, the person assuming that role can perform actions that relate to every participant.
- People like to meet in person, and when they do, they communicate in different manners besides verbally. Edward Hall states that space and distance play key roles in the way people communicate. Therefore, Proxemics are a non-verbal type of communication and can be exploited in the context of virtual meetings.
- We use the Proxemic Distances model to provide the necessary knowledge to bring social interactions into virtual meetings. To provide, the means for people to implicitly and automatically start remote interactions just by getting together.
- Avatars and telepresence robots are a poor representation of people, and they contribute to the lack of presence Our model do not play by the same rules The question is not how well we represent people. The important part of our research is the representation of interactions occurring around the room.
- We use a ceiling mounted projector to display floor circles which account for the position of all eery space participants. In this way, every one becomes aware of their intimate space (the inner circle) and their personal space (the outer ring). The dimensions follow the proxemic distances proposed by Edward Hall. In this figure, we display two people forming a social bubble, and performing a collaborative task. Again, there is no need for high definition avatars or video for people to know about the presence of others.
- Working/Virtual Space Co-location Simple Operators and Dialogues Data Fusion from several devices Benefits of on and above interaction Continuous transition surface and space Asymmetric Bimanual Interaction Implicit Mode Switch Good Not error prone for non familiar users Some relaxation needed Button vs Pinch gesture vs other modalities Physics Initially considered for Modeling Sketch based Beautification (measures needed)