Summary and Conclusions of the third Interna5onal AR Standards Mee5ng. June 15-16, 2011 Taichung, Taiwan

Transcription

1 Summary and Conclusions of the third Interna5onal AR Standards Mee5ng June 15-16, 2011 Taichung, Taiwan

2 Thank you to our sponsors/hosts June 17, 2011 (c) 2011 Chris5ne Perey 2

3 Co- Chairs & Program CommiLee Chris5ne Perey PEREY Research & Consul5ng Switzerland George Percivall OGC USA Dr. Bao- Shuh Paul Lin NCTU and CoCID Ministry of Economic Affairs (MOEA) Taiwan Neil TreveL, NVIDIA Mar5n Lechner, Wikitude Carl Reed, OGC Douglas Knisely, Qualcomm Gerard Kim, Korea University Adrian David Cheok, Na5onal University of Singapore Ed Parsons, Google Lars Erik Bolstad, Opera June 17, 2011 (c) 2011 Chris5ne Perey 3

4 Par$cipant Countries Taiwan US UK Korea Germany Others ~ 46 par5cipants > 50% OGC members Industry vs Academic/Research Four Taiwanese Universi5es were represented Mee5ng host was Feng Chia University (Taichung) Industry Academic Government June 17, 2011 (c) 2011 Chris5ne Perey 4

5 Agenda- at- a- Glance Day One What are each of the SDOs doing? AR Architectures Mass Market Domain Working Group Breakout groups Day Two Emerging Challenges AR and Spa5al Law Personal Data Sensors and Sensor Web Testbeds and Conformance/Compliance Work on Community Resources June 17, 2011 (c) 2011 Chris5ne Perey 5

6 Achieved Mee5ng s Objec5ves to establish or increase mutual awareness among Standards Development Organiza5ons (SDOs) relevant to AR to explore how SDOs and industry associa5ons will define "contact zones" of mutual interest to survey the AR architecture op5ons and begin to develop the AR reference model June 17, 2011 (c) 2011 Chris5ne Perey 6

7 Achieved Mee5ng s Objec5ves (2) to con5nue working on community resources to permit par5cipants of the mee5ng to share their views and objec5ves, as well as progress/status of their ac5vi5es, and to introduce new and important topics likely to impact the future of AR June 17, 2011 (c) 2011 Chris5ne Perey 7

8 Mobile software interfaces Graphics Representation Browser Standards POI Acceleration APIs Sensor APIs 3D Data Formats X3D X3Dom Display Technology Location/Geospatial Standards SensorWeb June 17, 2011 Mobile hardware interfaces (c) 2011 Chris5ne Perey 8

9 Standards Development Organiza5ons Five SDOs currently working on AR presented Presenta5ons are public and accessible from the Resources page of the AR Standards portal hlp:// SDOs are working at quite different levels Variety of maturi5es (none are mature) Exposed some strengths and weaknesses OGC collabora5ons highly appropriate June 17, 2011 (c) 2011 Chris5ne Perey 9

10 Standards Development Organiza5ons AR community recommenda5ons to SDOs Increase diversity of par5cipa5on (increase AR community par5cipa5on) in work- in- progress Establish MOUs/liaison agreements between SDOs AR Community must monitor progress regularly (and/or establish liaisons) Start new work but be aware of fragmenta5on ISO/JTC 1 Khronos Group June 17, 2011 (c) 2011 Chris5ne Perey 10

11 AR Architectures Three presenta5ons/proposals Requirements and survey of exis5ng systems Reference model development A Standards Process Approach Proposal based on implementa5on Discussion was held during Session 12 see notes hlp:// June 17, 2011 (c) 2011 Chris5ne Perey 11

12 Kim, Perey June 17, 2011 (c) 2011 Chris5ne Perey 12

13 Kim, Perey June 17, 2011 (c) 2011 Chris5ne Perey 13

14 June 17, 2011 (c) 2011 Chris5ne Perey 14

15 June 17, 2011 (c) 2011 Chris5ne Perey 15

16 APIs Needed for Visual AR Camera Control and image preprocessing Camera image available to GPU for composition Video/ graphics composition Physical Interfaces for HMD Image and vision processing Camera image available to CPU for image processing Composition of augmentations and camera image 2D / 3D Rendering Positional Tracking Situational Sensor fusion and synchronization Situational Sensors GPS, Compass, Accelerometer, Gyro, Pressure, Temperature Camera-to-scene transform in application StreamInput Multi-core, multithreaded programming physics and games engines e.g. UNITY Synchronized Spatial 3D Audio Augmentation Rendering Augmentation 3D models and markers Transmission of markers and 3D models

17 Khronos APIs in AR Processing Flow AL Camera Camera Control StreamInput Sensors Route video stream to CPU AL Media Player Capture and preprocess Applica$on on CPU Imaging (OpenCV etc.) Tracking Rendering Audio EGLStream Audio Rendering OpenSL ES Composite Gfx/Video OpenGL ES Speakers Screen FCAM Component? Route video stream to GPU June 17, 2011 (c) 2011 Chris5ne Perey 17

18 Simple Application Model for Instant mobilear Browser Interna5onal AR Standards Mee5ng June , Timo Engelke, Fraunhofer IGD

19 Deployment of Applications Traditional: All the content on a WEB Server Offline Alternative: Create a ZIP file of the content and put it on the server or drop it onto the applications document folder Modern Approach: Using RESTful interfaces and even couchdb for document based application download, customization or even application generation. Interna$onal AR Standards Mee$ng June , Timo Engelke, Fraunhofer IGD

20 Standards implementation approach WEB- View (HTML5 +JS) DOM-Declarative AR ML Other applica5on descrip5ons Annota&on Content Context Registra&on... SVG X3D A2ML JavaScript X3Dom Sound Vision Sensors Content webgl Na5ve Interface OS Generic Applica5on (Instant mobilear Browser) 20 Interna5onal AR Standards Mee5ng June , Timo Engelke, Fraunhofer IGD

21 Emerging Challenges/Obstacles Examina5on/expert presenta5ons Legal Very lille (no) precedent or case law to guide Obstacles and risks unknown (but probably high) Personal Data Personal data in user s control Sensors, SensorWeb June 17, 2011 (c) 2011 Chris5ne Perey 21

22 Other Emerging Challenges? AR Community seeks contact with other expert communi5es High value at the contact zones Future topics in the emerging challenges Indoor Posi5oning and Naviga5on Personal data management User context sources Hardware for Hands- free AR Others June 17, 2011 (c) 2011 Chris5ne Perey 22

23 Developing an AR Terminology Progress on Native AR terms and synonyms See notes June 17, 2011 (c) 2011 Chris5ne Perey 23

24 AR Content Prepara5on Process Authoring AR Authoring Tools Creative Augmentations Presentation Data Trigger Data Digital Representations of the Physical World Feature Extractions Physical World June 17, 2011 (c) 2011 Chris5ne Perey 24

25 AR Publishing & Delivery Process Authoring Publishing Delivery Present AR Authoring Tools Server Device Creative End User Augmentations Presentation Data Trigger Data Physical World June 17, 2011 (c) 2011 Chris5ne Perey 25

26 AR Presenta5on Authoring Publishing Delivery Present AR Authoring Tools Server Device Creative End User Augmentations Presentation Data Trigger Data Device Event Trigger Matches Sensor Present Augmentations Presentation In the Real World Sensors Stimuli June 17, 2011 (c) 2011 Chris5ne Perey 26

27 Next Steps The community efforts/ac5vi5es will con5nue Outreach Advocacy Mee5ngs Document/dissemina5on Monitor/dialog with SDOs Details of these is available in notes of Next Steps session June 17, 2011 (c) 2011 Chris5ne Perey 27

28 Next Steps: New work Ini5a5on of new work discussed Community to pursue ISO/JTC 1 / SC24 and Khronos Group OGC Domain Working Groups as appropriate June 17, 2011 (c) 2011 Chris5ne Perey 28

29 Next Mee5ng (the Fourth) hlp:// interna5onal- ar- standards- mee5ng/ October 24-25, 2011 Basel, Switzerland Objec5ves Increase community diversity, size Sharing of Open and Interoperable AR ini5a5ves Advance community resources Examine emerging issues or challenges Posi5on Papers highly recommended Deadline September 20, 2011 ISMAR2011 June 17, 2011 (c) 2011 Chris5ne Perey 29

30 For more informa5on hlp:// June 17, 2011 (c) 2011 Chris5ne Perey 30