11/10/2017. Jérôme Royan

Size: px

Start display at page:

Download "11/10/2017. Jérôme Royan"

Jasmin Warren
5 years ago
Views:

1 11/10/2017 Jérôme Royan

2 What is SolAR? SolAR is a framework dedicated to Augmented Reality (AR) SolAR will be released in early November under Apache license 2.0 SolAR offers a modular pipeline architecture to build customized camera pose estimation solutions The SolAR framework aims at stimulating the interaction between all actors of AR development.

3 Why SolAR? Wide variety of industry use cases and requirements Accuracy, scale, lighting, occlusions, etc. No «one solution fits all problems» for AR Low-level customization for better performances

4 Why SolAR? Industry faces a dilemma Proprietary solutions (ARKit, ARCore, Hololens SDK, etc.) operformance, robustness, all integrated, fast evolution odo no fit all needs, black box, content protection? Academic solutions Innovative, generally open-source, adapted to various needs otechnology Readiness Level, license, maintenance Own solution ofully adapted to needs, sustainability, competitive advantage ocost and time of development, maintenance

5 How? SolAR provides developers with a pipeline architecture to implement customized camera pose estimation solutions by connecting basic processing elements called components.

AR service Wrap 3rd parties to SolAR API SolAR Components SolAR

Connect Load packages components Package 2 Package 3 AR Service

1 proprietary open Group components in packages SolAR component

6 AR service Wrap 3rd parties to SolAR API SolAR Components SolAR component developer SolAR pose estimator designer Instantiate Connect Load packages components Package 2 Package 3 AR Service Designer Rollout Develop ChooseAR pose AR service estimator Package 1 proprietary open Group components in packages SolAR component developer SolAR pose estimator designer Build camera pose pipeline Rendering Engine

7 Framework Architecture SolAR Core Pipeline Manager SolAR Data Structures SolARImage SolAR SolARPose ISolARMatcher SolAR Components Interface ISolARDescriptor MatcherA MatcherB DescriptorA DescriptorB MatcherC SolAR Components

8 SolAR Data Structures Standardized data that will be exchanged between components SolARImage (size, layout, pixel order, data type) SolARMatrix (based on eigen) SolARPose SolARMarker SolARkeypoint SolARDescriptor SolARMatches Etc

9 Components interfaces Standardized interfaces for the different categories of basic processing elements required to implement camera pose estimation ISolARCamera ISolARConverter ISolARFilter ISolARFeaturesExtractor ISolARMatcher ISolARPoseEstimator Etc.

10 Pipeline Manager Handles the pipeline instantiation by Loading package of components Loading and dynamically instantiating components Introspecting package and components Providing a uniform component parametrization Chaining components and running the pipeline

11 SolAR Roadmap

12 Who can contribute to SolAR? Researchers, research engineers, PHD Students expert in computer vision to: develop new components, whether royalty-free or proprietary Implement new pose estimation pipelines AR service developers to: Configure and use available pipelines and create new AR applications fitting end-users needs. Any developers who wants to contribute to SolAR core by: Defining new components interfaces, new data structures Adding new features to the Pipeline Manager Developing new plugins for rendering engines Contributing to the development of a graphic editor

13 How to contribute to SolAR Have a look to the SolAR website Source code will be released soon Continuous integration Contribution workflow Communication tools

14 Thanks / jerome.royan@b-com.com /

Presentation of Industry Specification group on Augmented Reality Framework (ISG ARF)

Presentation of Industry Specification group on Augmented Reality Framework (ISG ARF) Presented by: ARF Chairman For: ETSI 2018 The context AR is a promising market with high revenue forecast e.g. 80$B