DAQRI ARToolKit 6/Open Source. Mobile development. ios and Android. Oxford Brookes University

Size: px

Start display at page:

Download "DAQRI ARToolKit 6/Open Source. Mobile development. ios and Android. Oxford Brookes University"

Allyson Woods
6 years ago
Views:

1 DAQRI ARToolKit 6/Open Source Mobile development ios and Android Phil Thorsten Oxford Brookes University

example Getting started ARToolKit6 for ios Tracking

2 Agenda Why mobile is important for us ARToolKit6 for Android Get familiar with ARTK6 on Android Tracking example Getting started ARToolKit6 for ios Tracking example Structure of ARTK6 Getting started Questions

3 Augmented Reality feels like magic

4 augmented.info Why mobile People love looking at their phone We enable them to see beyond their screen Mobile devices are the start to get people in touch with augmented reality augmented.info

6 Architecture on Android Objective-C API Java API JNI C# API P/Invoke ARController C API ARTracker ARTrackableAppearance ARTrackable ARVideoSource libarvideo ARTracker2D ARTrackable2D ARTrackerSqua re ARTrackableSquare ARTrackableMultiSqua re ARTrackerInstant On ARTrackableInstant On libartvision libar libinstanton ARView libarg Android Video Push AVFoundatio n Video4Linux2 Camera calibration database sqlite3 curl glog boost CoreMotion OpenGL/GLES Key: C++ class External library Internal library Hybrid system Binding

7 Architecture on Android <interface> CameraEventListener <interface> ARToolKitCallback CameraEventListenerImpl uses ARToolKitCallbackImpl <abstract> ARActivity instantiates uses <abstract> ARRenderer uses <abstract> ShaderProgram <singleton> ARToolKit ARController uses NativeInterface Java API JNI C API Key: C++ class Binding Java class instantiates uses implements

8 Tracking example <interface> CameraEventListener <interface> ARToolKitCallback CameraEventListenerImpl <abstract> ARActivity ARToolKitCallbackImpl <abstract> ARRenderer <abstract> ShaderProgram SimpleShaderProgram <interface> VertexShader <interface> FragmentShader ARTrackingActivity ARTrackingRenderer <interface> ARDrawable <singleton> ARToolKit ARController uses NativeInterface Java API JNI C API Key: C++ class Binding Java class App class instantiates uses implements

9 The actual code ARTrackingActivity ARTrackingRenderer

10 Getting started ARToolKit6 SDK download Setup Android Studio and the NDK (Native Development Kit) Install the JDK For Android SDK manager Open the SimpleTracking project Documentation

11 Questions regarding Android Contact:

12 Architecture on ios Objective-C API Java API JNI C# API P/Invoke ARController C API ARTracker ARTrackableAppearance ARTrackable ARVideoSource libarvideo ARTracker2D ARTrackable2D ARTrackerSqua re ARTrackableSquare ARTrackableMultiSqua re ARTrackerInstant On ARTrackableInstant On libartvision libar libinstanton ARView libarg Android Video Push AVFoundatio n Video4Linux2 Camera calibration database sqlite3 curl glog boost CoreMotion OpenGL/GLES Key: C++ class External library Internal library Hybrid system Binding

loading and rendering Too low-level for most users but maximally customisable High-performance crossplatform game engine

13 Virtual Environment Generation Construct a VE containing the digital dimensions of the experience Align the VE with the actual environment OpenGL projection matrix to match camera optical properties Video background rendering Basic model loading and rendering Too low-level for most users but maximally customisable High-performance crossplatform game engine Camera projection and position represented in scene graph Video background rendering Large ecosystem of solutions and vendors

14 Development platforms Platform Developer tools APIs ios Xcode ios-specific classes for AR Android macos Linux Windows Desktop Windows Mobile Android Studio Xcode standard tools Visual Studio 2013 Visual Studio 2013 Choice of Java / Java+native, full native with C++ framework Examples in C++ Examples in C and C++ Examples in C and C++ Native C# component and examples, lowlevel C/C++ framework

15 Prerequisites A Mac iphone or ipad running ios 7.0 or later (can t use simulator for ARToolKit) An Apple ID to associate with your developer account (no cost to deploy to your own device) Xcode

16 ` Open Examples/Source/iOS/ARToolKit6 Tracking Example.xcodeproj Choose target: ARToolKit6 Tracking Example/Device Build

17 Running on a device Connect device, and check it is enabled in Organizer Choose an app target and build Select team. Also choose your own unique app bundle ID If security warning: enable developer account in device settings

ARTVision Tracker 2D

DAQRI ARToolKit 6/Open Source ARTVision Tracker 2D Natural Feature Tracking in ARToolKit6 Dan 2017-01 ARTVision 2D Background Core texture tracking algorithm for ARToolKit 6. Developed and contributed