Extending Your Apps with SiriKit

Transcription

1 App Frameworks #WWDC16 Extending Your Apps with SiriKit Session 225 Vineet Khosla SiriKit Engineering Diana Huang SiriKit Engineering Scott Andrus SiriKit Engineering 2016 Apple Inc. All rights reserved. Redistribution or public display not permitted without written permission from Apple.

2 Adding SiriKit Intents Extension Intents UI Extension App

3 Adding SiriKit Intents Extension Intents UI Extension App Resolve Confirm Handle

4 Agenda Preparing to adopt SiriKit

5 Agenda Preparing to adopt SiriKit Adding your first Intents extension

6 Agenda Preparing to adopt SiriKit Adding your first Intents extension Providing a user interface in Siri

7 UnicornChat

8 Preparing to Adopt SiriKit

9 Preparing to Adopt SiriKit

10 Preparing to Adopt SiriKit Embedded frameworks

11 Preparing to Adopt SiriKit Embedded frameworks Unit tests

12 Preparing to Adopt SiriKit Embedded frameworks Unit tests Architecting your extensions

13 Preparing to Adopt SiriKit Embedded frameworks

14 Preparing to Adopt SiriKit Embedded frameworks Networking

15 Preparing to Adopt SiriKit Embedded frameworks Networking Data model

16 Preparing to Adopt SiriKit Embedded frameworks Networking Data model Decision-making logic

17 Preparing to Adopt SiriKit Embedded frameworks Networking Data model Decision-making logic User interfaces

18 Preparing to Adopt SiriKit Embedded frameworks Data Decision-making model logic Networking User interfaces

19 Preparing to Adopt SiriKit Embedded frameworks Data Decision-making model logic Networking User interfaces App Extension Best Practices WWDC 2015

20 Preparing to Adopt SiriKit Unit tests

21 Preparing to Adopt SiriKit Unit tests Mock intents

22 Preparing to Adopt SiriKit Unit tests Mock intents Make sure your app responds appropriately

23 Preparing to Adopt SiriKit Architecting your extensions SendMessageIntent StartAudioCallIntent StartVideoCallIntent

24 Preparing to Adopt SiriKit Architecting your extensions SendMessageIntent StartAudioCallIntent StartVideoCallIntent

25 Preparing to Adopt SiriKit Architecting your extensions SendMessageIntent StartAudioCallIntent StartVideoCallIntent

26 Preparing to Adopt SiriKit Architecting your extensions SendMessageIntent StartAudioCallIntent StartVideoCallIntent

27 Adding Your First Intents Extension Diana Huang SiriKit Engineering

28 Getting Started

29 Getting Started Add extension target

30 Getting Started Add extension target Configure Info.plist

31 Getting Started Add extension target Configure Info.plist Modify principal class

32 Intents Extension Adding an extension target

33 Intents Extension Adding an extension target

34 Intents Extension Adding an extension target

35 Intents Extension Info.plist

36 Intents Extension Info.plist Info.plist NSExtension NSExtensionAttributes IntentsSupported IntentsRestrictedWhileLocked

37 Intents Extension Info.plist Info.plist NSExtension NSExtensionAttributes IntentsSupported IntentsRestrictedWhileLocked

38 Intents Extension Info.plist Info.plist NSExtension NSExtensionAttributes IntentsSupported IntentsRestrictedWhileLocked

39 Intents Extension Principal class

40 Intents Extension Principal class Subclass of INExtension

41 Intents Extension Principal class Subclass of INExtension INIntentHandlerProviding

42 Intents Extension Principal class Subclass of INExtension INIntentHandlerProviding handlerforintent

43 Intents Extension Principal class Subclass of INExtension INIntentHandlerProviding handlerforintent handler class must conform to specific intent handling protocol

44 Demo Creating my first Intents extension

45 Resolve, Confirm, Handle Resolve

46 Resolve, Confirm, Handle Resolve Validate and clarify parameters

47 Resolve, Confirm, Handle Resolve Validate and clarify parameters Implement it if you might need Siri to help ask users

48 Resolve, Confirm, Handle Resolve

49 Resolve, Confirm, Handle Resolve recipients

50 Resolve, Confirm, Handle Resolve Contact search recipients

51 Resolve, Confirm, Handle Resolve Contact search recipients Exactly one match

52 Resolve, Confirm, Handle Resolve Contact search recipients Exactly one match Two or more matches

53 Resolve, Confirm, Handle Resolve Contact search recipients Exactly one match Two or more matches No match

54 Resolve, Confirm, Handle Resolve Contact search Exactly one match Resolve recipients Two or more matches No match

55 Resolve, Confirm, Handle Resolve Resolve recipients

56 Resolve, Confirm, Handle Resolve Contact search Resolve recipients

57 Resolve, Confirm, Handle Resolve Contact search Resolve recipients content

58 Resolve, Confirm, Handle Resolve Contact search Resolve recipients content Need a value to proceed

59 Resolve, Confirm, Handle Confirm Resolve recipients content

60 Resolve, Confirm, Handle Confirm Resolve recipients content Confirm

61 Resolve, Confirm, Handle Confirm Dry run Resolve recipients content Tell Siri how it went Confirm

62 Resolve, Confirm, Handle Confirm Dry run Resolve recipients content Tell Siri how it went Confirm authenticated?

63 Resolve, Confirm, Handle Handle Just handle it! Resolve recipients content Again, tell Siri how it went Confirm authenticated? Handle

64 Demo Filling in my app logic

65 NSUserActivity Resume state in your app

66 NSUserActivity Resume state in your app Siri creates one by default

67 NSUserActivity Resume state in your app Siri creates one by default ActivityType is intent class name

68 NSUserActivity Resume state in your app Siri creates one by default ActivityType is intent class name You can provide one to pass custom data

69 NSUserActivity Resume state in your app Siri creates one by default ActivityType is intent class name You can provide one to pass custom data INInteraction

70 Demo Providing my own NSUserActivity

71 User-Specific Vocabulary

72 User-Specific Vocabulary Phrases unique to your app and user

73 User-Specific Vocabulary Phrases unique to your app and user e.g. contact names

74 User-Specific Vocabulary Phrases unique to your app and user e.g. contact names Help Siri understand what users mean

75 User-Specific Vocabulary Phrases unique to your app and user e.g. contact names Help Siri understand what users mean INVocabulary API call from main app

76 User-Specific Vocabulary Phrases unique to your app and user e.g. contact names Help Siri understand what users mean INVocabulary API call from main app NOT your extension

77 // User-Specific Vocabulary - UnicornChat class UCAddressBookManager { // This method is called whenever there is a contact change func updatesiriknowledgeofcontacts() { // provide the updated list of favorites' unicorn names to Siri var unicornnames = OrderedSet(array: self.sortedfavoriteunicornnames) INVocabulary.shared().setVocabularyStrings(unicornNames, of: INVocabularyStringType.contactName) } }

78 // User-Specific Vocabulary - UnicornChat class UCAddressBookManager { // This method is called whenever there is a contact change func updatesiriknowledgeofcontacts() { // provide the updated list of favorites' unicorn names to Siri var unicornnames = OrderedSet(array: self.sortedfavoriteunicornnames) INVocabulary.shared().setVocabularyStrings(unicornNames, of: INVocabularyStringType.contactName) } }

79 // User-Specific Vocabulary - UnicornChat class UCAddressBookManager { // This method is called whenever there is a contact change func updatesiriknowledgeofcontacts() { // provide the updated list of favorites' unicorn names to Siri var unicornnames = OrderedSet(array: self.sortedfavoriteunicornnames) INVocabulary.shared().setVocabularyStrings(unicornNames, of: INVocabularyStringType.contactName) } }

80 // User-Specific Vocabulary - UnicornChat class UCAddressBookManager { // This method is called whenever there is a contact change func updatesiriknowledgeofcontacts() { // provide the updated list of favorites' unicorn names to Siri DispatchQueue(label: "UCSiriVocabulary").asynchronously(execute: { () -> Void in var unicornnames = OrderedSet(array: self.sortedfavoriteunicornnames) INVocabulary.shared().setVocabularyStrings(unicornNames, of: INVocabularyStringType.contactName) }) } }

81 // User-Specific Vocabulary - UnicornChat class UCAddressBookManager { // This method is called whenever there is a contact change func updatesiriknowledgeofcontacts() { // provide the updated list of favorites' unicorn names to Siri DispatchQueue(label: "UCSiriVocabulary").asynchronously(execute: { () -> Void in var unicornnames = OrderedSet(array: self.sortedfavoriteunicornnames) INVocabulary.shared().setVocabularyStrings(unicornNames, of: INVocabularyStringType.contactName) }) } }

82 // User-Specific Vocabulary - UnicornChat class UCAddressBookManager { // This method is called whenever there is a contact change func updatesiriknowledgeofcontacts() { // provide the updated list of favorites' unicorn names to Siri DispatchQueue(label: "UCSiriVocabulary").asynchronously(execute: { () -> Void in var unicornnames = OrderedSet(array: self.sortedfavoriteunicornnames) INVocabulary.shared().setVocabularyStrings(unicornNames, of: INVocabularyStringType.contactName) }) } }

83

84 Providing a User Interface with SiriKit Scott Andrus SiriKit Engineering

85 UI Extensions Increase Your App s Impact

86 UI Extensions Increase Your App s Impact Your view alongside Siri

87 UI Extensions Increase Your App s Impact Your view alongside Siri Experiences unique to your application

88 UI Extensions Increase Your App s Impact Your view alongside Siri Experiences unique to your application User-specific customization

89 UI Extensions Increase Your App s Impact Your view alongside Siri Experiences unique to your application User-specific customization Information Siri might not otherwise show

90 UI Extensions Increase Your App s Impact Your view alongside Siri Experiences unique to your application User-specific customization Information Siri might not otherwise show

91 Add UI Extension Target to Xcode How to get started

92 Add UI Extension Target to Xcode How to get started Add Intents UI Extension target

93 Add UI Extension Target to Xcode How to get started Add Intents UI Extension target Embed in application

94 Intents UI Extension Info.plist Info.plist NSExtension NSExtensionAttributes IntentsSupported

95 Intents UI Extension Info.plist Info.plist NSExtension NSExtensionAttributes IntentsSupported

96 Siri

97 Siri configure(with interaction:...)

98 UI extension Siri configure(with interaction:...)

99 UI extension Siri UIViewController : INUIHostedViewControlling configure(with interaction:...)

100 UI extension Siri INInteraction UIViewController : INUIHostedViewControlling configure(with interaction:...)

101 INInteraction Breaking it down INIntent INIntentResponse INInteraction INIntentHandlingStatus

102 INInteraction Breaking it down The handled (or to-be-handled) INIntent INIntent INIntentResponse INInteraction INIntentHandlingStatus

103 INInteraction Breaking it down The handled (or to-be-handled) INIntent INIntent The provided INIntentResponse INInteraction INIntentResponse INIntentHandlingStatus

104 INInteraction Breaking it down The handled (or to-be-handled) INIntent INIntent The provided INIntentResponse INIntentHandlingStatus INInteraction INIntentResponse INIntentHandlingStatus

105 Implementing Your View Controller

106 Implementing Your View Controller Principal class

107 Implementing Your View Controller Principal class Subclass of UIViewController

108 Implementing Your View Controller Principal class Subclass of UIViewController Configure with interaction

109 Implementing Your View Controller Principal class Subclass of UIViewController Configure with interaction Provided view context

110 Implementing Your View Controller Principal class Subclass of UIViewController Configure with interaction Provided view context

111 Implementing Your View Controller Principal class Subclass of UIViewController Configure with interaction Provided view context

112 Implementing Your View Controller Principal class Subclass of UIViewController Configure with interaction Provided view context Desired size in the completion

113 Demo Building a SiriKit UI extension

114

115 Siri Gives You Override Control

116 Siri Gives You Override Control Implement INUIHostedViewSiriProviding

117 Siri Gives You Override Control Implement INUIHostedViewSiriProviding Properties for displaying messages and maps

118 Siri Gives You Override Control Implement INUIHostedViewSiriProviding Properties for displaying messages and maps Opt-in to displaying a particular interface

119 Siri Gives You Override Control Implement INUIHostedViewSiriProviding Properties for displaying messages and maps Opt-in to displaying a particular interface Siri will accommodate your view s content

120 class IntentViewController: UIViewController, INUIHostedViewControlling, func configure(with interaction: INInteraction!, context: INUIHostedViewContext, completion: ((CGSize) -> Void)!) { // Configure your view completion(self.extensioncontext!.hostedviewmaximumallowedsize) } }

121 class IntentViewController: UIViewController, INUIHostedViewControlling, INUIHostedViewSiriProviding { func configure(with interaction: INInteraction!, context: INUIHostedViewContext, completion: ((CGSize) -> Void)!) { // Configure your view completion(self.extensioncontext!.hostedviewmaximumallowedsize) } var displaysmessage: Bool { return true } }

122 class IntentViewController: UIViewController, INUIHostedViewControlling, INUIHostedViewSiriProviding { func configure(with interaction: INInteraction!, context: INUIHostedViewContext, completion: ((CGSize) -> Void)!) { // Configure your view completion(self.extensioncontext!.hostedviewmaximumallowedsize) } var displaysmessage: Bool { return true } }

123 class IntentViewController: UIViewController, INUIHostedViewControlling, INUIHostedViewSiriProviding { func configure(with interaction: INInteraction!, context: INUIHostedViewContext, completion: ((CGSize) -> Void)!) { // Configure your view completion(self.extensioncontext!.hostedviewmaximumallowedsize) } var displaysmessage: Bool { return true } }

124 Demo Telling Siri about our interface

125

126

127 Considerations

128 Considerations Be memory conscious

129 Considerations Be memory conscious Minimum and maximum view sizes

130 Considerations Be memory conscious Minimum and maximum view sizes Flexible and adaptive layout patterns

131 Summary

132 Summary Prepare to adopt SiriKit

133 Summary Prepare to adopt SiriKit Add your first Intents extension

134 Summary Prepare to adopt SiriKit Add your first Intents extension Provide a user interface in Siri

135 More Information

136 Related Sessions Introducing SiriKit Presidio Wednesday 5:00PM App Extension Best Practices WWDC 2015

137 Labs SiriKit Lab Frameworks Lab C Thursday 3:00PM SiriKit Lab Frameworks Lab B Friday 9:00AM

138