What s New in SiriKit

Transcription

1 Session App Frameworks #WWDC17 What s New in SiriKit 214 Sirisha Yerroju, SiriKit Engineer Tin Tran, SiriKit Engineer 2017 Apple Inc. All rights reserved. Redistribution or public display not permitted without written permission from Apple.

2

3 Messaging Workouts Climate and Radio Ride Booking Photo Search Car Commands Payments VOIP Calling

4 Get me a ride to SFO via MyRidesApp Send a text to Carey using Unicorn Stop my workout in MyWorkoutApp Call Mike on my MyVoIPApp Messaging Send $10 to John Doe for dinner using MyPayApp Book me a Ride Look for beach photos in MyPhotosApp Climate and Radio Show missed calls from Jon Appleseed in Unicorn Ride Booking Start my daily workout Start slideshow in my UnicornPhotoApp Find messages from Jon on Unicorn Photo Search Show all my accounts Resume my daily run Workouts Pay the current balance on garbage bill Pay my sparkle sparks cleaners bills Set heater to 72 degrees Payments Change my audio source to USB Send $9 to John Doe using Unicorn Pay my rent to unicorn rental properties Ask John to pay me $100 in UnicornPay Car Commands Call John on MyVoIPApp Search for cute dog pics in my UnicornApp How far can I drive my car on the current charge VOIP Calling Pause my sparklysparkle run in UnicornApp Are the car doors unlocked Turn on the AC Switch to FM radio Turn off the front defroster Pay all my bills

5

6

7 Domains and intents Customizable UI Additional enhancements

8 Domains and intents Customizable UI Additional enhancements

9 Domains and intents Customizable UI Additional enhancements

10 Domains and intents Customizable UI Additional enhancements

11 Domains and Intents

12 Domains and Intents Payments

13 Domains and Intents Payments Lists and notes

14 Domains and Intents Payments Lists and notes Visual codes

15 Domains and Intents Payments

16 Domains and Intents Payments Send/Request

17 Domains and Intents Payments Send/Request Bills

18 Domains and Intents Payments Send/Request Bills Accounts

19 Domains and Intents Payments Send/Request Bills Accounts Transfer

20 Domains and Intents Payments Send/Request Bills Accounts Transfer Search

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35 Domains and Intents Payments NEW

36 Domains and Intents Payments NEW INTransferMoneyIntent

37 Domains and Intents Payments NEW INTransferMoneyIntent INSearchForAccountsIntent

38 Domains and Intents Lists and Notes

39

40

41

42

43 Domains and Intents Lists and Notes NEW INCreateNoteIntent

44 Domains and Intents Lists and Notes NEW INCreateTaskListIntent INCreateNoteIntent

45 Domains and Intents Lists and Notes NEW INCreateTaskListIntent INAddTasksIntent INCreateNoteIntent

46 Domains and Intents Lists and Notes NEW INCreateTaskListIntent INAddTasksIntent INSetTaskAttributeIntent INCreateNoteIntent

47 Domains and Intents Lists and Notes Create a note called WWDC in UnicornNotes

48 Domains and Intents Lists and Notes Create a note called WWDC in UnicornNotes title

49 Domains and Intents Lists and Notes Create a note called WWDC in my presentation folder saying SiriKit in UnicornNotes title groupname content

50 Domains and Intents Lists and Notes Create a note called WWDC in my presentation folder saying SiriKit in UnicornNotes title groupname content Add to my WWDC note in UnicornNotes saying It s on June 7th

51 Domains and Intents Lists and Notes Create a note called WWDC in my presentation folder saying SiriKit in UnicornNotes title groupname content Add to my WWDC note in UnicornNotes saying It s on June 7th targetnote content

52 Domains and Intents Lists and Notes NEW INCreateNoteIntent

53 Domains and Intents Lists and Notes NEW INCreateNoteIntent INCreateNoteIntent

54 Domains and Intents Lists and Notes NEW INCreateNoteIntent INAppendToNoteIntent INCreateNoteIntent

55

56 Domains and Intents Lists and Notes NEW INCreateNoteIntent

57 Domains and Intents Lists and Notes NEW INSearchForNotebookItemsIntent title content itemtype INCreateNoteIntent status location datetime

58 Domains and Intents Lists and Notes NEW INSearchForNotebookItemsIntent title content itemtype INCreateNoteIntent status location datetime

59 Domains and Intents Visual codes

60

61 Domains and Intents Visual codes NEW

62 Domains and Intents Visual codes NEW INGetVisualCodeIntent

63 Domains and Intents Visual codes NEW INGetVisualCodeIntent visualcodetype

64 Domains and Intents Visual codes NEW INGetVisualCodeIntent visualcodetype - contact

65 Domains and Intents Visual codes NEW INGetVisualCodeIntent visualcodetype - contact - requestpayment

66 Domains and Intents Visual codes NEW INGetVisualCodeIntent visualcodetype - contact - requestpayment - sendpayment

67 Adding Visual Codes to UnicornChat Tin Tran, SiriKit Engineer

68

69 Info.plist

70 Info.plist

71 Info.plist

72

73

74 Demo

75 Supporting Intents

76 Supporting Intents Info.plist

77 Supporting Intents Info.plist Principal class

78 Supporting Intents Info.plist Principal class Resolve, confirm, and handle

79 Customizable UI

80 SiriKit Extensions Intents Extension (ios, watchos) Intents UI Extension (ios) Resolve Configure view Confirm Handle

81

82 From: 1000 Stockton St $3.25 To: San Jose, CA

83 From: 1000 Stockton St $3.25 To: San Jose, CA

84 From: 1000 Stockton St $3.25 To: San Jose, CA

85 From: 1000 Stockton St $3.25 To: San Jose, CA

86 pickuplocation rideoptionname pickuplocation dropofflocation pricerange specialpricing

87 ridedriver ridevehicle pickuplocation dropofflocation scheduledpickuptime

88 ridedriver ridevehicle pickuplocation dropofflocation scheduledpickuptime

89 // INParameter NEW let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, keypath: #keypath(inrequestrideintent.pickuplocation) pickuplocation

90 // INParameter NEW let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, keypath: #keypath(inrequestrideintent.pickuplocation) pickuplocation

91 // INParameter NEW let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, keypath: #keypath(inrequestrideintent.pickuplocation) pickuplocation

92 // INParameter NEW let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, keypath: #keypath(inrequestrideintent.pickuplocation) pickuplocation

93 // INParameter NEW let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, keypath: #keypath(inrequestrideintent.pickuplocation) pickuplocation

94 // INParameter NEW let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, keypath: #keypath(inrequestrideintent.pickuplocation) // INInteraction let pickuplocationvalue = interaction.parametervalue(for: pickuplocation) pickuplocation

95 // INParameter NEW let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, keypath: #keypath(inrequestrideintent.pickuplocation) // INInteraction let pickuplocationvalue = interaction.parametervalue(for: pickuplocation) pickuplocation

96 // INParameter NEW let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, keypath: #keypath(inrequestrideintent.pickuplocation) // INInteraction let pickuplocationvalue = interaction.parametervalue(for: pickuplocation) pickuplocation

97 From: 1000 Stockton St $3.25 To: San Jose, CA pickuplocation rideoptionname pickuplocation dropofflocation pricerange specialpricing

98 From: 1000 Stockton St $3.25 To: San Jose, CA pickuplocation rideoptionname pickuplocation dropofflocation pricerange specialpricing

99 From: 1000 Stockton St $3.25 To: San Jose, CA pickuplocation rideoptionname pickuplocation dropofflocation pricerange specialpricing

100 // Intents UI Extension NEW class MyViewController: UIViewController, INUIHostedViewControlling { func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) {} }

101 // Intents UI Extension NEW class MyViewController: UIViewController, INUIHostedViewControlling { func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) {} }

102 // Intents UI Extension NEW class MyViewController: UIViewController, INUIHostedViewControlling { func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) {} }

103 // Intents UI Extension NEW class MyViewController: UIViewController, INUIHostedViewControlling { func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) {} }

104 // Intents UI Extension NEW class MyViewController: UIViewController, INUIHostedViewControlling { func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) {} }

105 // Intents UI Extension NEW class MyViewController: UIViewController, INUIHostedViewControlling { func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) {} }

106 // Intents UI Extension NEW class MyViewController: UIViewController, INUIHostedViewControlling { func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) {} }

107 // Intents UI Extension NEW class MyViewController: UIViewController, INUIHostedViewControlling { func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) {} }

108 pickuplocation rideoptionname pickuplocation dropofflocation pricerange specialpricing

109 pickuplocation rideoptionname pickuplocation dropofflocation pricerange specialpricing San Jose, CA Majestic Unicorn $3.25

110 Siri pickuplocation rideoptionname pickuplocation dropofflocation pricerange specialpricing INUIHostedViewControlling

111 Siri pickuplocation configureview rideoptionname [] pickuplocation dropofflocation pricerange specialpricing INUIHostedViewControlling

112 Siri pickuplocation rideoptionname pickuplocation dropofflocation pricerange specialpricing UI Extension

113 Siri pickuplocation rideoptionname false, [], CGSize.zero pickuplocation dropofflocation pricerange specialpricing UI Extension

114 // Configure Empty Parameters func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { if parameters.isempty { completion(false, [], CGSize.zero) } }

115 // Configure Empty Parameters func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { if parameters.isempty { completion(false, [], CGSize.zero) } }

116 // Configure Empty Parameters func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { if parameters.isempty { completion(false, [], CGSize.zero) } }

117 Siri pickuplocation rideoptionname pickuplocation dropofflocation pricerange specialpricing UI Extension

118 Siri pickuplocation configureview rideoptionname [pickuplocation] pickuplocation dropofflocation pricerange specialpricing UI Extension

119 Siri pickuplocation rideoptionname pickuplocation dropofflocation pricerange specialpricing INUIHostedViewControlling

120 Siri pickuplocation true, [pickuplocation], rideoptionname sizeforpickupview pickuplocation dropofflocation pricerange specialpricing INUIHostedViewControlling

121 Siri pickuplocation true, [pickuplocation], rideoptionname sizeforpickupview pickuplocation dropofflocation pricerange specialpricing INUIHostedViewControlling

122 Siri pickuplocation true, [pickuplocation], rideoptionname sizeforpickupview dropofflocation pricerange specialpricing INUIHostedViewControlling

123 Siri pickuplocation true, [pickuplocation], sizeforpickupview rideoptionname dropofflocation pricerange specialpricing INUIHostedViewControlling

124 // Configure Pickup Location func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, parameterkeypath: #keypath(inrequestrideintent.pickuplocation)) } if parameters == [pickuplocation] { // Configure view for pickup location. completion(true, [pickuplocation], self.sizeforpickupview) } else { completion(false, [], CGSize.zero) }

125 // Configure Pickup Location func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, parameterkeypath: #keypath(inrequestrideintent.pickuplocation)) } if parameters == [pickuplocation] { // Configure view for pickup location. completion(true, [pickuplocation], self.sizeforpickupview) } else { completion(false, [], CGSize.zero) }

126 // Configure Pickup Location func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, parameterkeypath: #keypath(inrequestrideintent.pickuplocation)) } if parameters == [pickuplocation] { // Configure view for pickup location. completion(true, [pickuplocation], self.sizeforpickupview) } else { completion(false, [], CGSize.zero) }

127 // Configure Pickup Location func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, parameterkeypath: #keypath(inrequestrideintent.pickuplocation)) } if parameters == [pickuplocation] { // Configure view for pickup location. completion(true, [pickuplocation], self.sizeforpickupview) } else { completion(false, [], CGSize.zero) }

128 // Configure Pickup Location func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { let pickuplocation = INParameter(parameterClass: INRequestRideIntent.self, parameterkeypath: #keypath(inrequestrideintent.pickuplocation)) } if parameters == [pickuplocation] { // Configure view for pickup location. completion(true, [pickuplocation], self.sizeforpickupview) } else { completion(false, [], CGSize.zero) }

129 Siri pickuplocation name rideoptionname dropofflocation pricerange specialpricing INUIHostedViewControlling

130 Siri pickuplocation configureview name [rideoptionname] rideoptionname dropofflocation pricerange specialpricing INUIHostedViewControlling

131 Siri pickuplocation rideoptionname rideoptionname dropofflocation pricerange specialpricing INUIHostedViewControlling

132 Siri pickuplocation true, [rideoptionname, rideoptionname dropofflocation, pricerange, specialpricing], sizefordetailview rideoptionname dropofflocation pricerange specialpricing INUIHostedViewControlling

133 Siri pickuplocation true, [rideoptionname, rideoptionname dropofflocation, pricerange, specialpricing], sizefordetailview rideoptionname dropofflocation pricerange specialpricing INUIHostedViewControlling

134 Siri true, [rideoptionname, dropofflocation, pricerange, specialpricing], sizefordetailview San Jose, CA Majestic Unicorn $3.25 INUIHostedViewControlling

135 // Configure Details func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { // Configure parameters. if parameters == [pickuplocation] { // Configure view for pickup location. completion(true, [pickuplocation], self.sizeforpickupview) } else if parameters == [rideoptionname] { // Configure view for details. completion(true, [rideoptionname, dropofflocation, pricerange, specialpricing], self.sizefordetailview) } else { completion(false, [], CGSize.zero) } }

136 // Configure Details func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { // Configure parameters. if parameters == [pickuplocation] { // Configure view for pickup location. completion(true, [pickuplocation], self.sizeforpickupview) } else if parameters == [rideoptionname] { // Configure view for details. completion(true, [rideoptionname, dropofflocation, pricerange, specialpricing], self.sizefordetailview) } else { completion(false, [], CGSize.zero) } }

137 // Configure Details func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { // Configure parameters. if parameters == [pickuplocation] { // Configure view for pickup location. completion(true, [pickuplocation], self.sizeforpickupview) } else if parameters == [rideoptionname] { // Configure view for details. completion(true, [rideoptionname, dropofflocation, pricerange, specialpricing], self.sizefordetailview) } else { completion(false, [], CGSize.zero) } }

138 // Configure Details func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { // Configure parameters. if parameters == [pickuplocation] { // Configure view for pickup location. completion(true, [pickuplocation], self.sizeforpickupview) } else if parameters == [rideoptionname] { // Configure view for details. completion(true, [rideoptionname, dropofflocation, pricerange, specialpricing], self.sizefordetailview) } else { completion(false, [], CGSize.zero) } }

139 // Configure Details func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { // Configure parameters. if parameters == [pickuplocation] { // Configure view for pickup location. completion(true, [pickuplocation], self.sizeforpickupview) } else if parameters == [rideoptionname] { // Configure view for details. completion(true, [rideoptionname, dropofflocation, pricerange, specialpricing], self.sizefordetailview) } else { completion(false, [], CGSize.zero) } }

140 // Configure Details func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) { // Configure parameters. if parameters == [pickuplocation] { // Configure view for pickup location. completion(true, [pickuplocation], self.sizeforpickupview) } else if parameters == [rideoptionname] { // Configure view for details. completion(true, [rideoptionname, dropofflocation, pricerange, specialpricing], self.sizefordetailview) } else { completion(false, [], CGSize.zero) } }

141 From: 1000 Stockton St $3.25 To: San Jose, CA

142 From: 1000 Stockton St $3.25 To: San Jose, CA San Jose, CA Majestic Unicorn $3.25

143 From: 1000 Stockton St $3.25 To: San Jose, CA United Unicorn Co. San Jose, CA Majestic Unicorn $3.25 San Jose, CA Majestic Unicorn San Jose, CA Majestic Unicorn $3.25

144 Customizing UnicornRide

145 fare, specialpricing From: 1000 Stockton St To: San Jose McEnery Convention Center Type: Majestic Unicorn pickuplocation dropofflocation rideoptionname

146

147

148 Demo

149 Configuring Parameterized View

150 Configuring Parameterized View Called multiple times

151 Configuring Parameterized View Called multiple times Called first with empty set parameters

152 Configuring Parameterized View Called multiple times Called first with empty set parameters Called in order for the interaction

153 Configuring Parameterized View Called multiple times Called first with empty set parameters Called in order for the interaction Handle parameters, size

154 // Upcoming Seed NEW func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, interactivebehavior: INUIInteractiveBehavior, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) {} // INUIInteractiveBehavior: //.None //.Launch //.NextView //.GenericAction

155 // Upcoming Seed NEW func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, interactivebehavior: INUIInteractiveBehavior, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) {} // INUIInteractiveBehavior: //.None //.Launch //.NextView //.GenericAction

156 // Upcoming Seed NEW func configureview(for parameters: Set<INParameter>, of interaction: INInteraction, interactivebehavior: INUIInteractiveBehavior, context: INUIHostedViewContext, (Bool, Set<INParameter>, CGSize) -> Void) {} // INUIInteractiveBehavior: //.None //.Launch //.NextView //.GenericAction // Intents UI Extension Context func descriptionofinterfaceparameters() -> String

157 Additional Enhancements

158 Additional Enhancements

159 Additional Enhancements Background workout app intent handling

160 Additional Enhancements Background workout app intent handling Alternative app names

161 Additional Enhancements Background workout app intent handling

162 Additional Enhancements Background workout app intent handling Extension INStartWorkoutIntentResponse(code:.continueInApp, useractivity: activity) App func application(_ application: UIApplication, continue useractivity: NSUserActivity ) { }

163 Additional Enhancements Background workout app intent handling NEW Extension INStartWorkoutIntentResponse(code:.handleInApp, useractivity: activity) App func application(_ application: UIApplication, handleintent intent: INIntent, (INIntentResponse) -> Void) {

164 Additional Enhancements Background workout app intent handling NEW Extension INStartWorkoutIntentResponse(code:.handleInApp, useractivity: activity) App func application(_ application: UIApplication, handleintent intent: INIntent, (INIntentResponse) -> Void) {

165 Additional Enhancements Background workout app intent handling NEW Extension INStartWorkoutIntentResponse(code:.handleInApp, useractivity: activity) App func application(_ application: UIApplication, handleintent intent: INIntent, (INIntentResponse) -> Void) {

166 Additional Enhancements Background workout app intent handling

167 Additional Enhancements Background workout app intent handling Extension

168 Additional Enhancements Background workout app intent handling handle( ) Extension

169 Additional Enhancements Background workout app intent handling handle( ) Extension INStartWorkoutIntentResponseCode.handleInApp

170 Additional Enhancements Background workout app intent handling handle( ) Extension INStartWorkoutIntentResponseCode.handleInApp Application

171 Additional Enhancements Background workout app intent handling handle( ) Extension INStartWorkoutIntentResponseCode.handleInApp application(_ application: UIApplication, handle intent: INIntent ) Application

172 Additional Enhancements Background workout app intent handling handle( ) Extension INStartWorkoutIntentResponseCode.handleInApp application(_ application: UIApplication, handle intent: INIntent ) Application INStartWorkoutIntentResponseCode.handleInApp.success

173 Additional Enhancements Background workout app intent handling handle( ) Extension INStartWorkoutIntentResponseCode.handleInApp application(_ application: UIApplication, handle intent: INIntent ) Application INStartWorkoutIntentResponseCode.handleInApp.success

174 Additional Enhancements Alternative app names INCreateNoteIntent

175 Additional Enhancements Alternative app names Show my accounts in UnicornPay Show my accounts in Unicorn Show my accounts in CornPay INCreateNoteIntent UnicornPay

176 Additional Enhancements Alternative app names NEW 0:00:02

177 Additional Enhancements Alternative app names NEW 0:00:02

178 Summary

179 Summary All new domains and intents

180 Summary All new domains and intents UI customizations

181 Summary All new domains and intents UI customizations Improved user experience

182 More Information

183 Related Sessions Making Great SiriKit Experiences Hall 2 Thursday 11:00AM Introducing SiriKit WWDC 2016 Extending Your Apps with SiriKit WWDC 2016

184 Labs SiriKit Lab Technology Lab B Wed 3:10PM 5:00PM SiriKit Lab Technology Lab C Fri 9:00AM 12:00PM

185