Creating Extensions for ios and OS X, Part Two

Transcription

1 Frameworks #WWDC14 Creating Extensions for ios and OS X, Part Two Architecture Session 217 Damien Sorresso Overloaded Operator 2014 Apple Inc. All rights reserved. Redistribution or public display not permitted without written permission from Apple.

2 What Are Apps? Most important experience Own entire screen Installed/removed by user

3 What Are Apps? Most important experience Own entire screen Installed/removed by user

4 What Are Apps? Most important experience Own entire screen Installed/removed by user

5 Extensions Important to the user Not more important than the app Augment current experience Come and go with apps

6 Extensions Important to the user Not more important than the app Augment current experience Come and go with apps

7 Built Separately

8 Built Separately

9 Built Separately

10 Run Separately Different process Isolated address space Executes independently System optimizes separately extension

11 Run Separately Different process Isolated address space Executes independently System optimizes separately extension

12 Run Separately Different process extension Isolated address space Executes independently System optimizes separately

13

14

15 Cancel Network Post Message: Look at this great website I found! Location: San Francisco, CA

16 Extending the Experience

17 A Piece of Your App Focused experience Seamlessly merged with current app Reuse code from your app

18 Sharing Code Hope you used MVC! model controller view Same data model Same view controllers

19 Sharing Code Hope you used MVC! model controller view Same data model Same view controllers

20 What's the best way to share code?

21 Frameworks!

22 Embedded Frameworks Can ship frameworks in ios apps App and extensions can link Encrypted Already possible in OS X

23 Minimum Deployment Target Minimum deployment target may change App linkage requires ios 8 Not affected by extension linkage

24 Minimum Deployment Target Minimum deployment target may change App linkage requires ios 8 Not affected by extension linkage extension

25 Related Sessions Building Modern Frameworks Presidio Thursday 3:15PM

26 API Availability Vast majority of API is available Some exceptions Marked specifically with "unavailability" macro

27 Unavailability + (UIApplication *)sharedapplication NS_EXTENSION_UNAVAILABLE_IOS("Use view controller based solutions where appropriate instead.");

28 Unavailability OS_EXTENSION_UNAVAILABLE("Not available for extensions") extern void super_1337_api_with_underscores(const char *astring);

29 App and Extension Consistency

30 Consistency

31 Consistency Common resources Reflect changes Share data

32 Sharing Data Separate containers No access to app data Opt into data sharing

33 Shared Container App Group Shared storage area General data sharing Coordinate file access

34 Safely Sharing extension

35 ` Safely Sharing extension

36 Safely Sharing extension

37 Safely Sharing extension

38 Synchronization Technologies NSFileCoordination CoreData sqlite

39 NSUserDefaults Distinct user defaults from app Can set up shared domain NSUserDefaults *shareddefaults = [[NSUserDefaults alloc] initwithsuitename:@ com.mycompany.mygreatapp.shared ]; API coordinates access

40 Shared Keychains App Group Distinct keychain from app Can set up keychain access group Like sharing keychains between apps

41 Privacy Approval encompasses app and extensions Some exceptions User approves entirety of app

42 Best Practices

43 Be Lean Frontmost app is still most important Don't have full use of system resources Get in, get out

44 Be Stateless May be killed aggressively No general multitasking Support for short task-completion Flush state to disk

45 Be Awesome Make it seamless Make it useful Surprise and delight!

46 Action Extensions Aki Inoue Cocoa Senior Engineer

47 Action Extensions

48 Action Extensions

49 Action Extensions

50 Action Extensions

51 Describing Action Extensions

52 Describing Action Extensions

53 Describing Action Extensions

54 Principal View Controller View Controller

55 Principal View Controller View Controller Extension Context

56 Principal View Controller View Controller Extension Context Extension Item

57 Principal View Controller View Controller Extension Context Extension Item Item Provider

58 Describing Action Extensions

59 Describing Action Extensions

60 UI Action Setup - (void)viewdidload { [super viewdidload];! // Get NSExtensionContext NSExtensionContext *extensioncontext = self.extensioncontext;! // Get NSExtensionItem NSExtensionItem *inputitem = extensioncontext.inputitems.firstobject; // Get NSItemProvider NSItemProvider *itemprovider = inputitem.attachments.firstobject;

61 UI Action Setup - (void)viewdidload { [super viewdidload];! // Get NSExtensionContext NSExtensionContext *extensioncontext = self.extensioncontext; extensioncontext! // Get NSExtensionItem NSExtensionItem *inputitem = extensioncontext.inputitems.firstobject; // Get NSItemProvider NSItemProvider *itemprovider = inputitem.attachments.firstobject;

62 UI Action Setup - (void)viewdidload { [super viewdidload];! // Get NSExtensionContext NSExtensionContext *extensioncontext = self.extensioncontext;! // Get NSExtensionItem NSExtensionItem *inputitem = extensioncontext.inputitems.firstobject; inputitems // Get NSItemProvider NSItemProvider *itemprovider = inputitem.attachments.firstobject;

63 UI Action Setup - (void)viewdidload { [super viewdidload];! // Get NSExtensionContext NSExtensionContext *extensioncontext = self.extensioncontext;! // Get NSExtensionItem NSExtensionItem *inputitem = extensioncontext.inputitems.firstobject; // Get NSItemProvider NSItemProvider *itemprovider = inputitem.attachments.firstobject;

64 UI Action Setup (continued) } // Request document data [itemprovider loaditemfortypeidentifier:mydocumentuti options:nil completionhandler:^(nsdata *data, NSError *error) { if (data) self.contents = data; }];

65 UI Action Setup (continued) }! } // Request document data [itemprovider loaditemfortypeidentifier:mydocumentuti options:nil completionhandler:^(nsdata *data, NSError *error) { if (data) self.contents = data; }];

66 UI Action Setup (continued) }! } // Request document data [itemprovider loaditemfortypeidentifier:mydocumentuti options:nil completionhandler:^(nsdata *data, NSError *error) { if (data) self.contents = data; }];

67 UI Action Setup (continued) } // Request document data [itemprovider loaditemfortypeidentifier:mydocumentuti options:nil completionhandler:^(nsdata *data, NSError *error) { if (data) self.contents = data; }];

68 Editor UI Action Conclusion - (IBAction)done:(id)sender { NSData *data = self.contents; // Document contents! // Create NSItemProvider NSItemProvider *itemprovider = [[NSItemProvider alloc] initwithitem:data typeidentifier:mydocumentuti]; // Create NSExtensionItem NSExtensionItem *item = [[NSExtensionItem alloc] init]; item.attachments } // Send the data back [self.extensioncontext completerequestreturningitems:@[item] completionhandler:nil];

69 Editor UI Action Conclusion - (IBAction)done:(id)sender { NSData *data = self.contents; // Document contents! // Create NSItemProvider NSItemProvider *itemprovider = [[NSItemProvider alloc] initwithitem:data typeidentifier:mydocumentuti]; // Create NSExtensionItem NSExtensionItem *item = [[NSExtensionItem alloc] init]; item.attachments } // Send the data back [self.extensioncontext completerequestreturningitems:@[item] completionhandler:nil];

70 Editor UI Action Conclusion - (IBAction)done:(id)sender { NSData *data = self.contents; // Document contents! // Create NSItemProvider NSItemProvider *itemprovider = [[NSItemProvider alloc] initwithitem:data typeidentifier:mydocumentuti]; // Create NSExtensionItem NSExtensionItem *item = [[NSExtensionItem alloc] init]; item.attachments } // Send the data back [self.extensioncontext completerequestreturningitems:@[item] completionhandler:nil];

71 Editor UI Action Conclusion - (IBAction)done:(id)sender { NSData *data = self.contents; // Document contents! // Create NSItemProvider NSItemProvider *itemprovider = [[NSItemProvider alloc] initwithitem:data typeidentifier:mydocumentuti]; // Create NSExtensionItem NSExtensionItem *item = [[NSExtensionItem alloc] init]; item.attachments } // Send the data back [self.extensioncontext completerequestreturningitems:@[item] completionhandler:nil];

72 Viewer UI Action Conclusion - (IBAction)done:(id)sender { // Complete Viewer Action [self.extensioncontext completerequestreturningitems:nil completionhandler:nil]; }

73 Viewer UI Action Conclusion - (IBAction)done:(id)sender { // Complete Send the Viewer data back Action [self.extensioncontext completerequestreturningitems:nil completionhandler:nil]; }

74 UIActivityViewController

75 Receiving Result Items - (void)setupactivityviewcontroller { UIActivityViewController *controller; // initialize the controller here! // Specifies the completion handler block } controller.completionwithitemshandler = ^(NSString *activitytype, BOOL completed, NSArray *returneditems, NSError *error) { if (completed && (returneditems.count > 0)) { // process the result items } }];

76 Receiving Result Items - (void)setupactivityviewcontroller { UIActivityViewController *controller; // initialize the controller here! // Specifies the completion handler block } controller.completionwithitemshandler = ^(NSString *activitytype, BOOL completed, NSArray *returneditems, NSError *error) { if (completed && (returneditems.count > 0)) { // process the result items } }];

77 Receiving Result Items - (void)setupactivityviewcontroller { UIActivityViewController *controller; // initialize the controller here! // Specifies the completion handler block controller.completionwithitemshandler completionwithitemshandler = ^(NSString *activitytype, BOOL completed, NSArray *returneditems, NSError *error) { if (completed && (returneditems.count > 0)) { // process the result items } }]; }

78 Receiving Result Items - (void)setupactivityviewcontroller { UIActivityViewController *controller; // initialize the controller here! // Specifies the completion handler block } controller.completionwithitemshandler = ^(NSString *activitytype, BOOL completed, NSArray *returneditems, NSError *error) { if (completed && (returneditems.count > 0)) { // process the result items } }];

79 NSTextView OzarkTrailPrime

80 Demo OS X Action Extension

81 Supporting Multiple Data Types OzarkTrailPrime

82 Reacting to Data Types NSString *texttype = (NSString *)kuttypetext;! // is it text? if ([itemprovider hasitemconformingtotypeidentifier:texttype]) { [itemprovider loaditemfortypeidentifier:texttype options:nil completionhandler:^(nsattributedstring *string, NSError *error) { if (string) { // process text here } }]; }

83 Reacting to Data Types NSString *texttype = (NSString *)kuttypetext;! // is it text? if ([itemprovider hasitemconformingtotypeidentifier:texttype]) { [itemprovider loaditemfortypeidentifier:texttype options:nil completionhandler:^(nsattributedstring *string, NSError *error) { if (string) { // process text here } }]; }

84 Reacting to Data Types NSString *texttype = (NSString *)kuttypetext;! // is it text? if ([itemprovider hasitemconformingtotypeidentifier:texttype]) { [itemprovider loaditemfortypeidentifier:texttype options:nil completionhandler:^(nsattributedstring *string, NSError *error) { if (string) { // process text here } }]; }

85 Reacting to Data Types NSString *texttype = (NSString *)kuttypetext;! // is it text? if ([itemprovider hasitemconformingtotypeidentifier:texttype]) { [itemprovider loaditemfortypeidentifier:texttype options:nil completionhandler:^(nsattributedstring *string, NSError *error) { if (string) { // process text here } }]; }

86 Reacting to Data Types NSString *texttype = (NSString *)kuttypetext;! // is it text? if ([itemprovider hasitemconformingtotypeidentifier:texttype]) { [itemprovider loaditemfortypeidentifier:texttype options:nil completionhandler:^(nsattributedstring *string, NSError *error) { if (string) { // process text here } }]; }

87 Reacting to Data Types NSString *texttype = (NSString *)kuttypetext;! // is it text? if ([itemprovider hasitemconformingtotypeidentifier:texttype]) { [itemprovider loaditemfortypeidentifier:texttype options:nil completionhandler:^(nsattributedstring *string, NSError *error) { if (string) { // process text here } }]; }

88 Reacting to Data Types (continued) NSString *imagetype = (NSString *)kuttypeimage;! // is it image? if ([itemprovider hasitemconformingtotypeidentifier:imagetype]) { [itemprovider loaditemfortypeidentifier:imagetype options:nil completionhandler:^(uiimage *image, NSError *error) { if (image) { // process image here } }]; }

89 Reacting to Data Types (continued) NSString *imagetype = (NSString *)kuttypeimage;! // is it image? if ([itemprovider hasitemconformingtotypeidentifier:imagetype]) { [itemprovider loaditemfortypeidentifier:imagetype options:nil completionhandler:^(uiimage *image, NSError *error) { if (image) { // process image here } }]; }

90 Reacting to Data Types (continued) NSString *imagetype = (NSString *)kuttypeimage;! // is it image? if ([itemprovider hasitemconformingtotypeidentifier:imagetype]) { [itemprovider loaditemfortypeidentifier:imagetype options:nil completionhandler:^(uiimage *image, NSError *error) { if (image) { // process image here } }]; }

91 Reacting to Data Types (continued) NSString *imagetype = (NSString *)kuttypeimage;! // is it image? if ([itemprovider hasitemconformingtotypeidentifier:imagetype]) { [itemprovider loaditemfortypeidentifier:imagetype options:nil completionhandler:^(uiimage *image, NSError *error) { if (image) { // process image here } }]; }

92 Reacting to Data Types (continued) NSString *imagetype = (NSString *)kuttypeimage;! // is it image? if ([itemprovider hasitemconformingtotypeidentifier:imagetype]) { [itemprovider loaditemfortypeidentifier:imagetype options:nil completionhandler:^(uiimage *image, NSError *error) { if (image) { // process image here } }]; }

93 Overlay OS X enhancement

94 Specifying Extension Frame -viewdidload NSRect sourceframe = itemprovider.sourceframe; // original data frame! if (!NSIsEmptyRect(sourceFrame)) { // the host specifies the source frame // Adjust sourceframe based on extension UI margins sourceframe = NSInsetRect(sourceRect, HORIZ_MARGIN, VERT_MARGIN);! } self.preferredscreenorigin = sourceframe.origin; self.preferredcontentsize = sourceframe.size;

95 Specifying Extension Frame -viewdidload NSRect sourceframe = itemprovider.sourceframe; // original data frame! if (!NSIsEmptyRect(sourceFrame)) { // the host specifies the source frame // Adjust sourceframe based on extension UI margins sourceframe = NSInsetRect(sourceRect, HORIZ_MARGIN, VERT_MARGIN);! } self.preferredscreenorigin = sourceframe.origin; self.preferredcontentsize = sourceframe.size;

96 Specifying Extension Frame -viewdidload NSRect sourceframe = itemprovider.sourceframe; // original data frame! if (!NSIsEmptyRect(sourceFrame)) { // the host specifies the source frame // Adjust sourceframe based on extension UI margins sourceframe = NSInsetRect(sourceRect, HORIZ_MARGIN, VERT_MARGIN);! } self.preferredscreenorigin = sourceframe.origin; self.preferredcontentsize = sourceframe.size;

97 Specifying Extension Frame -viewdidload NSRect sourceframe = itemprovider.sourceframe; // original data frame! if (!NSIsEmptyRect(sourceFrame)) { // the host specifies the source frame // Adjust sourceframe based on extension UI margins sourceframe = NSInsetRect(sourceRect, HORIZ_MARGIN, VERT_MARGIN);! } self.preferredscreenorigin = sourceframe.origin; self.preferredcontentsize = sourceframe.size;

98 Specifying Extension Frame -viewdidload NSRect sourceframe = itemprovider.sourceframe; // original data frame! if (!NSIsEmptyRect(sourceFrame)) { // the host specifies the source frame // Adjust sourceframe based on extension UI margins sourceframe = NSInsetRect(sourceRect, HORIZ_MARGIN, VERT_MARGIN);! } self.preferredscreenorigin = sourceframe.origin; self.preferredcontentsize = sourceframe.size;

99 Actions and the Web Safari custom actions Ian Baird ios Frameworks Engineer

100

101

102 Safari Custom Actions Rich new functionality in Safari on ios

103 Safari Custom Actions Rich new functionality in Safari on ios Access the DOM

104 Safari Custom Actions Rich new functionality in Safari on ios Access the DOM Two types

105 Safari Custom Actions Rich new functionality in Safari on ios Access the DOM Two types View controller

106 Safari Custom Actions Rich new functionality in Safari on ios Access the DOM Two types View controller No view

107 Safari Custom Actions JavaScript

108 Safari Custom Actions JavaScript

109 Safari Custom Actions JavaScript var PreprocessingJavaScript = function() {! };! PreprocessingJavaScript.prototype = {! run: function(actionargs) { // Get all image URLs from the document. actionargs.completionfunction({"imageurls": imageurls, "baseuri": document.baseuri}); },

110 Safari Custom Actions JavaScript var PreprocessingJavaScript = function() {! };! PreprocessingJavaScript.prototype = {! run: function(actionargs) { // Get all image URLs from the document. actionargs.completionfunction({"imageurls": imageurls, "baseuri": document.baseuri}); },

111 Safari Custom Actions JavaScript

112 Safari Custom Actions JavaScript

113 Safari Custom Actions JavaScript var PreprocessingJavaScript = function() {! };! PreprocessingJavaScript.prototype = { finalize: function(actionargs) { alert(actionargs[ message"]); } };

114 Safari Custom Actions JavaScript var PreprocessingJavaScript = function() {! };! PreprocessingJavaScript.prototype = { finalize: function(actionargs) { alert(actionargs[ message"]); } };

115 Safari Custom Actions JavaScript var PreprocessingJavaScript = function() {! };! PreprocessingJavaScript.prototype = { };! var ExtensionPreprocessingJS = new PreprocessingJavaScript;

116 Safari Custom Actions JavaScript var PreprocessingJavaScript = function() {! };! PreprocessingJavaScript.prototype = { };! var ExtensionPreprocessingJS = new PreprocessingJavaScript;

117 Safari Custom Actions Global variable

118 Safari Custom Actions Global variable ExtensionPreprocessingJS

119 Demo Safari custom actions

120 Safari Custom Actions Summary Flexibility of the web

121 Safari Custom Actions Summary Flexibility of the web Power of extensions

122 Safari Custom Actions Summary Flexibility of the web Power of extensions Transform web data easily

123 Safari Custom Actions Summary Flexibility of the web Power of extensions Transform web data easily

124 Summary Rich workflows

125 Summary Rich workflows Security

126 Summary Rich workflows Security Fun!

127 More Information Jake Behrens App Frameworks Evangelist Documentation App Extension Programming Guide Apple Developer Forums

128 Labs Extensions Lab Frameworks Lab B Thursday 2:00PM

129