WHAT DEVOPS NEED TO KNOW ABOUT MOBILE

Transcription

1 WHAT DEVOPS NEED TO KNOW ABOUT MOBILE or really everyone Jon Arne Sæterås

2 Desktop Mobile Tablet Console statcounter.com MOBILE MAJORITY

3 Desktop Mobile Tablet Console statcounter.com 80% MOBILE In India, and most of Asia, mobile is the main concern

4 Desktop Mobile Tablet Console RUSSIA

5 http Native apps Browsers Hybrid apps Web sites APIs Services Logs Analytics Reporting Debug

6

7

8

9 KNOW WHO YOU RE COMMUNICATING WITH Who sent the message?

10 s #devop

11 USER-AGENT h"ps://tools.ie-.org/html/rfc7231#sec8on-5.5.3

12 MEANINGFUL USER-AGENTS User-Agent Native apps Browsers Hybrid apps Web sites APIs Services Logs Analytics Reporting Debug

13 The "User-Agent" header field contains information about the user agent originating the request, which is often used by servers to help identify the scope of reported interoperability problems, to work around or tailor responses to avoid particular user agent limitations, and for analytics regarding browser or operating system use. #devops #BFF Format: User-Agent = product *( RWS ( product / comment ) ) The User-Agent field-value consists of one or more product identifiers, each followed by zero or more comments (Section 3.2 of [RFC7230]), which together identify the user agent software and its significant subproducts. By convention, the product identifiers are listed in decreasing order of their significance for identifying the user agent software. Each product identifier consists of a name and optional version. Name of the thing Thing version White space MostSignificant/1.0 Significant/1.1 LessSignificant high significance low

14 IN THE BEGINNING NCSA_Mosaic/2.0 Mozilla/1.0 (Win3.1) supported frames! Mozilla/1.22 (compatible; MSIE 2.0; Windows 95) History of the browser user-agent string:

15 AND NOW if(preg_match( /^Mozilla/, $useragent)){ //frameset support!! :D } WTF Mozilla/5.0 (Mobile; Windows Phone 8.1; Android 4.0; ARM; Trident/7.0; Touch; rv:11.0; IEMobile/11.0; NOKIA; Lumia 630) like iphone OS 7_0_3 Mac OS X AppleWebKit/537 (KHTML, like Gecko) Mobile Safari/537 #mess

16 OK, IT S A MESS but what can we do with our apps?

17 THREE KINDS OF APPS for simplicity (Progressive) Web Apps Hybrid Apps Native Apps Run in the browser. We re good. An app, but loads web content/pages Native code using APIs to communicate

18 Hybrid Apps ANDROID Mozilla/5.0 (Linux; Android 5.1.1; Nexus 5 Build/LMY48B; wv) AppleWebKit/ (KHTML, like Gecko) Version/4.0 Chrome/ Mobile Safari/ <Stock User-Agent> WebViewApp <AppName>/<Version> Mozilla/5.0 (Linux; Android 5.1.1; Nexus 5 Build/LMY48B) AppleWebKit/ (KHTML, like Gecko) Version/4.0 Chrome/ Mobile Safari/ WebViewApp Foo/1

19 Hybrid Apps ANDROID String ua = new WebView(this).getSettings().getUserAgentString(); webviewtouse.getsettings().setuseragentstring(ua + WebViewApp Foo/1 );

20 Hybrid Apps IOS WEBVIEW Mozilla/5.0 (iphone; CPU iphone OS 11_1 like Mac OS X) AppleWebKit/ (KHTML, like Gecko) Mobile/15B93 <Stock User-Agent> WebViewApp <AppName>/<Version>/<iOS HW ID> Mozilla/5.0 (iphone; CPU iphone OS 11_1 like Mac OS X) AppleWebKit/ (KHTML, like Gecko) Mobile/15B93 WebViewApp Foo/1/iPhone4,1 Swift: let useragent = UIWebView().stringByEvaluatingJavaScript(from: "navigator.useragent")! + "WebViewApp Foo/1/" + getname(); UserDefaults.standard.register(defaults: ["UserAgent" : useragent]) Objective C: UIWebView* webview = [[UIWebView alloc] initwithframe:cgrectzero]; NSString* ua = [webview stringbyevaluatingjavascriptfromstring:@"navigator.useragent"]; Then we modify the extracted User-Agent via the AppDelegate file: NSDictionary *dictionary = [NSDictionary dictionarywithobjectsandkeys: ua WebViewApp Foo/1/" + [self nil]; [[NSUserDefaults standarduserdefaults] registerdefaults:dictionary]; Swift Code at

21 Hybrid Apps IOS WEBVIEW Swift: let useragent = UIWebView().stringByEvaluatingJavaScript(from: "navigator.useragent")! + "WebViewApp Foo/1/" + getname(); UserDefaults.standard.register(defaults: ["UserAgent" : useragent]) Objective C: UIWebView* webview = [[UIWebView alloc] initwithframe:cgrectzero]; NSString* ua = [webview stringbyevaluatingjavascriptfromstring:@"navigator.useragent"]; Then we modify the extracted User-Agent via the AppDelegate file: NSDictionary *dictionary = [NSDictionary dictionarywithobjectsandkeys: ua WebViewApp Foo/1/" + [self nil]; [[NSUserDefaults standarduserdefaults] registerdefaults:dictionary]; Swift Code at

22 Native Apps ANDROID Dalvik/2.1.0 (Linux; U; Android 6.0.1; vivo 1610 Build/MMB29M) <AppName>/<version> <Default User-Agent> Myapp/1 Dalvik/2.1.0 (Linux; U; Android 6.0.1; vivo 1610 Build/MMB29M)

23 Native Apps ANDROID URLConnection cn = new URL(" cn.setrequestproperty("user-agent", Myapp/1 + System.getProperty("http.agent")); cn.connect();

24 Native Apps IOS MyApp/1 CFNetwork/808.3 Darwin/ <AppName/<version> <idevice platform><apple model identifier> ios/<os version> CFNetwork/<version> Darwin/<version> MyApp/1 iphone5,2 ios/10_1 CFNetwork/808.3 Darwin/ Swift: let useragent = UAString() if let url = NSURL(string: "") { let request = NSMutableURLRequest(url: url as URL) request.setvalue(useragent, forhttpheaderfield: "User-Agent") //... } Objective C: NSString* useragent = getuastring(); NSURL* url = [NSURL URLWithString:@""]; NSMutableURLRequest* request = [[NSMutableURLRequest alloc] initwithurl:url]; [request setvalue:useragent forhttpheaderfield:@"user-agent"]; Code at:

25 PITFALLS Fingerprinting/privacy Truncation Pretending to be something you re not Don t ever trust regular expressions to parse a User-Agent

26 Desktop Tablet Smart-TV Smartphone Feature Phone RUSSIA 4 % Form factors Q % 56 %

27 RUSSIA Popular Devices Q Samsung Galaxy J5 (2016) Samsung Galaxy J5 Samsung Galaxy J3 Duos Apple iphone 6S Apple iphone 6 Samsung Galaxy J7 (2016) Samsung Galaxy Grand Prime Apple iphone 7 Apple iphone 5S Huawei Y5II Other 4,15 % 4,15 % 3,59 % 3,59 % 2,84 % 2,84 % 2,84 % 2,84 % 2,61 % 2,61 % 2,39 2,39 % % 2,17 2,17 % % 2,16 2,16 % % 2,05 2,05 % % 1,95 1,95 % % 73,25 % 0 0,013 0,025 0,038 0,05 0 0,2 0,4 0,6 0,8

28 Samsung Huawei Apple LG Lenovo Sony Alcatel Nokia HTC Microsoft RUSSIA Top manufacturers Q % 4 % 4 % 6 % 7 % 2 % 2 % 41 % 15 % 15 %

29 9 % 6 % RUSSIA Popular Apps Q % 12 % 50 % 13 % Facebook Flipboard Google Search UCBrowser Opera browser Instagram Pinterest Twitter Facebook Messenger

30 Snapdragon 820; 1,1% Snapdragon 801; 17,0% Samsung Chipsets Snapdragon 835; 2,8% Other; 2,8% Exynos 5410; 2,4% Exynos 7420; 19,5% CHIPSETS Huuuge difference in performance Snapdragon 400; 3,4% Exynos 8895; 1,5% Exynos 8890; 37,9% Apple Chipsets Exynos 7420 Octa; 9,5% Exynos 7580 Octa; 2,1% Apple A10 Fusion; 25,8% Apple A9; 36,1% Apple A4; 0,2% Apple A5; 0,4% Apple A6; 4,4% Apple A7; 8,4% Apple A8; 24,6%

31 WHAT ELSE OK, we got some stats, but is there more?

32 THE WEB 55% of the web is images images video scripts css fonts html other 14 % 1 % 2 % 3 % 3 % 24 % 55 %

33 SCREEN RESOLUTIONS Other is the biggest! 22 % 19 % 1 % 1 % 1 % 1 % 13 % 2 % 2 % 2 % 2 % 2 % 7 % 3 % 3 % 5 % 2 % 3 % 3 % 4 % 3 % 360x x x x x x x x x x x x x x x x x x x x720 Other

34 IMAGE CDN User-Agent origin cache optimize distribute detect detect Screen size Resolution Formats Network etc. Cache key Native apps Browsers Hybrid apps

35 IS IT WORKING? Actual Bandwidth Usage For Optimized Objects Original Bandwidth Usage For Non-Optimized Objects Mbps Mbps Mbps Mbps 0 Mbps Time

36 IS IT WORKING? 75%-ish less data transmitted No visual quality loss >50% of images converted to different formats In apps, most images resized Faster loading UI Original traffic Optimized

37 MEANINGFUL USER-AGENTS Would have been too romantic sticking with the standard Name of the thing Thing version White space MostSignificant/1.0 Significant/1.1 LessSignificant high significance low The real world is a mess with historical mistakes that stick with us.

38 MEANINGFUL USER-AGENTS Remember to fix the App User-Agents Default Recommended ios MyApp/1 CFNetwork/808.3 Darwin/ MyApp/1 iphone5,2 ios/10_1 CFNetwork/808.3 Darwin/ Android Dalvik/2.1.0 (Linux; U; Android 6.0.1; vivo 1610 Build/MMB29M) Myapp/1 Dalvik/2.1.0 (Linux; U; Android 6.0.1; vivo 1610 Build/MMB29M)

39 I know where you live. My wife