High Performance: What These Apps Did May Shock You

Transcription

1 High Performance: What These Apps Did May Shock You Doug Sillars ARO Technical Lead Tiffany Kinkade ARO Developer Advocate

2 Doug Sillars ARO Technical Tiffany Kinkade ARO Developer

3 The Next 40 Minutes Will Change Your App

4 Developers Make This Mistake Everyday, And it s Killing Their Customer s Battery Data Connections account for: 40% of battery use (screen on) 70% screen off

5 You Won t Believe What Else Network Connections Do Cellular Networks are High Latency Environments Not Optimizing Your Content can lead to delays: 500ms: 26% frustration 8% engagement Amazon.com: 100ms delay 1% revenue 4% of mobile users admit to throwing their phones

6 Is Performance Holding Your App Back? User Acquisition Retention Rate User Experience/ Happiness Usage Session Length Active Users Lifetime Value Average Revenue per user Lifetime Value App Launch/Load Time

7 One Developer Tried This One Simple Trick Discovery Adoption Trial 48% of customers abandon if dissatisfied with the performance of a mobile app

8 Understanding Application Performance

9 Just Because Someone Says Unsinkable 98% of apps tested have potential Performance Optimizations

10 Death by a Thousand Cuts Or, It Isn t Always the Iceberg Minor issues found in testing Big problems at scale

11 Successful Applications Find That Testing Helps to Find Issues Early 44% of all issues are reported by users 20% issues were only found because of complaints in app reviews

12 The Bigger They Are The Quicker Small Issues Magnify

13 Find My Goat*

14 Find My Goat Connecting to the network every 5 seconds Creating a new connection every time 18x more connections than this app s architecture team expected The triage team discovered that IP/port collisions = loss in sales

15 Computers Are Great at Repetitive Stuff But Don t Punish Your Users

16 Repetitive Download vs. Caching 100 seconds to load

17 Caching Enabled!! 30 second startup 2 nd startup

18 Major Snap Sales App

19 Thumbnails or Dumbnails Downloading the same image twice, in different sizes, doesn t make sense. Download it once and use it in multiple ways. 54 kb User has to wait for image to load 198 kb World Famous World Famous Goat Racing Goat Racing Was $79, Now Was $79, Now $39 $39

20 Major Brick and Mortar Retailer Image:

21 A Rolling Stone Gathers No Moss, But Spinning Wheels Kill Sales With the introduction of these progress indicators, we had made people watch the clock. As a result, time went slower and so did our app. ~ Luke Wroblewski

22 AT&T DriveMode

23 AT&T DriveMode for Android 3 min 480 GPS connections/24hr ~20% Battery

24 AT&T DriveMode for Android Use activity APIs to identify when your users are in motion DetectedActivity.ON_FOOT: DetectedActivity.ON_BICYCLE: 11 minute trace DetectedActivity.IN_VEHICLE

25 Major Sports Reporting Application Regular NFL season Sept 4 Feb 1 50,000,000 installs on just Android So what would you expect the behavior of the app to be in June at 2am?

26 Major Sports Reporting Application Pinging the network 3 minutes 24 x 7 x365 Consider 70,000 fans in a stadium with this app trying to hit the network

27 Advertising Could Be Killing Your App Consider your advertising partner like you would a business partner Do they compress their content? Do they close their connections? Caching?

28 Constant Improvement Most of these issues have already been fixed by the app developers we ve worked with, but if you re wondering why the tops apps are staying on top, it s because they are constantly checking and watching all of these Best Practices.

29 Don t Over Think Performance Testing

30 The Excuses Too much effort Users haven t complained Why fix something that isn t broken Time Usage Cost Everyone else does the same thing Return on Investment Skill sets

31 Performance Testing Guidelines

32 Keep it Simple Free Tools: Application Resource Optimizer Network Attenuator Trepn Android Systrace Battery Historian Etc. Two tests (minimum) 40 minutes total testing time

33 What You Find Might Surprise You What the User Wants What the App Needs GPS Active Use Idle Use

34 AT&T Defects Duplicate Content Periodic Connections Closing Connections GPS/BT Text Compression Sev 3 <5% of KB 0-20% of Power 0-20% of Power 0-25% Active (s) KB Sev % of KB 20-50% of Power 20-50% of Power 25-65% Active (s) KB Sev 1 20+% of KB 50+% of Power 50+% of Power 65+% Active (s) 1000+KB

35 Trace Collections Hints Encourage testers to move at a speed that emulates real users Create flexible (yet reproducible) test cases Test cases can even reflect more of a feature checklist The Trace is not about the order of the features, but about the content Don t limit testing to 2 traces if additional are needed Some streaming apps can have a trace with just streamed content Some apps are most inefficient at startup Be Curious If something seems odd, explore it Screen rotation best practice came out of tester noticing the network lighting up each time they turned the device

36

37 Q&A

38 Thank You