MOBILE TESTING REFERENCE GUIDE

Transcription

1 SOLUTIONS BRIEF MOBILE TESTING REFERENCE GUIDE If you develop mobile applications, you already understand the why of software testing. You know that testing ensures your applications will perform as expected in production and deliver a consistent experience to end users that will earn you star ratings in app stores. This reference guide offers comprehensive guidance for planning a mobile application testing strategy.

2 TABLE OF CONTENTS Devices and Operating Systems to Target for Mobile Application Testing Mobile Device and Operating System Usage Trends Recommendations by Business Size Rankings by User Characteristics Rankings by Geographic Region Android Device Rankings ios Device Rankings OS Versions: Android and ios 0 Conclusion

3 DEVICES AND OPERATING SYSTEMS TO TARGET FOR MOBILE APPLICATION TESTING If you develop mobile applications, you already understand the why of software testing. You know that testing ensures your applications will perform as expected in production and deliver a consistent experience to end users that will earn you star ratings in app stores. Yet the how of mobile application testing can be more complicated. While an automated testing solution like Sauce Labs handles many of the tedious tasks for you, you still have to decide which types of devices and operating system versions to test across. That choice will be based on several factors, including: The geographic locations of your users. The industry in which you operate. The size of your organization. The gender, education level, income range and other personal characteristics of your users. Using this information to determine which types of devices and operating systems to prioritize for the testing market is essential for making optimal use of your testing resources. That s why we ve created this reference for you. It offers comprehensive guidance for planning a mobile application testing strategy. We have collected and organized device and OS data based on popularity with consumers in North America, EMEA and the rest of the world based on our analysis of mobile usage trends from several sources. While we can t tell you exactly which hardware and software platforms to test (that s of course a decision that varies from organization to organization), we can help you to clarify the biggest unknowns and get started in designing a mobile application testing strategy that meets all of your needs. MOBILE DEVICE AND OPERATING SYSTEM USAGE TRENDS The following are recommendations on mobile device hardware and software trends in today s market. The information is based on research and data collection from several sources, including Sauce Labs customer testing and anonymized user data, collected in collaboration with external vendors.

4 RECOMMENDATIONS BY BUSINESS SIZE Your test strategy should reflect not only market trends, but also the size of your business and the scale of your testing resources. We recommend that small and mediumsized businesses focus on testing for the devices and OS versions listed in the top 0 chart below. Larger businesses should focus on those in the top chart. Startups Employees: <00 Large Businesses & Enterprises Employees: 00+ Device iphone OS Version 0.. Device iphone OS Version 0.. iphone s 0.. iphone s 0.. Samsung Galaxy S Samsung Galaxy S ipad.. ipad.. iphone Plus 0.. iphone Plus 0.. iphone 0.. Samsung Galaxy S.0. 0 SMBs Employees: 0000 Device iphone iphone s Samsung Galaxy S ipad iphone Plus iphone Samsung Galaxy S Samsung Galaxy S Edge Samsung Galaxy S Samsung Galaxy Tab S OS Version Samsung Galaxy S Edge Samsung Galaxy S Samsung Galaxy Tab S iphone ipad Samsung Galaxy S Edge Samsung Galaxy S Mini Samsung Galaxy S Sony Xperia Z Huawei P iphone Plus Google Nexus X Samsung Galaxy S Samsung Galaxy Tab S HTC One M.0. Samsung Galaxy S Mini.. Google Nexus P.. Samsung Galaxy J.0.

5 RANKINGS BY USER CHARACTERISTICS Gender Android 0% % ios Other MALE % FEMALE 0% % % Household Income $0,000$,000 $,000$00,000 $00,000$,000 $,000+ % % 0% % % % 0% % Other Factors Affecting Platform Preference Impact on Adroid Adoption Impact on ios Adoption Age High technical skillset Live in an urban area Hold graduate degree No significant effect Very likely No significant effect Likely No significant effect Likely Likely Very likely

6 RANKINGS BY GEOGRAPHIC REGION The following charts display recommendations for the leading mobile device vendors in specific countries and regions. Top Device Vendors by Region Vendor Market Share* Trend United States Apple Samsung LG Motorola 0% % % % ZTE % Apple Huawei 0% % China Xiaomi Oppo 0% 0% BBK % Samsung Xiaomi % % India Lenovo Nokia % % Oppo % Samsung Apple % % Europe Huawei LG 0% % Sony Ericsson % Samsung Huawei 0% % Africa Nokia Tecno % % Infinix % South America Samsung Motorola LG Apple % % 0% % Huawei %

7 ANDROID DEVICE RANKINGS The following are recommendations for Android devices across all regions. Top 0 Smartphones Top 0 Vendors Samsung Galaxy S Samsung Galaxy S Samsung Xperia Z Samsung Galaxy S Edge Smartphones Tablets Samsung Galaxy S Samsung Galaxy S Mini 0 Samsung Galaxy S Samsung Galaxy S Edge Huawei P HTC One 0

8 IOS DEVICE RANKINGS The following are recommendations for ios devices (including iphones as well as ipads) across all regions. ios: Top 0 Devices iphone iphone s iphone Plus ipad iphone iphone s iphone c ipad Air ipad Mini 0 iphone ipads: Top 0 Device Variants ipad Air ipad Air ipad ipad Pro ipad ipad ipad Mini 0 ipad Mini ipad Mini ipad Mini

9 OS VERSIONS: ANDRIOD AND IOS.x Top OS Versions.x.x.0... ios Top OS Versions ios ios

10 CONCLUSION The best approach to selecting the right devices and operating systems to test your mobile app across is to know your users and understand the latest usage trends. These trends change constantly as new devices are released and OS versions are updated. The primary goal is to ensure that maintenance of physical devices and lab management is not time consuming and costly. A sound mobile strategy includes real devices, emulators/simulators, and the ability to meet the needs of mobile app testing for the user base and demographics. SB000 0

11 ABOUT SAUCE LABS Sauce Labs provides the world s largest cloudbased platform for automated testing of web and mobile applications. Sauce Labs runs over. million tests per day, providing most up to date testing trends along with instant access to all the device and OS combinations listed in this report. Sauce Labs provides the testing for mobile web, hybrid and native apps. Its awardwinning service eliminates the time and expense of maintaining an inhouse testing infrastructure, freeing development teams of any size to innovate and release better software, faster. Sauce Labs is a privately held company funded by Toba Capital, Salesforce Ventures, Centerview Capital Technology, IVP and Adams Street Partners. For more information, please visit saucelabs.com. SAUCE LABS INC. HQ SAUCE LABS EUROPE GMBH SAUCE LABS INC. CANADA BRYANT STREET #0 NEUENDORFSTR. B ABBOTT ST #0 SAN FRANCISCO, CA 0 USA HENNIGSDORF GERMANY VANCOUVER, BC VB K CANADA