deviceconnect Core of the Enterprise Mobile App Infrastructure

Transcription

1 deviceconnect Core of the Enterprise Mobile App Infrastructure

2 Contents Executive Summary 3 deviceconnect Cloud Architecture 11 Mobility Pain Points 4 deviceconnect Cloud Security Architecture 12 Costs of Poor Quality 5 Remote Device Control 12 Capital Expense Control 5 Secure Mobile Testing. Simplified. 13 Core of the Enterprise Mobile App Structure 6 Server Software Architecture 14 Pain Relief from a Cloud 7 deviceagent 14 Rebuilding DevOps Capability 8 Three-tier Software Architecture 15 Public vs. Private 9 Patent Applications 15 deviceconnect a Private Mobile Device Cloud 10 Putting it All Together 16 Test Your Way 11 About 16 EXECUTIVE SUMMARY Mobile devices have become the dominant venue for delivering customer-facing, B2B, and workplace apps as enterprise IT groups move from mobile first to mobile everything. While mobility brings ease of use to end users, enterprise IT faces massive challenges brought about by the enormous variety of device types and software platforms in the market. Moreover, development and testing has dramatically changed in earlier, desktop-web development, the number of test cases largely determined quality, since there was little variation among browsers. In mobility, however, quality is determined both by the number of test cases and the variety of devices tested. deviceconnect: Core of the Enterprise Mobile App Infrastructure 2

3 EXECUTIVE SUMMARY At the sunset of desktop web s dominance, its development hums along using Agile methodologies and DevOps capabilities; enterprise IT is able to leverage virtual servers to facilitate rapid change, continuous deployment, and to closely align production and test environments. However, more apps, higher end user expectations, and the burgeoning proliferation of mobile device types quickly bring chaos to the mobile everything enterprise, and DevOps gains can grind to a halt. For enterprise apps, new technologies are needed to bring order to the chaos of mobile development. The new core of the infrastructure is the mobile device cloud that can easily make a variety of devices available to developers and testers and can deliver key DevOps capabilities. A mobile device cloud must perform well, offer scheduling and DevOps capabilities, and be secure. As the core component, a device cloud can speed app delivery, reduce capital outlays, and reduce rework costs. After discussing the benefits of the core of the new infrastructure, we will look at the technology and capability of Mobile Labs private device cloud, deviceconnect. deviceconnect: Core of the Enterprise Mobile App Infrastructure 3

4 MOBILITY PAIN POINTS The chaos of mobile app development brings a number of pain points that are caused by the technology differences between mobile app development, test, and delivery, and what has come before. It is clear that the costs of mobile app development and test can quickly outstrip traditional desktop web. The variety of mobile platforms requires a huge number of test cases; time wasted waiting to touch devices slows developers and testers; quality suffers and costs rise dramatically because of bloated capital budgets and the costs of rework. When delivery slows and quality is challenged, end user reactions can damage brands and cost business. Global system integrator Infosys advises its clients, [mobile] app quality is directly related to the number of devices tested. Infosys believes that test teams need better and more cost-effective solutions to avoid any compromise on quality. The challenge of testing enough devices to ensure mobile app quality quickly becomes overwhelming: GSM Arena reports there are 97 manufacturers of mobile devices Open Signal reports that in more than 600,000 downloads of its app, there were thousands of different Android devices detected Apple alone has delivered 28 different devices to market There are five different, viable versions of ios in the market There are 10 different, viable versions of Android in the market Quality Mobile App Development Challenges $ Huge number of test cases $ Mobile DevOps inefficiencies $ Cost to repair poor quality $ Lower productivity caused by waiting to use devices $ Capital expense for a large variety of devices $ Damage to brand, loss of business deviceconnect: Core of the Enterprise Mobile App Infrastructure 4

5 COSTS OF POOR QUALITY If developers don t get to check out apps on a sufficient variety of devices, then testers must catch problems. If testers don t get to check apps on a sufficient variety of devices, then users catch problems. When users experience problems in mobile apps, poor perception of quality leads to poor app store reviews or, worse, the app gets deleted. Failing to find problems before users do ratchets up costs. A NASA software study showed that finding defects after deployment was up to 5-6 times more expensive than finding them during testing. The major challenge facing development and QA teams is how to test on a sufficient variety of devices to ensure that users aren t the ones finding problems. And that can bloat capital budgets. Defect Cost Requirements Design Develop Test Deploy Phase of Mobile App Development CAPITAL EXPENSE CONTROL Taking a hypothetical case where 100 developers and testers need access to just 24 device types, a mobile device cloud can make a remarkable difference in the budget. At the extreme end is a plan that purchases one of each device type for each engineer. But a $700K annual budget (assuming device life of two years) grows when new devices are announced. For example, in the fall of 2014, Google and Apple announced six new device types; by making those available to the team, the annual budget grows to more than a million dollars. Covering the same testers with 96 devices in a device cloud, even after absorbing the newly-announced devices, the budget is cut to a fraction. It is clear that a device cloud has powerful potential to reduce capital budgets. 100 people, 24 types, one device for everybody $1.4 Million (24 x $600 x 100) $700k per year Apple, Google, announces 6 devices $360k (6x100) $1060k for the year DeviceCloud 96 Devices $57.6k ($96 x 600) $28.8k per year Apple, Google, announces 6 devices $14.4k (6x4) $43.2k for the year deviceconnect: Core of the Enterprise Mobile App Infrastructure 5

6 CORE OF THE ENTERPRISE MOBILE APP INFRASTRUCTURE The basic architecture of a device cloud makes devices available to remote users wherever they are in an enterprise s worldwide infrastructure. Without the instant access that a device cloud can provide, there are significant risks of under-utilized devices and under-utilized engineers. The cloud can put the right device in the control of the right user instantly without delays caused by searching for or shipping devices. With more types of devices readily available, developers and testers can ensure app quality is optimized. The usefulness and appeal of the device cloud is not exclusive to developers and testers. Support engineers, trainers, architects, sales engineers, and others involved in the mobile app development lifecycle gain productivity and greater ability to collaborate from use of the device cloud, making it truly the core of the infrastructure. Heart of the Infrastructure: Developers Test Engineers Support Engineers Trainers Architects Sales Engineers deviceconnect: Core of the Enterprise Mobile App Infrastructure 6

7 PAIN RELIEF FROM A CLOUD Blog site e-testing notes, Cloud-based testing makes it possible to collaborate more effectively, to test across multiple platforms with less hardware, and to spend less on testing efforts, both long and short term. A mobile device cloud relieves pain when it restores order to the world of mobile app development and testing. Significantly more cost effective than a one of everything for everybody strategy, a device cloud can: By making mobile devices instantly available, by scheduling access to devices, and by facilitating mobile DevOps, a device cloud helps customer support, development, and quality engineers to: Produce better quality apps by testing on the widest possible variety of devices while reducing capital budgets. Eliminate waits for devices through instant or scheduled access, covering more locations and more shifts with the same device pool. Instantly collaborate, boosting productivity. Make possible more complete test coverage over a given range of devices. Rare or out-of-manufacture devices can be made available for app checkout and automated testing. Make possible more complete device utilization through cloud automation. The device cloud can run automated tests when devices are otherwise idle. The cloud either automates or eliminates manual steps involved. Make possible more complete device utilization through time-shifts. For example, an offshore team may be able to use the same set of devices used by the domestic team while the domestic team is not working. Utilize user interface automation to make possible running more test cases more frequently. Reduce costs of rework by finding problems earlier in the delivery cycle. Reduce the chances of lost business or brand damage. Facilitate critical collaboration through screen sharing, video recording, and sharing of automated run results. The best minds can tackle the toughest problems as a team. Multiple developers can investigate a problem, and developers, support engineers, and test engineers can observe and analyze device behavior concurrently in real time, even if located on different continents. deviceconnect: Core of the Enterprise Mobile App Infrastructure 7

8 REBUILDING DEVOPS CAPABILITY The need for a sufficient variety of devices is a revolutionary turn of events for enterprise development and test teams; until the advent of mobility, the same computers used to develop code could be used to test it, and a single type of workstation could be used for all work. The DevOps revolution rode on virtualization that enabled gains in rapidly applying changes, continuous integration, test bed deployment, and selective functional updates. The development tools cause a serious productivity drain because testing or checking out apps involves manual processes: the developer or tester must locate the correct binary version of the app and then must install the app on a test device, manual processes that use Apple and Google tools or web-based delivery apps. Without a device cloud, mobility may significantly reduce these gains: The development tools run on different systems than the apps, with different CPUs, hardware architectures, and operating systems. One type of development environment is not sufficient; Apple s Xcode mandates a Mac system, for example. Virtualization cannot help because software simulators are not an answer; real devices are needed for any kind of serious testing. Simulators do not account for variations in CPU or memory performance, on-device hardware emulation, network access, or OS supervisory reactions to device conditions like memory availability, temperature, or battery state. A mobile device cloud must have DevOps support and goals to shape the state of the art in mobile DevOps. The cloud should be able to automate continuous integration, the setup of the right apps on the right devices, and should be able to support automatic test case execution, relieving developers, testers, and other engineers of most if not all of the manual processes that use Apple and Google tools or web-based delivery apps. deviceconnect: Core of the Enterprise Mobile App Infrastructure 8

9 PUBLIC VS. PRIVATE Cloud technology that delivers processing power, data, and apps is becoming pervasive. Significant cost savings and gains in efficiency are the primary drivers for cloud technology. Yet public clouds can carry risk. Global Knowledge Training points out ten major security concerns, among them: Where is the data? How many backups? Where are the backups? Is the data stored in a country with fewer controls or less effective intellectual property protections? Can other users see your data? Who has access? Global Knowledge says, Insider attacks are a huge risk. What kind of training does the provider offer its employees? Global Knowledge points out that people will always be the weakest link in security. Is there a data classification system and is data encrypted? When is data not encrypted? (For example, when running on a remote device). Regulatory Requirements. Does the cloud provider meet ISO 27003, Safe Harbor, ITIL, and COBIT requirements? Is the provider willing to undergo certification, accreditation, and review? What are the procedures for a security breach? What services will the provider offer in the case of a breach? As Global Knowledge points out, cloud-based services are an attractive target to hackers. What is the disaster recovery plan and business continuity plan? What seems to be evolving is more strategic use of cloud technology public clouds are used for many functions, but private clouds are being deployed by security conscious enterprises when their more sensitive or proprietary data is at risk. InformationWeek s 2014 Private Cloud Survey shows that the percentage of respondents owning functional private clouds more than doubled from 2012 to 2014, from 21 per cent to 47 per cent. It would be difficult to overstate the success of the private cloud vision as reported by our respondents, InformationWeek noted. The significant factors causing companies to consider private clouds included: Significant operational cost savings (61%) Significant capital cost savings (54%) Compelling technical advantage (48%) Lower cost to entry (48%) When asked the reasons they would not use a public cloud, the two major citations were: Security and privacy concerns (73%) Regulatory, compliance, or legal restrictions (33%) InformationWeek s 2014 Private Cloud Survey shows that the percentage of respondents owning functional private clouds more than doubled from 2012 to 2014, from 21 percent to 47 percent. It would be difficult to overstate the success of the private cloud vision as reported by our respondents, InformationWeek noted. deviceconnect: Core of the Enterprise Mobile App Infrastructure 9

10 DEVICECONNECT A PRIVATE MOBILE DEVICE CLOUD Mobile Labs deviceconnect is a mobile device cloud that makes it easy for testers and developers to get live access to a real mobile device. A single unit holds up to 48 mobile devices that are attached to a server using powered USB hubs. More than one unit can be deployed if more devices are needed, and larger form factors of 100 devices and greater are planned. deviceconnect supports three closely-connected solution domains: automated testing of mobile applications and mobile websites, management of devices, users, and applications, and manual testing of mobile applications and mobile websites. The functional capabilities of deviceconnect include: Testing includes automated and manual testing of apps, websites, and hybrid apps that combine the two. Mobile Labs Trust, a certified add-in to HP s Unified Functional Test (UFT), supports automation. User Interface Automation includes using Trust with UFT; Selenium tests using WebDriver; open-source scripting using Frank, Calabash, and others; and partner automation including SOASTA TouchTest, Tricentis Tosca TestSuite, TurnKey and others. Performance Testing includes using UFT scripts to measure performance on real devices. Performance Metrics includes gathering device metrics through partner Crittercism. Load Testing includes using real mobile devices with HP s LoadRunner. Network Virtualization includes using real mobile devices as part of network virtualization tests using Shunra. Monitoring includes service level analysis and application health checking on real mobile devices using HP s BPM. Scheduling includes the ability to reserve devices in advance for individual use or for automated test runs. Devices can be reserved for a specific time or on a recurring basis. App Management includes the ability to make multiple versions of an app available for testing, to ensure the right version of the app is used for testing, and to inventory and select apps for testing as needed. Apps may be installed on devices or removed from devices remotely. Device Management includes the ability to charge the device, view device details, see the state of the battery and charging system, view device logs, analyze device provisioning, and to remotely reboot. User Management includes the ability to authorize users, disable users, assign user roles, and manage passwords. DevOps includes the ability to script most deviceconnect management functions, allowing the automated installation of new builds onto appropriate devices and running automated tests without manual intervention. For example, Mobile Labs has a certified plug-in for IBM Urban Code Deploy that can be used in continuous integration scenarios to move apps onto mobile devices automatically every time a new build is issued. deviceconnect: Core of the Enterprise Mobile App Infrastructure 10

11 TEST YOUR WAY As a central component of the development and test infrastructure, deviceconnect performs device management, DevOps automation, application management, inventory, and scheduling operations regardless of whether UI testing is done manually or with automation tools. Trust, enables UFT-trained engineers immediately to be productive writing automated tests to run on real mobile devices. Our second offering will be a set of libraries that extend the Selenium WebDriver protocol to both native apps and websites with object intelligence supplied by Mobile Labs components on the device. The deviceconnect strategy for testing takes into account that each enterprise is unique, and that not all enterprises will choose the same automation testing solution. Automation offerings are made available by Mobile Labs as supported add-ons to deviceconnect when popular, existing tools can be enabled to do mobile device testing. Mobile Labs first offering was an add-in for HP s Unified Functional Test (UFT) product. The add-in, Mobile Labs Many organizations choose other automation solutions to use with deviceconnect. There are offerings from our partners (SOASTA, TurnKey, Tricentis), as well as opensource frameworks like Frank, Calabash, and Selenium WebDriver. The philosophy can be summed up as, Test Your Way, allowing enterprises to benefit from the infrastructure savings and improvements of deviceconnect without being locked into a single automation strategy or tool. DEVICECONNECT CLOUD ARCHITECTURE The primary job of deviceconnect is to connect users with real mobile devices. Users connect to the deviceconnect server, select a device, and obtain control of the device through a remote viewer. deviceconnect: Core of the Enterprise Mobile App Infrastructure 11

12 DEVICECONNECT CLOUD SECURITY ARCHITECTURE deviceconnect has been designed to provide superior security when compared to public offerings. As a private device cloud, deviceconnect is installed behind the corporate firewall and does not require access to the wide area network. Moreover, deviceconnect has been designed so that customers can easily isolate their Wi-Fi networks from the internal LAN. All communication with deviceconnect occurs over wired connections LAN from desktop to the deviceconnect server and USB from the server to the devices. This important security measure means that the devices do not have to appear on the same subnet as the internal LAN and can be routed through proxy servers or other security measures as needed. This architecture has the added advantage of leaving the Wi-Fi and cellular connections for dedicated use in app testing without the interference of test management traffic like events and screenshots. All test management data flows into and out of the device over USB. REMOTE DEVICE CONTROL The user has a real-time view of the device screen whether sitting in the same room or across an ocean. The viewer can be used to input gestures like scroll, swipe, and tap. The device immediately executes such gestures. The viewer may also be used with automation software to identify objects and script actions against those objects. deviceconnect Server Local (LAN) Users Mobile Devices Off-Shore Users deviceconnect: Core of the Enterprise Mobile App Infrastructure 12

13 deviceconnect: Core of the Enterprise Mobile App Infrastructure 13 SECURE MOBILE TESTING. SIMPLIFIED.

14 SERVER SOFTWARE ARCHITECTURE deviceconnect consists of three software server programs running on a single system: The dc-web server manages the web user interface that testers, developers, and administrators use to manage device inventory, connect to devices, manage device state, reserve devices, manage authorized users, and manage mobile apps. The dc-hub server provides services to the mobile devices like installing apps, removing apps, launching apps, rebooting the device, and retrieving device logs. The dc-gateway server is the communication bridge between a viewer on the user s desktop and a connected mobile device. Whether using our deviceviewer Windows app or our web viewer in a browser, the gateway process manages the interaction between the user and the device and, if using automation, between the automation component and the device. A high-performance, real-time display of the device screen is shown in the viewer. DEVICEAGENT In addition to the three servers, deviceconnect installs software on the mobile device. The deviceagent program is installed automatically by deviceconnect when an app is launched on the device. The deviceagent program produces a deep object inventory of the app and processes events and screen updates; it also works with our devicecontrol apps to provide remote manual access to the entire UI of a device (not just one instrumented app). The deviceconnect servers exchange data with deviceagent that then manages the device and any app being tested. deviceagent Mobile App DC-WEB DC-HUB DC-GATEWAY deviceconnect: Core of the Enterprise Mobile App Infrastructure 14

15 THREE-TIER SOFTWARE ARCHITECTURE The server is but one component of a three-tier distributed software architecture that includes the viewer/ automation on the user s desktop, the server, and a software instrument that runs on the device. 1. Management, automation components, and viewers on the user s desktop 2. The deviceconnect servers Mobile Labs has developed the software for each of the three tiers: 3. The deviceagent instrument that processes events, returns screen contents, and discovers the complete object structure of a mobile app or a mobile website. TIER 1: USER/ADMINISTRATION deviceviewer, webviewer Automation components Management interface TIER 2: DEVICECONNECT SERVERS Web Server Hub Server Gateway Server TIER 3: DEVICEAGENT devicecontrol Realtime updates Object-based testing PATENT APPLICATIONS Mobile Labs has three major patent claims pending concerning deviceconnect: 1. Mobile Application Testing System 2. Hardware topology as applied to mobile testing system 3. deviceagent functionality Taken together, the patent portfolio describes the appliance concept and its cornerstone hardware and software architecture and functions. deviceconnect: Core of the Enterprise Mobile App Infrastructure 15

16 PUTTING IT ALL TOGETHER deviceconnect, a secure, private mobile device cloud, can help the mobile everything enterprise shorten cycle times, improve app quality, and reduce capital budgets by bringing order to the chaos of mobile app development and testing. With its Test Your Way philosophy, deviceconnect encourages collaboration and improves DevOps efficiencies for continuous integration and makes it easy to test on a wide variety of devices. Automation solutions from Mobile Labs, partners, and open source teams enable the greater numbers of test cases that mobility demands. Whole team collaboration among development, QA, customer support, training, and even sales support is possible with device cloud access and scheduling. As the core of the new mobile development and test infrastructure, deviceconnect provides answers to the new challenges that the mobile everything enterprise faces on the road to high-quality, secure, and efficient mobile app development and testing. About Mobile Labs Mobile Labs provides enterprise-grade mobile device clouds that improve efficiency and raise quality for agile based, cross-platform mobile app and mobile web deployments. The company s patented device cloud, deviceconnect, is available in both public and on-premises configurations. deviceconnect provides affordable, highly-secure access to a large inventory of mobile devices across major mobile platforms to developers, test engineers, and customer support representatives, among others. At the heart of enterprise mobile app deployment, deviceconnect enables automated continuous quality integration, DevOps processes, automated testing, and manual app/web/device testing on managed devices. deviceconnect supports all major integrated app development environments (IDEs), such as Xcode, as well as automated app and web testing on real mobile devices using a wide variety of mobile UI test automation tools. For more information, please visit deviceconnect: Core of the Enterprise Mobile App Infrastructure 16