Mobile Automation Testing

Transcription

1 Mobile Automation Testing with Appium & Oxygen Software Release Process Today 1

2 3 Manual Testing is a Nightmare Test Engineer Selenium & Appium Selenium Advantages Cross Platform Native Testing Flexible & Customizable Appium Open Source 2

3 5 Appium Architecture 6 Why You need a Framework 3

4 Oxygen - Swiss Knife for Test Automation JavaScript Use JavaScript to develop your automation scripts no need to compile code or create complex architecture. Dedicated IDE Includes advanced recording mechanism, simple script editing, intellisense, debugging and playback. Page Objects & Parameters Manage UI elements in one central place and run data-driven tests natively with ease. Integration Testing Oriented Run cross-platform tests and assertions against databases, REST APIs, web services IoT and file systems. No-Setup Parallel Execution Run tests instantly with a simple command line toolset - no setup, compilation or configuration required. Advanced Reporting Get comprehensive results including userfriendly error details, screenshots and Junit XML file. Real End-to-End Testing APIs Async Processes DB Devices Logs 4

5 9 GETTING STARTED 10 Android SDK Download Android SDK or Android Studio: Once installed, open SDK Manager from: C:\android-sdk\SDK Manager.exe Download relevant Android API version (4.4, 5.1, 6 and etc.) 5

6 11 Preparing Device Developer Options 1. Go to the settings menu, and tap on "About phone." 2. Scroll down to the bottom again, where you see "Build number." 3. Tap it seven (7) times. 12 Preparing Device USB Debugging Go to Settings>Developer Options>USB Debugging. Tap the USB Debugging checkbox. 6

7 13 ADB - Android Debug Bridge Android Debug Bridge (adb) is a versatile command line tool that lets you communicate with an emulator instance or connected Android-powered device. It is a client-server program that includes three components: A client, which runs on your development machine. You can invoke a client from a shell by issuing an adb command. Other Android tools such as DDMS also create adb clients. A server, which runs as a background process on your development machine. The server manages communication between the client and the adb daemon running on an emulator or device. A daemon, which runs as a background process on each emulator or device instance. You can find the adb tool in <sdk>/platform-tools/. 14 Appium Desired Capabilities platformname - which mobile OS platform to use platformversion - mobile OS version devicename device id app - path or http URL to an.ipa,.zip or.apk file apppackage - Java package of the Android app you want to run appactivity - activity name for the Android activity you want to launch from your package More capabilities: 7

8 15 Getting apppackage and appactivity Getting all installed packages on the device: > adb shell pm list packages -f > packages.txt Download the selected package: > adb pull /data/app/<package>.apk Dump package information to the local file: > aapt dump badging <package>.apk > dump.txt 16 SCRIPTING 8

9 17 Appium Desktop 18 Locators By ID By Class Name By Accessibility ID By XPath 9

10 19 Popular Oxygen Commands mob.init(<capabilities>) mob.click(<locator>) mob.pause(<milliseconds>) mob.waitforelement(<locator>) mob.sendkeys(<locator>, <text>) mob.assertvalue(<locator>, <value>) 20 DEMO 10

11 CloudBeat Cloud Based Tests your native and hybrid mobile apps with ease. Improve quality and shorten delivery cycle with mobile automated testing. Test Management Manage your tests, versions, builds and runs in one central place. Use our intuitive UI from any device with a single click. Cross Device & Browser Test your apps and websites across 700+ browsers and devices using BrowserStack integration! Continuous Integration Run your tests from everywhere, with everything: manually, command-line, CI, ALM, etc. 11

12 23 DEMO Questions? Nachum Dimer linkedin.com/in/ndimer 12

13 Agile and Testing Mobile 13

14 What are we showing today Waterfall SDLC Agile SDLC Scrum VS Kanban Jira Agile management Testing under Agile methodologies Automation under Agile A bit about me Testing manager in the fintech world Involved in harboring startups Founder QA forum 2004 Tai Chi instructor 14

15 What is wrong with testing today? 15

16 Waterfall Development Problem With Waterfall 16

17 Agile Agile scrum content 17

18 Agile Sprints User stories 18

19 Agile Artifacts Agile scrum board 19

20 Agile Roles Agile ceremonies 20

21 Scrum stages Sprint entire process 21

22 Scrum VS Kanban nue= 1l-zaIr=v& 7Kf8w Jira Sprint management Demo.. 22

23 Testing Agile Testers are integrated in all stages of development Testers are part of the overall quality process They should find the bugs early and verify them fast Testing Agile- Pros and Cons Pros More collaboration Better overall visibility of status, progress, quality Less bureaucracy to get in your way Less bureaucracy to get in your way Testing is EVERYBODY S concern, ALL the time! Reduces resource bottlenecks Cons More meetings (kind of) Less (perceived) accountability Less (unnecessary?) documentation Shorter runway for writing tests May require a new toolbox Everyone feels IS invested in the deliverable 23

24 Testing Agile- CI-CD Testing Agile- Testing under CI-CD Continuous delivery means short time to test till you deliver Tests are sometimes done by users (quick time to respond) 24

25 Testing Agile- Entire process Testing Agile- Automation Automation in agile is critical Automation mixture must be totaly different Automation is done by all development teams (DEV and QA) Automation covers different stages in development, Testing and deployment 25

26 Testing Agile- Automation Mixture Mobile Testing challenges Wide variety of end devices Emulators VS Real devices Usually 2 distinct leading platforms (Android & IOS) Native, Hybrid, Web (Responsive) Store management (especially Apple) 26

27 User Story: Automation in a new financial company Front End Mobile App (Android & IOS) Back End Web Screens (Inside LAN) The Challenge: Creat Automation where the FE is outside the LAN and the BE is in the LAN Reason: Security restrictions prevent connecting mobile devices to inside LAN User Story: Automation in a new financial company Cloudbeat Oxygen ADSL Computer Selenium C# Automation VPN FW Internal Computer (no internet) BE Server DB 27

28 User Story: Automation in a new financial company Huristics: Create a set of FE Automation independent of BE Create a set of BE Automation independent of FE Create a merged automation User Story: Automation in a new financial company Team management: Run Automation Daily! Manage the Automation as any other development effort o Create Development backlog and sprints o Assign tasks o Daily Meetings o Sprint retrospective 28

29 User Story: Automation in a new financial company Management: Define a measurable set of objectives and targets Prioritize Automation tasks Periodic management meetings including progess charts Celebrate success! 29

30 Introduction to Visual Testing Yanir Taflev Head of Customer Success AMEA-APAC Visual testing expert Software engineer 30

31 Agenda What is Visual Testing? Why do we need Visual Testing? What we can do with Visual Testing? Visual testing tools Basic concepts in visual testing Playing with visual testing (Hands on Demo) Trends and future of Visual Testing (Optional) Q&A What is Visual Testing? Visual testing/validation is an activity in UI testing intended to test and validate the visual-aspects of applications and detect visual flaws and bugs across different devices, browsers, sizes, operating systems, orientations, scales, languages/locales and brands. That s including UI, UX and different states that are visibly reflected to the end user. 31

32 we need Visual Testing? A Challenge(Find the bug) ** Visual bugs can be easily missed by the naked eyes 32

33 And because it happens everywhere to everybody Your brand is too important to trust only your eyes 33

34 The demand to be more efficient and accurate in growing world Amount of combinations A Paradox No. of Release cycles 34

35 Visual Testing inherent capabilities Content validation No Data/content/spelling mistakes No Missing/Extra content No Errors in translation Layout validation No Missing/Extra/Unexpected elements No Fully/Partially invisible elements No Overlapping elements No Dislocated/Misaligned elements Scheme validation No Incorrect colors No Incorrect Typography (Fonts, Sizes, Spacing etc..) Experience validation Experience retained across devices, OS, browsers, resolutions and sizes Correct responsive design across devices, OS, browsers, resolutions and sizes Functional aspects validation- Many of the functional flows come up visually ADA/Accessibility validation - Correctness of visual accessibility scenarios Visual Testing supported scenarios: Design -> Prototypes visual testing Compliance > ADA/Accessibility visual testing Scale > Localization, Cross environment and load visual testing Labelling > Cross environment visual testing (Devices, Browsers, OS, ) Development > Components, Integration & regression ressio visual testing CI/CD > Regression visual testing Release > Acceptance visual testing Production > Visual monitoring Maintenance > Visual auditing 35

36 Toolset Visual testing arena: Desktop Automated Manual Mobile 36

37 Basic concepts Baseline: An example(s) or a visual model(s) of the UI that was approved to be used as a point of reference to actual UI snapshots. - In order to retain different baselines for different tests and environments without mixing between them, they usually identified by scenario/test name, Application name (+browser), OS and Viewport size* * See the next slide 37

38 Viewport size: This is the operative area of your application. In web this number will reflect the dimensions of the rendered area: * In mobile, the applications/browsers are usually not resizable so the screen size is good enough to uniquely reflect the viewport. Why do we need it? To avoid undesired behaviour of comparing apples to oranges so different devices/layouts/forms will be compared one agains the other. In resizable browsers, it is possible to resize the browser to achieve the desired viewport size. Full page screenshot: Browsers and automation tools will usually provide screenshot just of the visible area of scrollable pages And elements. Full-page-screenshot allows single unified screenshot of the entire scrollable area, achieved by scrolling and stitching all the segments together. 38

39 Demo 39

40 Testing Android Devices with ADB 40

41 Hey! I m Tomer Cohen, Blog Owner, Automation Engineer and Team Leader About ADB What is adb? When do we use it? 41

42 Getting started with ADB.. Install ADB Install AVD Connect your device to adb Connect to ADB over Wifi Working with ADB Lets look at some examples... 42

43 Summary About ADB ADB setup ADB commands ADB Shell Automation with ADB ADB cheat sheet adb devices - all connected devices adb -s <serial> <command> - send command to specific device adb push <file> <path_on_device> - push file to device adb pull <file> <path_on_computer> - pull file from device adb install <apk_path> adb uninstall <package_name> adb shell - enter device s shell $ input <source> <command> - send input event $ screencap -p <path>.png - save screenshot $ dumpsys (-l) - system info $ dumpsys cpuinfo -h - cpu usage $ dumpsys battery - battery info $ dumpsys meminfo - memory info $ logcat (-d) - all device s logs 43

44 Automation With Python 44

45 45