Development of Custom Python Test Framework

Size: px

Start display at page:

Download "Development of Custom Python Test Framework"

Lorraine McLaughlin
6 years ago
Views:

1 An Success Story Development of Custom Python Test Framework AN MSYS TECHNOLOGIES BROCHURE

2 Executive Summary The client is a leading manufacturer of highperformance computing systems. They have around eight hardware and software product lines in storage domain alone. The client s specific requirement was development of a modular code base that can easily be extended by a broad team. The framework should be an improvement over the existing testing frameworks based on such technologies as PyUnit. PyUnit is not mature enough to do end-to-end testing. In order to achieve end-to-end testing, the customer needs to set up new hardware, virtual clusters, and databases, and file systems. This setup creation and configuration can be prohibitively costly and painstaking. The customer also wanted to use Python or Bash as required as the test case automation language. In addition, the customer wants to make the test cases data-driven rather than script-driven. For instance: create a file system with 4, 8, or 16 NSD servers and do load testing on it. The test cases reports needed to be ported to Rally and Jenkins. Charting and easy deep-diving should be possible for identifying issues and test failures. MSys Solution In this project, MSys provided a key solution that completely takes care of the requirements set forth by the customer. MSys proposed the use of YAMLbased test case definitions wherein the test engineer only needs to provide the test data, presetup modules to run, actual test modules, and post-test modules. Here s an example: TC: TC1161 # Rally test case ID for reporting pre_module: autoconfigure tags: realhw,couplet test_modules: network_shutdown:node=oss0:nics=ib0, sleep:time=10m,check_fs_mounted A test processing engine will execute the test modules in Bash or Python scripts. These scripts can use PyUnit or Selenium as required. The solution involves a meta layer for managing test cases and encapsulate all test cases within a single framework. The test cases will be tagged according to where they can be run. realhw as shown above means the test is run on real hardware. Test modules are developed data-driven exactly as required by the client, so that the code duplication issue is minimized. This helps QA professionals greatly as they only need to write new YAML data when needed. JUnit test case reporting used in the project to allow Jenkins to plot graphs and charts for test case results. Tools & Technologies In the execution of this project, MSys made use of several major tools and technologies, including: YAML (YAML Ain t Markup Language) is a special markup scheme which bridges the gap between machine language and human readability. It comes with the capability of porting across programming languages, making it simple and universal. MSys developed the solution to be capable of using both PyUnit and Bash for test scripts. JUnit is used for test

3 reporting. Jenkins, a popular continuous integration tool, is used for plotting and charting the test case reports. The Results In this project, the main aim of MSys was to reduce the additional infrastructure that the client may require to extend the capability of PyUnit and Selenium to use universal test case creation and execution. MSys has thus provided high costeffectiveness to the customer. Some of the results are: Quick execution and high cost-effectiveness Provided a framework to the customer so that the QA engineers only need to provide new test case data in simple language. New test cases can be executed across any testing framework.

4 About MSys is a global technology services company with a focus on Storage, IoT, Cloud Computing, and Analytics. MSys' elite client base includes: NetApp, Tintri, DDN, Nimble Storage, Lantronix, Eurotech, and Panasas. The bottom line of every one of our project has always been to increase productivity and scalability of the client, while drastically cutting down on production costs. MSys is constantly seeking out to expand its horizons by embracing modern technologies, and hiring the best in class engineers. What started out in 2007 in Chennai as a small team of extremely motivated individuals, has today expanded to a 500+ member organization with offices in Alpharetta (Georgia, USA), Chennai, Pune and Bangalore, India.

5 Our Clients STORAGE CLOUD IT PRODUCTS & SERVICES ECOMMERCE & LOYALTY MANAGEMENT DEVOPS EMBEDDED COMMUNICATION RETAIL ELEARNING

Thank you Please do contact us for any queries We will be happy to help Contact Us Email Us info@msystechnologies.

6 Thank you Please do contact us for any queries We will be happy to help Contact Us Us USA Atlanta, LLC 1159 Park Woods Circle Suite 702, Alpharetta, Georgia US INDIA Chennai MSys Tech India Pvt. Ltd. ASV Chandilya Towers (8 th Floor), #5/397, Rajiv Gandhi Salai (OMR), Okkiyam Thoraipakkam, Chennai Tamil Nadu, IN Bangalore MSys Tech India Pvt. Ltd. No: 56/3, Ground Floor, Vakil Square, Bannerghatta Road Bangalore, Karnataka, IN Pune MSys Tech India Pvt. Ltd. Midas Tower, 2nd floor, Rajiv Gandhi Infotech Park Phase1, Hinjawadi Pune, Maharashtra, IN Social

Bringing HyperScale Computing to the Enterprise. The need for Enterprises to overhaul their IT systems

Bringing HyperScale Computing to the Enterprise The need for Enterprises to overhaul their IT systems MSys: Corporate Overview Established In: 2007 Self-funded, profitable Over 350 employees Global Presence