UI cases Documentation

Transcription

1 UI cases Documentation Release 0.0.1a Sergei Chipiga Nov 03, 2016

2

3 Contents 1 Task to resolve 1 2 Solution Autotests for top 250 IMDB movies Python Module Index 9 i

4 ii

5 CHAPTER 1 Task to resolve For the page please do the following: 1. List all the test cases you consider necessary ordered by priority starting from the must have ones (at least 10) 2. What tests you would add to the compulsory pre-release test suite? 3. Describe test cases #4 and #8 in details taking into consideration that these tests will be performed by junior testers. 4. Cover at least 2 cases (#4, #8, maybe some others) with automated tests. Make sure that instructions provided with your code allow it to be run in Linux environment. 1

6 UI cases Documentation, Release 0.0.1a 2 Chapter 1. Task to resolve

7 CHAPTER 2 Solution First of all let s define the type of testing. We see a web page, and seems it would be nice to verify its functionality. Nice toolkit for that is selenium. And should keep in mind, that selenium is exactly for functional testing only, not for load testing, not for markup testing. Btw some recommendations about other testing types: load testing - yandex.tank markup testing - yandex.gemini integration and unit testing - commonly depends on backend language and framework. Then let s create test plan according to test design patterns and page functionality. And separate testcases according to severity (not priority! priority of bugs fixing is set by project manager(s)). We consider only severities: critical, major and minor, despite of in reality also they can be expanded with blocker, medium, cosmetic, etc, according to a project rules. Test suite preconditions: 1. User is not authenticated at IMDB site. Critical: 1. Page should looks fine and all active UI elements should be clickable in popular browsers. (List of top browsers: Special attention should be paid to IE. It is not functional testcase but is very critical). 2. Clicking to movie title link leads to movie details page. 3. Clicking to movie star your rating leads to login page. 4. Clicking to movie button add to watchlist leads to login page. 5. Share button is clickable. 6. In dropdown menu social buttons lead to social pages. Major: 1. Clicking to movie icon leads to movie details page. 2. Sort type Ranking is correct. 3. Sort type IMDb Rating is correct. 4. Sort type Release Date is correct. 5. Sort type Number of Ratings is correct. 6. Sort type Your Rating is correct. 7. In dropdown menu item has correct link. 3

8 UI cases Documentation, Release 0.0.1a 8. Top list includes exactly 250 items. Minor: 1. Reverse sort order link works correct. 2. Top list numeration has correct order by default. 3. Copy site address to clipboard in dropdown menu. Let s describe some testcases, as they should be presented at test plan management tool (would like to recommend Scenario: Clicking to movie title link leads to movie details page 1. Page is opened in browser. 1. Click title movie of first item in movies list Page with detailed info about exactly that movie is opened. Scenario: Share button is clickable 1. Page is opened in browser. 1. Click button Share. Dropdown menu with social buttons to share is present (QA engineer should be familiar with project and understand what it s meant under social buttons to share and other concepts. It should not be described in every step in details.) Scenario: In dropdown menu social buttons lead to social pages 1. Page is opened in browser. 1. Click button Share. Dropdown menu with social buttons to share is present. 2. Click button Facebook Dropdown menu is closed. Facebook page to share IMDB page is opened in new window. 3. Click button Share. Dropdown menu with social buttons to share is present. 4. Click button Twitter Dropdown menu is closed. Twitter page to tweet IMDB page is opened in new window. 4 Chapter 2. Solution

9 UI cases Documentation, Release 0.0.1a Scenario: Copy site address to clipboard in dropdown menu 1. Page is opened in browser. 1. Click button Share. Dropdown menu with social buttons to share is present. 2. Click item Copy Dropdown menu is closed. 3. Open text editor and push Ctrl+V link is pasted. Talking about cases in pre-release test suite. Actually all cases should be executed during acceptance testing. But if time is limited, minor severity test cases can be neglected, and further test suite restriction depends on release specific. 2.1 Autotests for top 250 IMDB movies Please, note that autotests may have different steps and cases than manual tests, according to the convenience of automation. (And usually it happens.) These autotests are implemented with POM framework ( sergeychipiga/pom) and STEPS-methodology. If you are interesting how POM works in enterprise testing, please visit v9.1. If you are curious about STEPS-methodology in enterprise testing, please visit https: //github.com/mirantis/stepler. How to install: Verified on Ubuntu v14.04 and higher. Make following commands in terminal: echo "deb [arch=amd64] stable main" sudo tee /etc/apt/sources.list.d/google-chrome.list sudo apt-get update sudo apt-get install -y google-chrome-stable libav-tools xvfb xsel xclip python-pip git gconf2 sudo pip install virtualenv git clone cd cases_design virtualenv.venv..venv/bin/activate pip install -U pip pip install -r requirements.txt pip install -e Autotests for top 250 IMDB movies 5

10 UI cases Documentation, Release 0.0.1a How to launch: 1. py.test cases -v --junitxml=test_report.xml - single thread 2. py.test cases -v --junitxml=test_report.xml -n 2 - two threads 3. py.test cases -v --junitxml=test_report.xml -n auto - autocalc threads Results are available in folder test_reports including video capture of virtual display. By default tests are launched in xvfb with video capture. If you want to disable them, please use py.test keys --disable-virtual-display and --disable-video-capture. How to debug: If you use ipdb you should disable stdout capture: 1. py.test cases -v --disable-video-capture --disable-virtual-display -s class cases.tests.test_cases.testtop250imdb Functional e2e tests for top 250 IMDB movies page. Preconditions: 1.User is not authenticated. test_add_movie_to_watch_list(top_movies_steps) Scenario: If user adds movie to watch list, it leads to login page. 1.Add movie in movies list to watch list. 2.Check page login page is opened. test_change_movies_sort_type(top_movies_steps, sort_type) Scenario: Changing of sort type leads to reordering of movies list. 1.Change sort type of movies list. 2.Check that movies list order was changed. 3.Click Reverse sort button. 4.Check that movies list is reversed. test_like_movie(top_movies_steps) Scenario: If user likes movie, it leads to login page. 6 Chapter 2. Solution

11 UI cases Documentation, Release 0.0.1a 1.Like movie in movies list. 2.Check page login page is opened. test_movies_list_amount(top_movies_steps, movies_amount) Scenario: Movies list contains exaclty 250 items. 1.Check that movies list contains exaclty 250 items. test_open_movie_details_by_icon(top_movies_steps) Scenario: Detailed info movie page is opened when user clicks icon of movie. 1.Click movie icon. 2.Check that page with detailed info about movie is opened. test_open_movie_details_by_title(top_movies_steps) Scenario: Detailed info movie page is opened when user clicks title of movie. 1.Click movie title. 2.Check that page with detailed info about movie is opened. test_reverse_movies_sort_order(top_movies_steps) Scenario: Clicking on Reverse sort button leads to reverse of movies list Autotests for top 250 IMDB movies 7

12 UI cases Documentation, Release 0.0.1a 1.Click Reverse sort button. 2.Check that movies list is reversed. 3.Click Reverse sort button. 4.Check that movies list is reversed. test_share_with_social(top_movies_steps) Scenario: User can share top IMDB movies with social networks. 1.Click Share button. 2.Check that all social links are clickable. 8 Chapter 2. Solution

13 Python Module Index c cases.tests.test_cases, 5 9

14 UI cases Documentation, Release 0.0.1a 10 Python Module Index

15 Index C cases.tests.test_cases (module), 5 T test_add_movie_to_watch_list() (cases.tests.test_cases.testtop250imdb method), 6 test_change_movies_sort_type() (cases.tests.test_cases.testtop250imdb method), 6 test_like_movie() (cases.tests.test_cases.testtop250imdb method), 6 test_movies_list_amount() (cases.tests.test_cases.testtop250imdb method), 7 test_open_movie_details_by_icon() (cases.tests.test_cases.testtop250imdb method), 7 test_open_movie_details_by_title() (cases.tests.test_cases.testtop250imdb method), 7 test_reverse_movies_sort_order() (cases.tests.test_cases.testtop250imdb method), 7 test_share_with_social() (cases.tests.test_cases.testtop250imdb method), 8 TestTop250Imdb (class in cases.tests.test_cases), 6 11