Test Plan and Cases (TPC)

Transcription

1 Test Plan and Cases (TPC) LiveRiot Video Editing System and social networking enhancement Team 04 Yang Li Haoyu Huang Project anager, Life Cycle Planner Feasibility Engineer, System Architect Ye Tian Zichuan Wang Operational Concept Engineer, Prototyper Operational Concept Engineer, Prototyper Haishan Ye Requirement Engineer, Life Cycle Planner Kaiqi Zhang itra, Alok Feasibility Engineer, System Architect IIV&V

2 Version History Date Author Version Changes made Rationale 23/10/13 Team4 1.0 Original template for 577 use Initial draft for use with LiveRiot 25/11/13 Haishan Ye 2/12/13 Haishan Ye 1.1 Update wrong test cases and remove some test cases that are no longer needed because of requirement changes Update according to feedback from LiveRiot 1.2 Update description of the test cases Prepare for ARB ii

3 Table of Contents TEST PLAN AND CASES (TPC)... I VERSION HISTORY... II TABLE OF CONTENTS... III TABLE OF TABLES... IV 1. Introduction Purpose of TPC Status of the TPC Purpose for Testing Scope Test Strategy and Preparation Hardware preparation Software preparation Other pre-test preparations Requirements Test Identification TC-01 Account anagement TC-02 Share Video TC-03 Featured Videos Resources and schedule Resources Staffing and Training Needs Schedule iii

4 Table of Tables Table 1: Requirements atrix... 3 Table 2 TC Verify Facebook web authenticate... 4 Table 3 TC Verify Facebook account authenticate... 5 Table 4 TC Verify Facebook App authenticate... 5 Table 5 TC Verify Twitter web authenticate... 6 Table 6 TC Verify Tumblr web authenticate... 6 Table 7 TC Verify Facebook logout... 7 Table 8 TC Verify Twitter logout... 7 Table 9 TC Verify Tumblr logout... 7 Table 10 TC Post to Facebook... 9 Table 11 TC Check Compose new Tweet Table 12 TC Check Post to Tumblr Table 13 TC Display Top-10 List Table 14 TC Display video info Table 15 TC Stream Video TPC_TRR_F13a_T04_V1.2.doc iv Version Date: 06/22/12

5 1. Introduction 1.1 Purpose of TPC The TCP document describes the scope, resources, requirements, and identify our plan for detail testing cases of our system. 1.2 Status of the TPC This document is the second version (version 1.1) of our TPC. It is design based on our app features. It has removed some of the test cases because of requirement changes. Besides, it has made several updates to some ambiguous test cases. 1.3 Purpose for Testing Test cases are important in the development of a system. We have to design cases cover all situations of using this app. This is to make sure our system works as we want and to show our clients how this app like. Perform test cases can help in preventing missing of requirements, incorrect or inadequate function. 1.4 Scope This project will be tested for every components and functions, both in valid case and invalid case. Such as what if the input account of Facebook is non-exit when a user wants to share video on their Facebook account. The more adequate test, the more reliable our product will be. 1

6 2. Test Strategy and Preparation As a small agile development team, our choice of test strategy combines several strategies to increase test completeness and efficiency: Value-based test prioritization: Test tasks priority will be ranked by how important they are according to previous Win-Win sessions. Requirements-test traceability: Tests for the system will be designed to meet project requirements drawn from Win-Win conditions. The test plan will be verified by checking how well Win-Win conditions are covered by the plan. 2.1 Hardware preparation Our project requires test video HTL pages accessible by third-party social network platforms, so we will need a web server to host all those pages. Since test HTL pages do not need to be dynamically generated, the greenbay server provided by CSCI577 will satisfy our basic needs. We also need several ios devices to test our project's real performance. The simulator provided by Xcode could not support some of our test requirements. 2.2 Software preparation The main software needed is Xcode. The current version of Xcode is We will use Xcode native unit text framework to write some of the test cases. Plus, we will need Chrome developer tools to retrieve information we need from current LiveRiot development server, as well as test our scratched test HTL pages. We will also need some web-based applications to better test our HTL pages. Facebook Graph Object Debugger ( will be needed to debug Facebook metadata errors in test HTL page. The main software needed is Xcode. The current version of Xcode is We will use Xcode native unit text framework to write some of the test cases. Plus, we will need Chrome developer tools to retrieve information we need from current LiveRiot development server, as well as test our scratched test HTL pages. We will also need some web-based applications to better test our HTL pages. Facebook Graph Object Debugger ( will be needed to debug Facebook metadata errors in test HTL pages. 2

7 2.3 Other pre-test preparations No other pre-test preparations are necessary. 2.4 Requirements Table 1: Requirements atrix Requirement ID Verification Type Test Case ID (if applicable) WC-2799: Fans can share videos on Testing TC-01: Account anagement Facebook WC-2799: Fans can share videos on Facebook Testing TC-02: Share Video WC-2813: Fans can share videos on Tumblr WC-2813: Fans can share videos on Tumblr WC-2504: Fans can retrieve the top 10 videos Testing TC-03: Featured Videos 3

8 3. Test Identification 3.1 TC-01 Account anagement Test case 01 covers the account management for Facebook, Twitter and Tumblr account Test Level This test will be performed at the system software item level Test Class This test will include user functions, workflow and erroneous input tests Test Completion Criteria - User is able to login to Facebook, Twitter or Tumblr with their valid username and password. - User is able to use account stored in system setting to login to Facebook, Twitter or Tumblr. - User is able to use the Facebook ios App or Twitter ios App to login to Facebook or Twitter. - User is able to logout his/her Facebook account, Twitter account or Tumblr account Test Cases Table 2 TC Verify Facebook web authenticate TC Verify Facebook web authenticate Test the Facebook web authenticate workflow. 1. User did not authenticate the Facebook in the LiveRiot before. 2. User did not authenticate the Facebook account in the system settings before. 3. User does not have Facebook App. 4. User clicks the share button or authenticate button. After successful authenticate, user is forwarded to previous interface. App operational state. Correct user name, correct user password Store the user token. Display the previous interface. 1. Verify the app allows the user to authenticate Facebook account using valid usernames and passwords. 4

9 1. User has connection to the internet and has a Facebook account. 2. Facebook and its API work as normal, i.e. Facebook is not down. TC WC_2799, WC_2511 Table 3 TC Verify Facebook account authenticate TC Verify Facebook account authenticate Test the Facebook account authenticate workflow. 1. User did not authenticate the Facebook in the LiveRiot before. 2. User has already logged in the Facebook account in the system settings before. 3. User clicks the share button or authenticate button. After successful authenticate, user is forwarded to previous interface. App operational state. User confirms that LiveRiot is allowed to use the Facebook account that was stored in the system settings. Store the user token. Display the previous page. 1. Verify the app allows the user to use the Facebook account stored in the ios system settings to authenticate Facebook. 1. If any Pass Criteria are not met 1. User has connection to the internet and has a Facebook account. 2. Facebook and its API work as normal, i.e. Facebook is not down. None WC_2799, WC_2511 Table 4 TC Verify Facebook App authenticate TC Verify Facebook App authenticate Test the Facebook App authenticate workflow. 1. User did not authenticate the Facebook in the LiveRiot before. 2. User did not authenticate the Facebook account in the system settings before. 3. User has already installed Facebook App on his/her iphone. 4. User clicks the share button or authenticate button. After successful authenticate, user is forwarded to previous interface. App operational state. User confirms that LiveRiot is allowed to use the Facebook App to authorize the authenticate request. Store the user token. Display the previous page. 1. Verify the app allows the user to use the Facebook account stored in the ios system settings to authenticate Facebook. 1. If any Pass Criteria are not met 5

10 1. User has connection to the internet and has a Facebook account. 2. Facebook and its API work as normal, i.e. Facebook is not down. 3. User has installed Facebook App TC WC_2799, WC_2511 Table 5 TC Verify Twitter web authenticate TC Verify Twitter web authenticate Test the Twitter web authenticate workflow. 1. User did not authenticate the Twitter in the LiveRiot before. 2. User did not authenticate the Twitter account in the system settings before. 3. User does not have Twitter App. 4. User clicks the share button or authenticate button. After successful authenticate, user is forwarded to previous interface. App operational state. Correct user name, correct user password Store the user token. Display the previous interface. 1. Verify the app allows the user to authenticate Twitter account using valid usernames and passwords. 1. User has connection to the internet and has a Twitter account. 2. Twitter and its API work as normal, i.e. Twitter is not down. None WC_2799, WC_2511 Table 6 TC Verify Tumblr web authenticate TC Verify Tumblr web authenticate Test the Tumblr web authenticate workflow. 1. User did not authenticate the Tumblr in the LiveRiot before. 2. User did not authenticate the Tumblr account in the system settings before. 3. User does not have Tumblr App. 4. User clicks the share button or authenticate button. After successful authenticate, user is forwarded to previous interface. App operational state. Correct user name, correct user password Store the user token. Display the previous interface. 1. Verify the app allows the user to authenticate Tumblr account using valid usernames and passwords. 1. User has connection to the internet and has a Tumblr account. 2. Tumblr and its API work as normal, i.e. Tumblr is not down. None 6

11 WC_2799, WC_2511 Table 7 TC Verify Facebook logout TC Verify Facebook logout Test the Facebook logout workflow. User has already logged in to Facebook. User clicks the logout button. After successful logout, user is forwarded to previous interface. App clears the Facebook user data. User clicks the logout button. Clears the user s Facebook data. 1. User needs to authenticate again before sharing a video. 2. User data has been cleared. 1. User has connection to the internet and has a Facebook account. 2. Facebook and its API work as normal, i.e. Facebook is not down. TC-01-01, TC-01-02, TC WC_2799, WC_2511 Table 8 TC Verify Twitter logout TC Verify Twitter logout Test the Twitter logout workflow. User has already logged in to Twitter. User clicks the logout button. After successful logout, user is forwarded to previous interface. App clears the Twitter user data. User clicks the logout button. Clears the user s Twitter data. 1. User needs to authenticate again before sharing a video. 2. User data has been cleared. 1. User has connection to the internet and has a Twitter account. 2. Twitter and its API work as normal, i.e. Twitter is not down. TC WC_2799, WC_2511 Table 9 TC Verify Tumblr logout TC Verify Tumblr logout Test the Tumblr logout workflow. User has already logged in to Tumblr. User clicks the logout button. 7

12 After successful logout, user is forwarded to previous interface. App clears the Tumblr user data. User clicks the logout button. Clears the user s Tumblr data. 1. User needs to authenticate again before sharing a video. 2. User data has been cleared. 1. User has connection to the internet and has a Tumblr account. 2. Tumblr and its API work as normal, i.e. Tumblr is not down. TC WC_2799, WC_2511 8

13 3.2 TC-02 Share Video Testers need to act as fans/musicians using this app to share contents to Facebook, Twitter or Tumblr, which means posting to Facebook s timeline, Twitter s homepage or Tumblr s dashboard Test Level Software item level Test Class Erroneous test Test Completion Criteria The test for share videos on social website will be complete when testers, as fans/musicians: - Are capable of posting to their own Facebook timelines publicly - Are capable of composing new tweets to Twitter - Are capable of posting to their own Tumblr dashboard Test Cases Table 10 TC Post to Facebook TC Post to Facebook The item tested is this app s sharing module, which allows the tester to post to Facebook timeline. (ust have) 1. The tester has access to the internet. 2. He/she is in the view of video information and has seen this video s information. 3. He/she may or may not have played the video. 4. The tester has connected his/her Facebook account through this app. 1. The app will return to the view of video information. 2. When the tester logs into Facebook, there should be a new post of the shared video with the description he\she has added. 1. Choose Facebook share with one touch. 2. Write something that describes this share post. A new post appears on the connected Facebook account s timeline. 9

14 1. The tester can see his/her post about that video on Facebook feed page or his/her own timeline. 2. The tester s Facebook friends are able to view this post. 3. The tester finds that post comes with the previously written description. 4. His/her friends should see exactly the same description. 1. User has connection to the internet and has a Facebook account. 2. Facebook and its API work as normal, i.e. Facebook is not down. TC-01-01, TC-01-02, TC WC-2799 Table 11 TC Check Compose new Tweet TC Check Compose new Tweet The item tested is this app s sharing module, which allows the tester to compose new tweet about a particular video. (ust have) 1. The tester has access to the internet. 2. He/she is in the view of video information and has seen this video s information. 3. He/she may or may not have played the video. 4. The tester has connected his/her Twitter account through this app. 1. The app will return to the view of video information. 2. When the tester logs into Twitter, there should be a new tweet of the shared video with the description he\she has added. 1. Choose Twitter share with one touch. 2. Write something that describes this tweet. A new tweet appears on the connected Twitter account s homepage. Pass criteria: 1. The tester can see his/her tweet about that video on Twitter feed page or among his/her own tweets. 2. The tester s Twitter followers are able to view this tweet. 3. The tester finds that post comes with the previously written description. 4. His/her friends should see exactly the same description. 1. User has connection to the internet and has a Twitter account. 2. Twitter and its API work as normal, i.e. Twitter is not down. TC WC-2812 Table 12 TC Check Post to Tumblr TC Check Post to Tumblr The item tested is this app s sharing module, which allows the tester to compose new tweet about a particular video. (ust have) 1. The tester has access to the Internet. 10

15 2. He/she is in the view of video information and has seen this video s information. 3. He/she may or may not have played the video. 4. The tester has connected his/her Tumblr account through this app. 1. The app will return to the view of video information. 2. When the tester logs into Tumblr, there should be a new post of the shared video with the description he\she has added. 1. Choose Tumblr share with one touch. 2. Write something that describes this share post. A new post appears on the connected Tumblr account s blog dashboard. Pass criteria: 1. The tester can see his/her post about that video on Tumblr dashboard page or among his/her own posts. 2. The tester s Tumblr followers are able to view this tweet. 3. The tester finds that post comes with the previously written description. 4. His/her friends should see exactly the same description. 1. User has connection to the internet and has a Tumblr account. 2. Tumblr and its API work as normal, i.e. Tumblr is not down. TC WC

16 3.3 TC-03 Featured Videos Test case 03 covers the featured videos retrieval and play functions Test Level This test will be performed at the system software item level Test Class This test will include user functions, workflow and erroneous input tests Test Completion Criteria - User is able to view featured videos, including Top-10 videos in different classification. - User is able to view the detailed info of the videos. - User is able to watch the videos Test Cases Table 13 TC Display Top-10 List TC Display Top-10 List Test the Top-10 List function. User navigated to featured videos section. Display the featured video list. App operational state. Use will tap the featured video button. Display the featured video list with correct content. 1. Verify the app allows the user to see the featured video list with real accurate content. 1. User has connection to the internet. 2. LiveRiot server is working properly. None WC_2504 Table 14 TC Display video info TC Display video info Test the video info retrieval function. 12

17 User has navigated to featured videos section. Detailed info of the selected video is retrieved. App operational state. Use will select a video. Display the detailed info of a selected video. 1. Verify the app allows the user to check the detailed info of a selected video. 2. If any Pass Criteria are not met. 1. User has connection to the internet. 2. LiveRiot server is working properly. TC WC_2504 Table 15 TC Stream Video TC Stream Video Test the video streaming function. S User has already navigated to video list page or video info page. Detailed info of the selected video is retrieved. App operational state. Use will play a video. Content of the video will be streamed. 1. Verify the app allows the user watch the videos. 1. User has connection to the internet. 2. LiveRiot server is working properly. TC WC_

18 4. Resources and schedule 4.1 Resources Test data: - Videos available on server - User profile on LiveRiot - User s Facebook account credentials - User s Twitter account credentials - User s Tumblr account credentials - Top10 video rankings Software: - Safari Xcode 5 Hardware: - acbook - Amazon EC2 4.2 Staffing and Training Needs LiveRiot clients are responsible for providing videos and access to the server. Providing valid user accounts is every tester s responsibility because it is really simple. Top 10 video ranking is not necessarily accurate since the system is not online yet, so that it is supposed to be made up by testers. Because Zichuan Wang and Haishan Ye have experience in ios testing while others do not have, so there is training needs in teaching ios test skills to every other team member who participate in testing process. 4.3 Schedule Table 16 Testing Schedule Date Test Identifier Responsible person Resources Training needs 11/25/2013 TC-01, TC-03 Ye Tian User account information None and videos 11/25/2013 TC-02 Haishan Ye User account information, featured video list None 14