Test Results. Generation Java. ID-10t Consultations. Assistant Professor Department of Computer Science Siena College

Transcription

1 Test Results Requested by: Dr. Darren Lim Assistant Professor Department of Computer Science Siena College Mrs. Pauline White Visiting Professor Department of Computer Science Siena College Generation Java ID-10t Consultations Prepared by: Christine Fox Nick Miller Kevin Mulcahy Jordan Steans April 28, 2008

2 Generation Java Test Results Table of Contents Section 1: Introduction 1.1: Introduction & Testing Explanation Section 2: System Test 2.1: Test Items & Functional Requirements Inventory : Non-Functional Requirements Inventory Testing : Exception Handling : Approach to Testing : Pass/Fail Criteria Section 3: Unit Test 3.1: Login Page : Forgot Password : Student Home Screen : System Home Screen : Program Home Screen : Instructor Home Screen : Student Account Creation : Student Account Creation Pop-up : Created Account System : Create User Account System : Create Question Instructor/Program & System : Student Question/ Question Set Answer Page : Student Grade book : Grade book : Instructor Grade book : System Admin Course Management Link to Create Course : System Create Course of 81

3 3.18: Instructor Published Content Pool : Instructor My Pool : Instructor Course Pool : Instructor Global Pool : Question Set Creation : Question Set (Adding Question) : Submitted Created Question : Question Set Publication : Editing Live Question : Editing Live Question Set : Account Management Student : Account Management Instructor : Account Management Program : Account Management System : Course Home Page Student : Course Home Page Instructor/ Program & System Admin : Pool Management Program : Pool Management System : Student Question Compile and Run : Pop-up Save Student Question : Created Course System : Approval of Global Pool Requests System : Approval of Course Pool Requests Program Create User Accounts Program administrator Create Section Section 4: Integration/Regression Tests 4.1: Explanation & Integrated Units of 81

4 Section 1: Introduction 1.1: Introduction & Testing Explanation This document is the first of many possible versions that will be used to describe the testing requirements for the Generation Java. These are the requirements that need to be tested in order for the Generation Java to be considered fully functional. As the project development continues towards a completed project, the requirements will be fulfilled, and some items may be removed, or revised. This document will keep track of these changes, as well as those requirements that have been completed. Many updates will be made to this document in order to better prepare for the Acceptance Test document due in April An acceptance test is black-box testing performed on a system prior to its delivery. Generally involves running a suite of tests on the completed system. Each individual test, known as a case, exercises a particular operating condition of the user's environment or feature of the system, and will result in a pass or fail boolean outcome. The acceptance test suite is run against the supplied input data or using an acceptance test script to direct the testers. The test plan will begin with system testing. System testing consists of software or hardware testing conducted on a complete, integrated system to evaluate the system's compliance with its specific requirements. System testing falls within the scope of black-box testing, and as such, should require no knowledge of the inner design of the code or logic. In system testing, our team is concerned with validating the specified functional requirements on the Generation Java system. The functional requirements of the Generation Java system will be tested in the system test along with non-functional requirements, exception handling, our approach to testing, and will end with the system s pass/fail criteria. This test is a crucial part of the test plan because it will help us determine if we met all of the requirements promised at the beginning of our work. Unit testing is where our team tests each unit individually to make sure that specific unit is free of data, logic, or standard errors. The units have been divided by screen in the system. Every screen in the web system has its own unit and within each unit are a number of test cases. These test cases test specific actions within each unit. The following units and test cases are represented in an Excel table format and as we progress and begin to produce our software, these units may become more in depth and more dense. The final portion of this document contains the integration and regression testing. Regression testing is any type of software testing which seeks to uncover software regressions. Such regressions occur when software functionality that was previously working correctly, stops working as intended. Typically regressions occur as an unintended consequence of program changes. Common methods of regression testing include re-running previously run tests and checking whether previously fixed faults have re-emerged. This is a crucial stage in the testing process because this is where the separate units tested before combine to become a whole. We are concerned with the functionality of the units together and how they interact with each other in this stage of testing. Finally our testing is complete with regression testing which is only incorporated if software functionality that was working normal, stops working completely or no longer works correctly. Regression testing is used to discover regression bugs which may be causing these errors. As the project continues to grow, so too will this test document. 4 of 81

5 Section 2: System Test 2.1: Test Items & Functional Requirements Inventory Functional Requirements Requirements grouped according to Use Case. System : There is only one System. Once logged in, a System has three views available: Student Instructor The System can perform different tasks based on which view is currently be used: Student View Registration 5 of 81

6 The System views the system as a Student that is registered in all possible courses. The System is not seen as registered for any course by any user. The System does not need to log out to switch between courses. Questions/Question Sets The System is able to attempt any of the question sets, including all homework, quiz, test, and practice sets. The System is able to save code to a database. Once code is compiled and executed, the System will receive feedback on it. The feedback received by the System is identical to that of a Student; however, it is not viewable by any Instructor. The System should be aware when the maximum number of attempts (if specified) has been reached on a question, but should not be restricted by it as a Student would be. The System has the ability to click any links (if provided and enabled) on any question. The System can view all files posted by all Instructors. Instructor View Registration The System views the system as an Instructor that is instructing all possible courses. 6 of 81

7 The System is not seen as an Instructor of any course by any user. The System does not need to log out to switch between courses. Questions/Question Sets The System can create, edit, delete, and distribute all questions and question sets. The System can set a time and date for any question set to become available. The System can set a time and date for any questions set to be due. The System can assign point totals to any question set. Instructor Privileges The System can see all Students last submissions and submission information for every (attempted) question in every question set. View The System can create, edit, and delete the following types of accounts: Program Instructor Student 7 of 81

8 The System can set a timeout length for all sessions. The System can add questions/question sets to the global pool. The System may logout in any view. Program : A Program coordinates one more sections/courses. There may be multiple Program s. Program s do not register. A Program s account is created by the System. Once logged in, a Program has three views available: Student 8 of 81

9 Instructor Program A Program can perform different tasks based on which view is currently be used: Student View Registration A Program views the system as a Student that is registered in all courses specified by the System. A Program is not seen as registered for any course by any user except by the System. A Program does not need to log out to switch between courses. Questions/Question Sets A Program is able to attempt any of the question sets specified by the System, including homework, quiz, test, and practice sets. A Program is able to save code to a database. Once code is compiled and executed, A Program will receive feedback on it. The feedback received by a Program is identical to that of a Student; however, it cannot be viewed by any Instructor. A Program s grades are not counted in any reports, including reports run by an. 9 of 81

10 A Program should be aware when the maximum number of attempts (if specified) has been reached on a question, but should not be restricted by it as a Student would be. A Program has the ability to click any links (if provided and enabled) on any question specified by the System. A Program can view all files posted by Instructors specified by the System. Instructor View Registration A Program views the system as an Instructor that is instructing all courses specified by the System. A Program is not seen as an Instructor of any course by any user. A Program does not need to log out to switch between courses. Questions/Question Sets A Program can create, edit, delete, and distribute course-specific questions and question sets. A Program can set a time and date for any question set specified by the System to become available. A Program can set a time and date for any questions set specified by the System to be due. A Program can assign point totals to any question set specified by the System. 10 of 81

11 Instructor Privileges A Program can see all Students (specified by the System ) last submissions and submission information for every (attempted) question in every question set. A Program can see all Students (specified by the System ) statistics (including login information) and all statistics for every question in every question set (also specified by the System ). View A Program can create, edit, and delete the following types of accounts: o Instructor o Student The Program can add question/question sets to any of the course-specific pools specified by the System. The Program may logout in any view. Instructor: An Instructor does not register. An Instructor s account is created by a Program or the System. 11 of 81

12 Once logged in, an Instructor has two views available: Student Instructor An Instructor can perform different tasks based on which view is currently be used: Student View Registration An Instructor views the system as a Student that is registered in all courses specified by the Program. An Instructor is not seen as registered for any course by any user. An Instructor does not need to log out to switch between courses. Questions/Question Sets An Instructor is able to attempt any of the question sets specified by the Program, including homework, quiz, test, and practice sets. An Instructor is able to save code to a database. Once code is compiled and executed, an Instructor will receive feedback on it. The feedback received by an Instructor is identical to that of a Student. No one else can view this feedback. 12 of 81

13 An Instructor s grades are not counted in any reports, even reports run by an. An Instructor should be aware when the maximum number of attempts (if specified) has been reached on a question, but should not be restricted by it as a Student would be. An Instructor has the ability to click any links (if provided and enabled) on any question specified by the Program. An Instructor can view all files posted by themselves or other Instructors specified by the Program. Instructor View Registration An Instructor can view all courses specified by a Program. An Instructor is seen as the Instructor for all courses specified by the Program. An Instructor does not need to log out to switch between courses. If an Instructor wishes to teach a new course, the new course may be added by inputting the Course ID into the appropriate location. A Course ID is provided by the Program or System. Questions/Question Sets An Instructor has the ability to create, edit, and delete java questions in the Instructor s own private pool. An Instructor can upload a question or enter it into a text box. An Instructor may provide links to aid a Student. 13 of 81

14 An Instructor has the ability to create, edit and delete question sets in the Instructor s own private pool. An Instructor can use questions from the Instructor s private pool, the course-specific pool, or the global pool when creating question sets. When creating a question set, an Instructor can set point totals and a maximum number of attempts allowed for each question. An Instructor can set a time and date for a question set to become available and unavailable. If an Instructor wishes to add a question or question set to the course-specific pool, it must be submitted to the Program. If an Instructor wishes to add a question or question set to global pool, it must be submitted to the System. Instructor Privileges An Instructor can see all Students (registered in the Instructor s course) last submissions and submission information for every (attempted) question in every question set. An Instructor may edit a Student s grade as seen fit. An Instructor may deny a student access to a course. An Instructor may post files that can be viewed by Students in the Instructor s course. An Instructor can log out in either view. Student: A Student has only one view. 14 of 81

15 Registration A Student must register in a specific course by entering a Course ID in the appropriate location. (A Course ID is provided by the Instructor of that course) A Student may be registered in multiple courses under the same username and. A Student does not need to log out in order to change which course is currently being worked in. Question Sets A Student has the ability to view and attempt any question set provided by the Instructor. When a Student submits code, feedback is returned indicating the code s degree of correctness. A Student can retry a question until the number of attempts (if specified) has run out. A Student may see only their own grades and statistics. Additional Privileges/Restrictions A Student may view any link or file provided by the Instructor (if enabled). A Student may not click out of the testing window during a test or the test will be terminated. A Student may log out as desired. 2.2: Non-Functional Requirements Inventory Testing 15 of 81

16 The system should be quick and smooth, using fast servers and databases The system should also be aesthetically pleasing. 2.3: Exception Handling Exception Handling is a method used by the system to detect and recover from exceptional conditions. An exceptional condition is any unexpected occurrence that cannot be accounted for in a system s normal operation. The developers of Generation Java realize that it can be difficult to protect a system from the effects of exceptional conditions because, by nature, they are unusual occurrences that can generally not be anticipated. Therefore, the developers of Generation Java will implement programmed and default exception handlers that will attempt to recover the system from any unanticipated conditions. Programmed exception handling modules are mechanics built into software for specific exceptional cases that are known and are likely to occur. Since these occurrences are relatively well understood, protection for them will be incorporated into Generation Java. For example, if the User does not provide all of the required information for registration, then the system will prompt them to resubmit their information again with the proper data. For all exceptional conditions that are not anticipated by the system developers, a default exception handler will be built in. The default exception handlers must catch-all unexpected exceptions and return the system to a normal state of operation. 2.4: Approach to Testing Software testing is an activity aimed at verifying that are correct solution to the problem has been developed such that it satisfies the functional and non-functional requirements. In general, most of these outlined in the document will be unit and integration testing. System-level testing will also be carried out and documented on the components once they have been fully developed. It is also important to note that in general, our testing will be structured to evaluate correctness of the code. It is anticipated since the future phases of code development will be focused on performance enhancement, performance of the code (a non-functional requirement) will then be monitored closely. Consequently, routine performance testing should be unnecessary, while testing for correctness will be important as changes are made to speed up the code. 2.5: Pass/Fail Criteria 16 of 81

17 In order to ensure that the system as a whole passes testing, we must start with each individual piece. The following is a checklist of the major requirements, some of which are based on screens, to ensure that each item has either passed of failed. In order for an item to pass, it will have to undergo its specific unit test as provided. If the unit test causes a failure in the system, we will then need to fix it and use regression testing to re-test the unit/requirement. Page being tested Login Page Forgot Password Student Home Screen System Admin Home Screen Testing for Expected Outcome The screen will load correctly and the users will have ability to type in their login info The screen will load correctly and the users will have ability to type in their user name The screen will load with the user s information on their home page The screen will load with the user s information on their home Pass Fail Comment 17 of 81

18 Prg Admin Home screen Instructor Home Screen Student Acct Creation Std Acct Creation Popup Created Acct sys admin Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? page The screen will load with the user s information on their home page The screen will load with the user s information on their home page The screen will load correctly and the users will have ability to type in their login info The screen will load correctly and the users will have ability to type in their login info The screen will load correctly and the users will be registered and receive 18 of 81

19 Created user acct sys admin Create Question Student Question / Q set answer Student gradebook gradebook Instructor Gradebook System admin course mngment Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? Is all the data an 19 of 81

20 link to new course Sa create course Instructor published content pool Instructor my pool Instructor course pool Instructor global pool Question Set Creation Question Set Adding a Question uploaded to the database correctly? Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? Will display that the course has successfully been created and allow the sys admin to create another course 20 of 81

21 Submitted Created Question Question Set Publication Editing Live Question Editing Live Question set Acct Management Student Acct Management Instructor Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? 21 of 81

22 Acct Management Prg Admin Acct Management Sys Admin Course home page std Course home pg instructor, admins Pool management prg admin Pool management sys admin Std quest run & compile Pop up save Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? 22 of 81

23 question Created course sys admin Approval global pool requests sa Approval course pool requests - pa Create User Accounts prog admin Create Section Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? Is all the data uploaded to the database correctly? The screen will load correctly and display that the section has been created 23 of 81

24 Section 3: Unit Tests 3.1 Unit Test Catalog Test Result Test Number Unit Test Name PASS 1 Login Page PASS 2 Forgot Password PASS 3 Student Home Screen PASS 4 System Admin Home Screen PASS 5 Prg Admin Home screen PASS 6 Instructor Home Screen PASS 7 Student Acct Creation NO LONGER USED 8 Std Acct Creation Pop-up PASS 9 Created Acct sys admin NO LONGER USED 10 Created user acct sys admin PASS 11 Create Question PENDING 12 Student Question / Q set answer IN PRODUCTION 13 Student grade book IN PRODUCTION 14 grade book IN PRODUCTION 15 Instructor grade book NO LONGER USED 16 System admin course mngment link to new course PASS 17 Sa create course PENDING 18 Instructor published content pool PASS 19 Instructor my pool PASS 20 Instructor course pool PASS 21 Instructor global pool PASS 22 Question Set Creation PASS 23 Question Set Adding a Question 24 of 81

25 NO LONGER USED 24 Submitted Created Question IN PRODUCTION 25 Question Set Publication PENDING 26 Editing Live Question PENDING 27 Editing Live Question set PASS 28 Acct Management Student PASS 29 Acct Management Instructor PASS 30 Acct Management Prg Admin PASS 31 Acct Management Sys Admin PASS 32 Course home page std PASS 33 Course home pg instructor, admins IN PRODUCTION 34 Pool management prg admin IN PRODUCTION 35 Pool management sys admin PENDING 36 Std quest run & compile NO LONGER USED 37 Pop up save question NO LONGER USED 38 Created course sys admin IN PRODUCTION 39 Approval global pool requests sa IN PRODUCTION 40 Approval course pool requests - pa PASS 41 Create User Accounts - pa PASS 42 Create Section 25 of 81

26 Unit 1 Login Page Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments P Login page loads Correct page loads N/A Login page loads and is appropriately displayed Correct login: Student Welcome Page Student opens P P P P P P P Correct login: Instructor Correct login: Program Correct login: System Incorrect username login Incorrect login New Account link Login with valid Student account and. Login with valid Instructor account and. Login with valid Program account and Login with valid System account and User attempts to log in with invalid username User attempts to log in with invalid A Student wishes to register a new account Input Student address and Input Instructor address and Input Program address and Input System address and Input username Input User clicks "New Account" Instructor Welcome Page opens Program Welcome Page opens System Welcome Page opens Error message stating that the username is incorrect is displayed Error message stating that the is incorrect is displayed Student Account Creation Page loads correctly 26 of 81

27 P P Forgot Password link Login button = Summary of Tests for This Unit A user wishes to receive their via A user wishes to log in User clicks "Forgot Password" User clicks the "Login" button Forgot Password Confirmation Page loads correctly If all fields are filled in and contain correct data, the user is logged in Unit 2 Forgot Password Pop-up Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments P Forgot Password Page Pop Up Forgot Password Page Pop Ups N/A Forgot Password page pop-ups and is appropriately displayed P Pop-up allows student to enter user name Student must enter username to have e- mailed Input Student username Password is ed to the student 27 of 81

28 Unit 3 Student Home Page P Note: Assume a Student has successfully logged in. A student refers to a Student user, or any user in the Student view. Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments Student Home Correct page N/A Student Home Page loads Page loads loads and is appropriately P F P F P Home button Gradebook button Current course Completed course Logout button = Summary of Tests for This Unit A Student wishes to go to the Home Page A Student wishes to view the Gradebook A Student wishes to view the page of a particular current course A Student wishes to view the page of a particular completed course A Student wishes to log out Student clicks the "Home" link Student clicks the "Gradebook" link Student clicks a current course Student clicks a completed course Student clicks the logout button displayed Student Home Page is loads and is appropriately displayed Student Gradebook is correctly reloaded Correct page is loaded for the selected course Correct page is loaded for the selected course The user is successfully logged out and redirected to the login screen Gradebook feature has not been created 28 of 81

29 Unit 4 System Home Page Note: Assume the System has successfully logged in. Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments System Correct page N/A Home Page loads loads Student Home Page loads and is appropriately displayed Home button Global Pool request button Change view Course Logout button = Summary of Tests for This Unit The System wishes to go to the Home Page The System wishes to view Global Pool requests The System wishes to change view The System wishes to view the page of a particular course The System wishes to log out System clicks the "Home" link System clicks the "Global Pool" link Desired view selected System clicks a course Student clicks the logout button System Home Page is loads and is appropriately displayed Global Pool request page is correctly loaded The System s view changes to the selected view Correct page is loaded for the selected course The user is successfully logged out and redirected to the login screen Views are selected from a drop-down menu 29 of 81

30 Unit 5 Program Home Page Note: Assume a Program has successfully logged in. A Program refers to a Program user, or the System in the Program view. Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments Program Correct page N/A P Home Page loads loads Program Home Page loads and is appropriately displayed P P P F P Home button Course Pool request button Current course Change view Logout button = Summary of Tests for This Unit A Program wishes to go to the Home Page A Program wishes to view the Course Pool requests A Program wishes to view the page of a particular course A Program wishes to change view A Program wishes to log out Program clicks the "Home" link Program clicks the "Course Pool" link Program clicks a course Desired view selected Program clicks the logout button Program Home Page is loads and is appropriately displayed Course Pool request page is loaded correctly Correct page is loaded for the selected course A Program s view changes to the selected view The user is successfully logged out and redirected to the login screen Views are selected from a drop-down menu 30 of 81

31 Unit 6 Instructor Home Page P Note: Assume an Instructor has successfully logged in. An Instructor refers to an Instructor user, or any user in the Instructor view. Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments Instructor Correct page N/A Instructor Home Page Home Page loads loads and is appropriately loads P F P F P Home button Gradebook Current course Change view Logout button = Summary of Tests for This Unit An Instructor wishes to go to the Home Page An Instructor wishes to view the Gradebook An Instructor wishes to view the page of a particular course An Instructor wishes to change view An Instructor wishes to log out Instructor clicks the "Home" link Instructor clicks the "Gradebook" link Instructor clicks a course Desired view selected Instructor clicks the logout button displayed Instructor Home Page is loads and is appropriately displayed Instructor Gradebook is correctly reloaded Correct page is loaded for the selected course The Instructor s view changes to the selected view The user is successfully logged out and redirected to the login screen Gradebook feature has not been created Views are selected from a drop-down menu 31 of 81

32 Unit 7 Student Account Creation Note: Assume student knows his/her first and last name and address, and has then on the "Submit" button. Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments P Student Account Creation page loads Correct page loads N/A Student Account Creation page loads and is appropriately displayed P P P P P P accepted first name unaccepted first name accepted last name unaccepted last name accepted address unaccepted address Student enters first name with no illegal characters Student enters first name with illegal characters Student enters last name with no illegal characters Student enters last name with illegal characters Student enters a unique and valid address with legal characters Student enters a non-unique address or one that is invalid or contains illegal characters Input first name Input first name Input last name Input last name Input address Input address No illegal characters, the name is accepted Page reloaded with proper error message displayed No illegal characters, the name is accepted Page reloaded with proper error message displayed No illegal characters, the address is valid. The address is accepted Page reloaded with proper error message displayed 32 of 81

33 Unit 8 P P P P Pass/Fail accepted unaccepted Confirm correctly Confirm incorrectly = Summary of Tests for This Unit Test Case P P P Student enters a of the proper length with no illegal characters Student enters a not of the proper length or containing illegal characters Student retypes the correctly Student retypes the incorrectly Input Input Input Input Password is compared to confirmation Page reloaded with proper error message displayed Confirmation matches and is accepted. Confirmation does not match the. Page reloaded with proper error message displayed. Student Account Created Pop-up Note: A student has just successfully created an account and attempt to log in with it for the first time. Their information is entered and the Continue button is. Number Step Description Action Needed Expected Result Observed Result Comments Student Correct page N/A Student Account Created Account loads Pop-up page loads and is Created Pop-up appropriately displayed page loads Correct login Incorrect login Log in with valid ID and Student attempts to log in with an invalid ID or Student enters ID and Student enters an invalid ID or Student is logged in Page reloaded with proper error message displayed 33 of 81

34 Unit 9 Created Account System Pass/Fail Test Case Number Step Description Action Needed Expected Result Observed Result Comments Account Correct page N/A Account Created Pop-up This page Created Pop-up loads page loads and is is no page loads appropriately displayed longer Create another account Return to homepage The System wishes to create another account The System wishes to return to the homepage Create Another Account Button Return to Homepage button The account create page loads correctly The System homepage loads correctly included This page is no longer included This page is no longer included 34 of 81

35 Unit 10 Create User Account System P Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments Account Creation Correct page N/A Account Creation page loads page loads loads and is appropriately displayed P P P P accepted first name unaccepted first name accepted last name unaccepted last name System enters first name with no illegal characters System enters first name with illegal characters System enters last name with no illegal characters System enters last name with illegal characters Input first name Input first name Input last name Input last name No illegal characters, the name is accepted Page reloaded with proper error message displayed No illegal characters, the name is accepted Page reloaded with proper error message displayed 35 of 81

36 accepted address System enters a unique and valid address with legal characters Input address No illegal characters, the address is valid. The address is accepted P P unaccepted address accepted System enters a nonunique address or one that is invalid or contains illegal characters System enters a of the proper length with no illegal characters Input address Input Page reloaded with proper error message displayed Password is compared to confirmation P P unaccepted System enters a not of the proper length or containing illegal characters Input Page reloaded with proper error message displayed 36 of 81

37 Confirm correctly System retypes the correctly Input Confirmation matches and is accepted. P P Confirm incorrectly = Summary of Tests for This Unit System retypes the incorrectly Input Confirmation does not match the. Page reloaded with proper error message displayed. 37 of 81

38 Unit 11 Question Creation Note: Assume a user has just the Submit button. Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments P Question Creation page loads Correct page loads N/A Question Creation page loads and is appropriately displayed P acceptable question title Question title contains no illegal characters Input a question title No illegal characters, question title is accepted P P P P P P P unacceptable question title acceptable question unacceptable question acceptable method signature unacceptable method signature acceptable viewable test cases unacceptable viewable test Question title contains illegal characters Question contains no illegal characters Question contains illegal characters Method signature contains no illegal characters Method signature contains illegal characters Viewable test cases contain no illegal characters and are in the proper format Viewable test cases contain illegal characters Input a question title Input a question Input a question Input a method signature Input a method signature Input viewable test cases Input viewable test cases Page reloaded with proper error message displayed No illegal characters, question is accepted Page reloaded with proper error message displayed No illegal characters, method signature is accepted Page reloaded with proper error message displayed No illegal characters and proper format, viewable test cases are accepted Page reloaded with proper error message displayed 38 of 81

39 P P P P P P P P P cases acceptable hidden test cases unacceptable hidden test cases acceptable solution unacceptable solution acceptable hints unacceptable hints Select a category Do not select a category Select if recursion is required or are in an improper format Hidden test cases contain no illegal characters and are in the proper format Hidden test cases contain illegal characters or are in an improper format Solution contains no illegal characters Solution contains illegal characters Hints contain no illegal characters Hints contain illegal characters User selects a category User neglects to select a category User selects Yes or No Input hidden test cases Input hidden test cases Input a solution Input a solution Input hints Input hints Click a category N/A Click an option No illegal characters and proper format, hidden test cases are accepted Page reloaded with proper error message displayed No illegal characters, the solution is accepted Page reloaded with proper error message displayed No illegal characters, the hints are accepted Page reloaded with proper error message displayed Selected category is assigned to the question Page reloaded with proper error message displayed If Yes the solution will require recursion; if No it will not This field can be left blank This field can be left blank This field can be left blank This field can be left blank This field can be left blank This field can be left blank The categories are check boxes The categories are check boxes The options are check boxes P Do not select if recursion is User fails to select Yes or No N/A Page reloaded with proper error message displayed The options are check required boxes F Upload a User uploads a User clicks File is successfully Uploading is 39 of 81

40 F file successfully valid file Browse and selects a file Upload a file User uploads a file User clicks unsuccessfully that is invalid Browse and selects a file = Summary of Tests for This Unit uploaded Page reloaded with proper error message displayed optional Uploading is optional 40 of 81

41 Unit 12 Student Question / Question Set Answer Page Note: Assume a user has just finished answering a question and on the "Run & Compile" Button Test Case Pass/Fail Number Step Description Solution Submission page loads P correctly Correct page loads N/A Save code on Verify test is saved Code F submission in the database submission F F P F P F Student enters valid code Student enters invalid code Student enters code that compiles Student enters code that does not compile Student enters correct code Student enters incorrect code = Summary of Tests for This Unit Validate text for legal characters Validate text for legal characters Compile submission using Java 1.6 Compiler Compile submission using Java 1.6 Compiler Run test cases through submission code Run test cases through submission code Action Needed Expected Result Observed Result Comments Code submission Code Submission Code submission Code submission Code submission & Question Test Cases Code submission & Question Test Cases Solution Submission page loads and is appropriately displayed Code submission saved in the database No illegal characters Proper error message displayed No compilation errors Proper compilation errors displayed Correct test case output is returned by code submission, all cases pass The student is notified as to whether or not specific test cases were passed or not 41 of 81

42 Unit 13 Student - Gradebook F Note: Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments Student Grade Correct page N/A Student Grade book page book Page loads loads and is appropriately Loads Correctly displayed F Student s completed assignments appear as hyper links Home button Students are able to navigate to completed assignments A Student wishes to go to the Home Page Click on completed assignments Student clicks the "Home" link Student is navigated to completed assignment Student Home Page is loads and is appropriately displayed F Logout button is A Student wishes to logout Student clicks the logout button Student is logged out and redirected and to login page F of 81

43 Unit 14 Admin Gradebook Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments Admin Grade Correct page N/A Admin Grade book page book Page loads loads and is appropriately Loads Correctly displayed P P P P Admin s assignments appear as hyper links Home button Logout button is = Summary of Tests for This Unit Admins are able to navigate to assignments An Admin wishes to go to the Home Page An Admin wishes to logout Click on completed assignments Admin clicks the "Home" link Admin clicks the logout button Admin is naviagated to completed assignment Admin Home Page is loads and is appropriately displayed Adminis logged out and redirected and to login page Unit 15 Instructor - Gradebook Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments P Instructor Grade book Page Loads Correctly Correct page loads N/A Instructor Grade book page loads and is appropriately displayed P P P Instructor s assignments appear as hyper links Home button Logout button is = Summary of Tests for This Unit Instructors are able to navigate to assignments A Instructor wishes to go to the Home Page A Instructor wishes to logout Click on completed assignments Instructor clicks the "Home" link Instructor clicks the logout button Instructor is naviagated to completed assignment Instructor Home Page is loads and is appropriately displayed Instructor is logged out & redirected and to login pg. 43 of 81

44 Unit 16 System Course Management P Note: Assume the system administrator knows the proper course title and course number Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments Course Correct page N/A Course Management page Management loads loads and is appropriately page loads displayed P F P Edit a course Remove a course New course = Summary of Tests for This Unit The System wishes to edit a course The System wishes to remove a course The System wishes to add a new course The System clicks the 'Edit' button next to the appropriate course The System clicks the 'Remove' button next to the appropriate course The System click the 'New Course' button The System is brought to a page where the course can be edited. The course is removed The System is brought to a page where a new course can be created 44 of 81

45 Unit 17 Course Creation Page Test Case Pass/Fail Number Step Description Action Needed Expected Result Observed Result Comments P P P Course Creation page Course Name selection Course Number selection Section Number selection Semester selection Create button = Summary of Tests for This Unit Correct page loads Course Name is selected Course Number is selected Course Section is selected Semester (Fall, Spring, or Summer) and the year are selected User wishes to create the course N/A Course Name is selected from a drop-down menu Course Number is selected from a drop-down menu Course Section is selected from a drop-down menu Course Semester and year are selected from a drop-down menu User clicks the "Create" button Course Creation page loads and is appropriately displayed Course Name is accepted Course Number is accepted Section Number is accepted Semester/year are accepted The course is successfully created i.e. Intro to Computer Science Now done in create section Unit 42 Now done in create section Unit 42 Now done in create section Unit of 81

46 Unit 18 Number Instructor Published Content Pool Test Case Name Description Input Expected Result Published Content loads Filter by Date Published Content loads Filter content by date added N/A Select Filter by Date Published Question Sets are properly listed The Published Content list gets filtered by the date they were published Actual Result/Comments Test Result F F Filter by Date Range Filter by Type Filter content by the dates in the specified range Filter content by type Select Filter by Date Range Select Filter by Type The Published Content list gets filtered by the dates in the specified date range, beginning with the most recent The Published Content list gets filtered by the types of question sets F F Preview a Published Question Set Edit a Published Question Set Preview a Published Question Set Edit a published question set Click Preview Click Edit A preview of the published question set is loaded in a pop-up window Loads the Editing a Live Question Set page F F Unpublish a Question Set Unpublish a question set Click Unpublish The question set gets unpublished and is removed from the published content list F 46 of 81

47 Unit 19 Number Instructor - My Pool Test Case Name Description Input Expected Result Actual Result/Comments Test Result My Pool content loads Choose Questions Tab Choose Question Sets Tab My Pool content loads Choose Questions Tab Choose Question Sets Tab N/A Click on Questions tab Click on Question Sets tab My Pool content is loaded with all proper questions and question sets Questions in My Pool are populated and listed Question Sets in My Pool are populated and listed P F F Filter by Date Filter content by date added Select Filter by Date My Pool Content gets filtered by the date they were published F Filter by Date Range Filter content by the dates in the specified range Select Filter by Date Range My Pool content gets filtered by the dates in the specified date range, beginning with the most recent F Filter by Type Filter content by type Select Filter by Type My Pool Content gets filtered by the types of question sets or questions F Publish content Publish content Click the publish button Publishes the designated question or question set F 47 of 81

48 Preview content Preview content Click the preview button Displays a preview of the designated question or question set in a pop-up window P Delete content Delete content Click the delete button Removes the designated question or question set from the content list P Global Pool Request Global Pool Request Click the Global Request button A request is sent to the System Admin asking permission to move the designated question or question set to the Global Pool F Course Pool Request Course Pool Request Click the Course Request button A request is sent to the System Admin asking permission to move the designated question or question set to the Course Pool F 48 of 81

49 Unit 20 Number Instructor - Course Pool Test Case Name Description Input Expected Result Actual Result/Comments Test Result Course Pool content loads Course Pool content loads N/A Course Pool content is loaded with all proper questions and question sets P Global Pool tab Choose Global Pool tab Click on Global Pool tab Questions/Sets in Global Pool are populated and listed P My Pool tab Choose My Pool tab Published Pool tab Choose Published Pool tab Click on My Pool tab Click on Published Pool tab Question/Sets in My Pool are populated and listed Questions/Sets in Published Pool are populated and listed P F Edit Instructor wishes to edit a question/set Click Edit Redirected to a page to edit the question/set P Remove Instructor wished to remove a question/set Click Remove The appropriate item is removed from the pool P Preview content Preview content Click the question/set title Displays a preview of the designated question or question set in a pop-up window F 49 of 81