Raytheon Senior Project Test Plan Spring 2012

Size: px

Start display at page:

Download "Raytheon Senior Project Test Plan Spring 2012"

Charles Short
5 years ago
Views:

1 Raytheon Senior Project Test Plan Spring 2012 Department of Computer Science and Engineering University of South Florida Tampa, Fl Version 1.01 March 21, 2012 Jarret Allen Luis Cintron Michael Kubacki Robert Skinner

2 Brief Overview of System Operation Test cases shall be selected to ensure that the requirements are met and the specification and design has been implemented correctly. A very brief description of the program operation follows to identify some best-case and worst-case cases for tests to be built upon. The Vinculum-II device is powered by a 5v power supply. The FAT API on the Vinculum-II device performs a linear scan of the file system and transfers this data (strings of filenames) to the Raytheon Senior Project Application (RSPA) on an Android phone. Navigating to a new directory in the RSPA requires the file data for the new directory to be streamed from the Vinculum-II device to the RSPA. Once a file is selected, it must be transferred from the USB mass storage device through the Vinculum-II device to the RSPA to be ed. General Best Cases Analyzing this process, the best case and worst case for various scenarios can easily be determined. The best case for the USB mass storage device linear scan would be an empty mass storage device or, in the case of complete program operation, one file on the mass storage device. The best case for data transfer both to the phone and across the network would be the minimum supported file size of the file system and the maximum speed data network connection supported by the Android device. In addition, directories with large list of files will take longer to navigate, as more data must be transferred to the user interface on the Android device. Thus, one root directory with no files would be the best case for overall system operation. General Worst Cases Because the FAT API performs a linear scan of the files in the current directory, the worst case would be the maximum number of files in a directory each of the minimum supported file size. The worst case for file transfer to the phone and across the network would be a file of the maximum size supported by the file systems present (on the Android device and the USB mass storage device). The speed of the file ed is dependent upon the data network speed. General Corner Cases The Vinculum-II module should be tested to verify it is capable of operating in various conditions such as varying battery power levels, environment temperatures, durations of time, with various USB devices (not the expected Android phone or mass storage device), and combinations of these configurations. The FAT API firmware should be tested with no files present, one file present, and many files present. The RSPA should be run without the Vinculum-II module attached, with no data connection, and other limitations on successful program operation to ensure it gracefully exits and accurately reports the problem to the user. Typical Cases A typical case may consist of a USB mass storage device with approximately files, a 3G data connection, and an Android device. 2

3 The requirements referenced are defined in the Spring 2012 Raytheon Senior Project Statement of Work. Test Case 1: Android Device Version Confirmation o Android device with sufficient battery charge to facilitate powering on the phone and navigating screens. 1. Hold down the Android device power button for 2 seconds. 2. When the Android device is fully powered on, touch the Menu button located next to the Home, Back, and Search buttons. 3. Touch the Settings button. 4. Scroll until you find the About phone button and touch the button. 5. Scroll until you find Android version. 6. If the version in the Android version box is 2.2 or greater, SYS02 and SYS02a are successfully met. Check the version number in the Android version box. If it is greater than 2.2, the test was successful. Requirements Met: o SYS02 o SYS02a Test Case 2: Bulk-only Mass Storage Flash Drive USB 2.0 Compliance o Windows XP, Windows Vista, or Windows 7 computer with female USB 2.0 type A port o Known USB 2.0 compliant BOMS flash drive with a male type A port o BOMS flash drive with a male type A port to be tested for USB 2.0 compliance 1. Turn on Computer and wait for it to completely start. 2. Connect the USB 2.0 compliant BOMS flash drive to the computer. 3. If a message from the system tray appears which reports that a device is being installed, please wait for it to report that the device has been successfully installed. 3

4 4. Open the flash drive s contents for viewing using either the dialog window that opens upon connecting the compliant BOMS flash drive, or by clicking on My Computer on the computer s Desktop or Start Menu, navigating to the removable storage devices, and double-clicking on the compliant BOMS flash drive. 5. After successfully viewing the files, press the back button on Windows Explorer to return to My Computer. 6. Right-click on the compliant BOMS device under removable storage devices and click Eject. 7. Remove the compliant BOMS device from the female USB 2.0 type A port on the computer and set it aside. 8. Insert the BOMS flash drive to be tested into the female USB 2.0 type A port on the computer. 9. If a message from the system tray appears which reports that a device is being installed, please wait for it to report that the device has been successfully installed. 10. Attempt to open the flash drive s contents for viewing using either the dialog window that opens upon connecting the BOMS flash drive, or by clicking on My Computer on the computer s Desktop or Start Menu, navigating to the removable storage devices, and double-clicking on the BOMS flash drive. 11. If the dialog window does not open upon connecting the BOMS flash drive, AND the device is not found under removable storage devices, AND a message from the system tray did not appear which reported that a device is being installed, the test has failed. The BOMS flash drive is not USB 2.0 compliant. Requirements Met: o SYS03 Test Case 3: Measurement of File Locating Delay o A stopwatch timer 1. Power on Android device by holding down power button for 2 seconds. 2. Power on V2DIP2-48 system by putting the rocker switch into the on position. 3. Plug the cable s male type A USB port into a female type A USB port on the V2DIP2-48 System. Plug the cable s male micro type B USB port into the Android device s female micro type B USB port. 4

5 4. Plug the BOMS flash device into the V2DIP2-48 system s unoccupied female USB type A USB port. 5. The correct application should open on the Android device automatically. If not, a window will open asking which application you would like to open. Open the Raytheon Senior Project application. 6. Prepare the stopwatch to begin timing when the Browse Files button is clicked. 7. When you are ready, click the Browse Files button and start the stopwatch simultaneously. When the files are located and the directory list appears, stop the stopwatch. 8. Record the time and retest several times. Record an average time. Analyze the average time. If it is greater than 5 seconds, the test was a failure. If it was equal to or less than 5 seconds, it was successful. Requirements Met: o SYS06 Test Case 4: Handling Large Files 1. Power on Android device by holding down power button for 2 seconds. 2. Power on V2DIP2-48 system by putting the rocker switch into the on position. 3. Plug the cable s male type A USB port into a female type A USB port on the V2DIP2-48 System. Plug the cable s male micro type B USB port into the Android device s female micro type B USB port. 4. Plug the BOMS flash device into the V2DIP2-48 system s unoccupied female USB type A USB port. 5. The correct application should open on the Android device automatically. If not, a window will open asking which application you would like to open. Open the Raytheon Senior Project application. 6. Click the Browse Files button and select a file with size greater than 3MB from the BOMS flash drive. 7. Confirm a recipient of the file and send through either or MMS to an account you can check for successful file transfer. 5

6 8. Open the account and the file to confirm that it works properly after the transfer has completed. If the file has transferred correctly and was not altered during the transfer this test has been demonstrated successfully, otherwise the test was a failure. Requirements Met: o SYS08 Test Case 5: Handling Large Files 1. Power on Android device by holding down power button for 2 seconds. 2. Power on V2DIP2-48 system by putting the rocker switch into the on position. 3. Plug the cable s male type A USB port into a female type A USB port on the V2DIP2-48 System. Plug the cable s male micro type B USB port into the Android device s female micro type B USB port. 4. Plug the BOMS flash device into the V2DIP2-48 system s unoccupied female USB type A USB port. 5. The correct application should open on the Android device automatically. If not, a window will open asking which application you would like to open. Open the Raytheon Senior Project application. 6. Click the Browse Files button and select a file from the BOMS flash drive. 7. Confirm a recipient of the file and send through to an account you can check for successful file transfer. 8. Open the account and the file to confirm that it works properly after the transfer has completed. If the file has transferred correctly and was not altered during the transfer this test has been demonstrated successfully, otherwise the test was a failure. 6

7 Requirements Met: o SYS09 o SYS09a o SYS09b o SYS09c Sub-tests: o Follow Test Plan 4, for each of the following file types: JPG, GIF, PNG, BMP, TIFF, RAW WAV, WMA, MP3, FLAC AVI, 3GP, DIVX, FLV, MPG, WMV, MOV o Contingent on the verification process of Test Plan 4, for each of the above file types. Test Case 6: USB device and Smart Phone distance Analyze USB 2.0 Specifications. Maximum cable length is limited to 5 meters, so a 2 meter cable will be successful in interfacing the USB device and smart phone for communication. Requirements Met: o SYS12 Test Case 7: Single User Interface Inspection of the Raytheon Senior Project application by sight will show that all interactions happen within this one user interface. Requirements Met: o SYS14 Test Case 8: Ease of Use 1. Find a participant who is a non-engineering student. 2. Start a stopwatch, and train him or her in installing and using the V2DIP2-48 system and the Raytheon Senior Project application for at most 5 minutes. 7

8 3. Reset the stopwatch, then give the participant 5 minutes to successfully install and use the device to send a file from scratch. 4. Record results and retest with several participants. Record the average of the results. If the average time to install and send a file using the application is less than 5 minutes, the test will be considered a success. Requirements Met: o SYS15 Test Case 9: Necessary drivers/software Demonstration Process 1. Power on the Android device. 2. When fully powered on, open the Android Market 3. Search for the application in the market and install it. 4. Power on the V2DIP2-48 via the rocker switch. 5. Plug the BOMS flash device into a female USB type A port. 6. Plug the USB male type A side of the cable into the V2DIP2-48 USB female type A port and the male micro B USB port into the Android device s female micro B USB port. 7. The correct application should open on the Android device automatically. If not, a window will open asking which application you would like to open. Open the Raytheon Senior Project application. 8. Click the Browse Files button and select a file from the BOMS flash drive. 9. Confirm a recipient of the file and send through either or MMS to an account you can check for successful file transfer. 10. Open the account and the file to confirm that it works properly after the transfer has completed. Requirements Met: o SYS19 8

9 Test Case 10: Self Powered 1. First remove the battery plate from the bottom of the box. 2. If there are no batteries currently present then acquire two AA batteries and place them in the appropriate position it the battery holder. 3. Then replace the battery plate and make sure it is secure. 4. Once installed in the device, locate the power rocker switch on the side of the device. 5. The flip press this switch to switch it from off to on. 6. A red LED located either on the top of the device or on the switch itself will then light up to signify that the device is turned on. Initially look at the red LED to ensure that it is lit. After assuring that the LED is lit the device will be monitored for a couple of minutes to make sure that the device stays on. Exact Input: 1. Putting batteries into the device if there is initially none. 2. The pressing of the power rocker switch. Exact Expected Output: The red LED that signifies power is lit. Requirements Covered: o SYS04 Test Case 11: Interfacing Phone and USB storage device 9

10 1. Press rocker switch to switch it from off to on. 2. A red LED located either on the top of the device or on the switch itself will then light up to signify that the device is turned on. 3. The user will have a stop watch or some sort of time keeping device. 4. Once the device is turned on the insert the one end of the USB cable into the phone and the other into the device. 5. Once the phone is plugged in then the USB storage device will be inserted next and the time will be started. 6. Time will stop when app opens. Once the device is turned on and both the phone and USB storage device are plugged in to the device the user will then look at the phone screen and start timing. The app on the phone then automatically opens up on the upon interfacing and this is when the time shall be stopped and checked to see if it s within five seconds. Exact Input: 1. Power switch for device. 2. Plug cable into phone and other end into the device. 3. Plug the USB storage device into the device. Exact Expected Output: 1. Device turns on. 2. Once phone and USB storage device are plugged in app will automatically start. Requirements Covered: o SYS01 o SYS05 Test Case 12: File Load Time (SYS07) 1. Turns on the device by pressing the rocker switch located on the side to the on position. 10

11 2. The red LED on the switch itself or on top of the device will be lit to signify the device being on. 3. Once the device is turned on the insert the one end of the USB cable into the phone and the other into the device. 4. Once the phone is plugged in then the USB storage device will be inserted next. 5. Once both phone and USB are inserted the messaging app will then open up automatically on the phone which will signify successful interfacing of phone and storage device. 6. Once the app is select the option to browse files. 7. The next menu will come up and option to either add a file from the USB storage device or delete an already attached file from the messaging app. 8. Click on add file and then browse the directory from the USB device. 9. Once the desired file is hit add/attach. Once the desired file is found and the add/attach button is selected time will be kept from until a popup says that the add was successfully. Once confirmation is received the timer will be stopped and the time recorded. Exact Input: 1. Pressing power switch. 2. Plugging phone and USB into the device. 3. User hitting add files once app is running. 4. User selecting desired file. 5. User hitting add once desired file is found. Exact Expected Output: 1. Device turns on. 2. App starts once both devices are plugged in. 3. User navigates successfully to browse file screen 4. A confirmation popup is displayed once file has successfully been attached. Requirements Covered: o SYS07 Test Case 13: Send a File to Address 11

12 1. Turn on the device by pressing the rocker switch located on the side to the on position. The red LED on the switch itself or on top of the device will be lit to signify the device being on. 2. Once the device is turned on the insert the one end of the USB cable into the phone and the other into the device. 3. Once the phone is plugged in then the USB storage device will be inserted next. 4. Once both phone and USB are inserted the messaging app will then open up automatically on the phone which will signify successful interfacing of phone and storage device. 5. Once the app is open the select the option to browse files. 6. The next menu will come up and option to either add a file from the USB storage device or delete an already attached file from the messaging app. 7. Click on add file and then browse the directory from the USB device. 8. Once the desired file is found hit add/attach. 9. After the files are added successfully then move on to the next screen by selecting the add/remove contacts option. 10. At this page either manually enter contacts address or hit the browse contacts button and pull it from there. 11. When the contacts have been entered or loaded the there will be an opportunity to review the files and contacts before hitting send. 12. Once files and contacts are reviewed the hit send and confirmation pop-up message appears. 13. The app then goes back to the beginning. After the user selects to add a file, the file will then be seen as attached on the phone. After that the user enters an address. Then the user reviews the file and contact information. When they deem it is correct they hit send. The recipient of the then checks their mail to see if they received the file. Exact Input: 1. Pressing power switch. 2. Plugging phone and USB into the device. 3. User hitting add files once app is running. 4. User selecting desired file. 5. User hitting add once desired file is found. 6. User entering or loading a contact address 7. User hitting send Exact Expected Output: 1. Device turns on. 12

13 2. App starts once both devices are plugged in. 3. User navigates successfully to browse file screen 4. A confirmation popup is displayed once file has successfully been attached. 5. Added contact appearing in the To field 6. Addressee receiving the mail. Requirements Covered: o SYS10 Test Case 14: Variety of Connector Plugs 1. Turn on the device by pressing the rocker switch located on the side to the on position. 2. The red LED on the switch itself or on top of the device will be lit to signify the device being on. 3. Once the device is turned on insert the one end of the USB cable with a type-a USB receptacle into the phone and the other into the device. 4. Once the phone is plugged in then the USB storage device will be inserted next. 5. Once both phone and USB are inserted the messaging app will then open up automatically on the phone which will signify successful interfacing of phone and storage device. 6. Repeat steps for following USB receptacles: mini-b, micro-a, micro-b. Once user has device turned on, phone plug in and the desired receptacle plug in the app will auto start. The auto start of the app signifies successful interfacing. Exact Input: 1. Power switch for device. 2. Plug cable into phone and other end into the device. 3. Plug the USB storage device into the device. Exact Expected Output: 1. Device turns on. 2. Once phone and USB storage device are plugged in app will automatically start. 13

14 Requirements Covered: o SYS11 o SYS11a o SYS11b o SYS11c o SYS11d Test Case 15: Power Usage 1. Unscrew two screws at the bottom of the case. 2. When the case is off then power up the device. 3. Once the device is on then plug in the phone and USB storage device. 4. When everything is connected attach voltmeter and read the voltage reading. Verification of the voltage being under 6 volts can be done by inspecting the voltmeter while it is in place and the device is on. Exact Input: 1. Power switch for device. 2. Plug cable into phone and other end into the device. 3. Plug the USB storage device into the device. Exact Expected Output: 1. Device turns on. 2. Voltmeter reads 5V Requirements Covered: o SYS13 Test Case 16: Total Volume 14

15 o Fully-functional Android device 1. Measure the length of device 2. Measure the width of device 3. Measure the height of device 4. Multiple together to get volume Verification will be done by comparing the maximum volume specified which is 621 cm^3 with the value obtained from the calculations Exact Input: 1. Length of device 2. Width of device 3. Height of device Exact Expected Output: 1. A volume less that the maximum allowed Requirements Covered: o SYS16 Test Case 17: Device weight 1. Find a scale and weigh the device. Verification will be done by comparing the weight from the scale reading to the maximum weight of 150grams. Exact Input: 1. Weight from the scale Exact Expected Output: 1. A weight less than 150 grams 15

16 Requirements Covered: o SYS17 Test Case 18: Operation time 1. Turn the device on 2. Plug one end of the cable to the phone and the other one into the device 3. Plug in the USB storage device into the device. Leave alone for 15 minutes 4. After 15 minutes select the option to browse files from the app 5. The next menu will come up and option to either add a file from the USB storage device or delete an already attached file from the messaging app 6. Click on add file and then browse the directory from the USB device 7. Once the desired file is found hit add/attach 8. After the files are added successfully then move on to the next screen by selecting the add/remove contacts option 9. At this page either manually enter contacts address or hit the browse contacts button and pull it from there 10. When the contacts have been entered or loaded the there will be an opportunity to review the files and contacts before hitting send 11. Once files and contacts are reviewed the hit send and confirmation pop-up message appears 12. The app then goes back to the beginning 13. Wait another 15 minutes then repeat. Continue for 8 hour Verification will be done by inspecting the device and phone to see if they have enough power. The inspections will be done every 30 minutes. Exact Input: 1. Pressing power switch. 2. Plugging phone and USB into the device. 3. User hitting add files once app is running. 4. User selecting desired file. 5. User hitting add once desired file is found. 16

17 6. User entering or loading a contact address 7. User hitting send Exact Expected Output: 1. Addressee receiving file 2. Device staying on. Requirements Covered: o SYS18 Test Case 19: Testing for Loss of Data o A file is located on the BOMS flash device The file is selected in the RSPA user interface and sent via the firmware in the Vinculum-II device to the RSPA and ed as an attachment to a standard address. The USB mass storage device file and attachment file are opened side-by-side on one computer and compared to ensure no changes have happened to the data in transfer. The file transferred should open and function exactly the same as the USB mass storage device file in the appropriate program for the file type. Exact Input: o Test 1: A small (< 10KiB).txt file, a medium (~500KiB).txt file, and a large (~1MiB).txt file all containing ASCII characters. o Test 2: An ~3MiB.BMP,.GIF,.JPG,.PNG,.RAW, and.tiff file. o Test 3: An ~6MiB.FLAC,.MP3,.WAV, and.wma file. o Test 4: An ~10MiB.3GP,.AVI,.DIVX,.FLV,.MOV,.MPG, and.wmv file. Exact Expected Output: Exactly the same file data (unmodified) with the exact matching file size in the attachment. 17

18 Requirements Covered: o SYS08 o SYS09 o SYS10 18

19 Traceability Matrix of Test Cases to Project System Requirements 19

System Requirements Review Preliminary Design Review. Jarret Allen Luis Cintron Michael Kubacki Robert Skinner

System Requirements Review Preliminary Design Review Jarret Allen Luis Cintron Michael Kubacki Robert Skinner Project Overview 2 Project Overview Smart Phone Compatibility with a USB Storage Device Objective: