Q&A Web Application. Senior Project Test Report 1

Transcription

1 Q&A Web Application Senior Project Test Report 1 November 5, 2013 Department of Computer, Electrical, and Information Technology Indiana University-Purdue University Fort Wayne Student: Adam Frisby Faculty Advisor: Professor Hongli Lou Class Instructor: Professor Paul I-Hai Lin

2 Table of Contents Unit Testing... 2 Performance Testing... 4 Loading Home Page Performance Test P a g e

3 Unit Testing Several unit tests using Revel s built-in testing framework have been written to ensure correct behavior of the web application. Test Suite Test Title Description Result RegistrationTest Test NotUnique Tests whether registration form does not continue and shows error for not being unique. RegistrationTest Test Valid Tests whether registration form does not continue and shows error for not being in a valid format RegistrationTest TestwordMinSize Tests whether registration form does not continue and shows error for password being too short RegistrationTest TestwordReq Tests whether registration form does not continue and shows error for password RegistrationTest TestUserNotUnique Tests whether registration form does not continue and shows error for username not being unique RegistrationTest TestUsernameMaxSize Tests whether registration form does not continue and shows error for username being too long RegistrationTest TestUsernameMinSize Tests whether registration form does not continue and shows error for username being too short RegistrationTest TestUsernameReq Tests whether registration form does not continue and shows error for username RegistrationTest TestUsernameValid Tests whether registration form does not continue and shows error for username being in a valid format (A-Z_) RegistrationTest TestValid Tests whether when given all valid data, whether the form does not error and a new user is created LoginTest TestwordReq Tests whether the login form does not continue and shows error for password LoginTest TestUsernameReq Tests whether the login form does not continue and shows error for username LoginTest TestValidLogin Tests whether given correct data, the user can login LoginTest TestWrongword Tests whether the login form does not continue and shows error for password being wrong 2 P a g e

4 LoginTest TestWrongUsername Tests whether the login form does not continue and shows error for username being wrong LogoutTest TestLogout Tests whether a logged in user can log out ScheduleInterviewTest TestCategoriesReq Tests whether schedule interview form does not continue and shows error for category required ScheduleInterviewTest TestCategoriesValid Tests whether schedule interview form does not continue and shows error for an invalid category selected ScheduleInterviewTest TestDescMaxSize Tests whether schedule interview form does not continue and shows error for description being too long ScheduleInterviewTest TestDescMinSize Tests whether schedule interview form does not continue and shows error for description being too short ScheduleInterviewTest TestDescReq Tests whether schedule interview form does not continue and shows error for description ScheduleInterviewTest TestSchedDateReq Tests whether schedule interview form does not continue and shows error for scheduled date ScheduleInterviewTest TestSchedDateValid Tests whether schedule interview form does not continue and shows error for scheduled date being a valid format ScheduleInterviewTest TestSchedTimeReq Tests whether schedule interview form does not continue and shows error for scheduled time required ScheduleInterviewTest TestSchedTimeValid Tests whether schedule interview form does not continue and shows error for scheduled time is in a valid format ScheduleInterviewTest TestTitleMaxSize Tests whether schedule interview form does not continue and shows error for title being too long ScheduleInterviewTest TestTitleMinSize Tests whether schedule interview form does not continue and shows error for title being too short ScheduleInterviewTest TestTitleReq Tests whether schedule interview form does not continue and shows error for title 3 P a g e

5 Performance Testing Preliminary performance testing has been performed on Amazon EC2 and RDB instances. Loading Home Page Performance Test A ruby script utilizing watir-webdriver to drive Firefox instances to test the performance of the application. The script creates 5 threads. Each thread creates a new instance of Firefox and navigates to the home page every 5 seconds. This allows constant load on the server. This simulates multiple users reading the data from the application. The script was ran for 10 minute and several performance variables were recorded. Results Baseline (No Load) Load Difference Web Server CPU % 0.00% 11.67% 11.67% DB Server CPU % 12.11% 19.32% 7.21% DB Free Memory MB MB 3.3 MB DB Max Write Latency s s s DB Max Read Latency s s s Analyze Assuming the each measure of performance is a linear function of number of users, it is possible to estimate the maximum number of users under these circumstances. Web Server CPU % Max Users Web Server CPU% = (11.67% 0.00%) = 11.67% Web Server CPU% Per User = Web Server CPU% = 11.67% = 2.334%/User 100% = Baseline Web Server CPU% + (Number of Users)(Web Server CPU% Per User) Number of Users = DB Server CPU % Max Users 100% 0.00% 2.334%/User = 42.8 DB Server CPU% = (19.32% 12.11%) = 7.21% DB Server CPU% Per User = DB Server CPU% = 7.21% = 1.442%/User 100% = Baseline Db Server CPU% + (Number of Users)(DB Server CPU% Per User) Number of Users = 100% 12.11% 1.442%/User = 60.9 DB Free Memory Free Memory = MB MB = 3.3 MB 4 P a g e

6 Memory Per User = Free Memory = (3.3 MB) = 0.66 MB/User 0 MB = DB Baseline Free Memory (Number of Users)(Memory Per User) Number of Users = DB Max Write Latency (0.5 second) 0.5 second seconds = = Users DB Max Read Latency (0.5 second) 0.5 second seconds = = 1562 Conclusion MB = MB/User The Web Server CPU Utilization is the limiting factor of the system. If the CPU% utilization is assumed to be linear, the server can handle a total of about 40 concurrent users viewing the home page every 5 seconds. Code require 'watir-webdriver' NUM_THREADS = 5 PAGE = " DELAY = 5 # Starts Firefox and navigate to homepage every 5 seconds def loadhot(num) count = 0 puts "Starting Browser #" + num.to_s() browser = Watir::Browser.new :firefox, :profile => 'watir' while true puts "Loading Page Thread #" + num.to_s() + " Count #" + count.to_s() browser.goto PAGE sleep(delay) count = count + 1 end end # Starts threads threads = NUM_THREADS.times.map { i Thread.new { loadhot i } } threads.each(&:join) 5 P a g e