LIBRARY HOMEPAGE PROTOTYPE USABILITY TEST REPORT. Submitted by Dana M. Smith Usability GRA, Library Systems Office

Transcription

1 LIBRARY HOMEPAGE PROTOTYPE USABILITY TEST REPORT Submitted by Dana M. Smith Usability GRA, Library Systems Office

2 CONTACT INFORMATION: For more information about this report, please contact: Dana Smith Usability GRA, Library Systems Office Georgia State University Library Doug Goans Web Development Librarian Georgia State University Library 100 Decatur Street, SE Library North Office 529 Atlanta, GA CHANGE HISTORY: Issue Date Description of Changes Submission of initial report to Doug Goans Final Report Addition of Appendix Material 5/17/2004 2

3 Contents Abstract... 4 Introduction... 5 Background & Premise... 5 Study Objectives... 7 Usability Test Method... 8 Test Results & Analysis Introduction Pre-Test Questionnaire (Demographics) Usability Questionnaire Task Analysis Post Test Interview Conclusions Design Recommendations Appendix A. Homepage Prototype Design Process Appendix B. Usability Test Instruments Appendix C. Test Facilitator Documents /17/2004 3

4 Abstract This document details the GSU Library Homepage Prototype Usability Testing conducted during April 7 th - 15 th Fifteen (15) GSU students (also library website users) participated in usability test sessions held to gather reaction regarding a new Library Homepage Design. This new design and corresponding functional web prototype were developed based on the results from the focus group study held by the Library Systems Office last semester. A graphic of the prototype design is located in Appendix A. The usability test results in this report outline basic demographic information gathered using a presession questionnaire, answers recorded from a questionnaire related to a graphic display version of the new design, and task analysis using the functional web prototype. Responses from a post-test interview were also documented by the test facilitators. Test Facilator observations were recorded as notes during the sessions. All sessions were video recorded for later review by the principal investigator. Copies of the test instruments are located in Appendix B; completed test documentation is located in Appendix D. The conclusions drawn from analysis of the usability test results support the following: The users had no problem identifying the preferred homepage links for 3 out of 10 questions. Users had a serious identification problem for navigation terms associated with finding a subject librarian although they made a reasonable connection with the choices offered. The other issues are mostly likely due to unfamiliarity with online services and users ignorance. Users had no problem performing 2 out of 5 tasks given; 2 of the remaining tasks involve third party applications used by the library and out of our control. Future design recommendations for new GSU Library homepage based on the test results include: Better terminology regarding Ask a Librarian, Research Guides, and Contact Us and the related information behind these links. An online tutorial to supplement the in-class tutorial offered by GSU Libraries, specifically tailored to online users and corresponding online library services. 5/17/2004 4

5 Introduction Background & Premise The GSU Library Web Development Team conducted a focus group study at GSU Library on Friday, December 5 th, Twenty-two (22) library website users participated across three (3) focus group sessions to discuss the current homepage design (refer to Figure 2) and four (4) new prototype designs. Results and suggestions from the focus group study included: Offer fewer text link choices. Users struggled to make choices (based on importance or value) because of no visual hierarchy on the home page. The graphics featured in Figure 1 are highly recognized and valued by GSU students and faculty These could possibly be altered (design and color wise), but should NOT BE REMOVED from the home page for the new design. Figure 1: GSU Library Homepage Favored Icons GSU library website users are drawn to graphics and color for navigation and distinguishing between topic sections on pages. GSU library website users are a captive audience (it is necessary for classes and research), but would appreciate more user-centered (student) features less News & events specific; more relevant information like hours of operation should be readily apparent. A One-Sentence Tagline should explain briefly the mission of GSU Library, and tell users what they ll gain from visiting the site. This would be more welcoming and indicative of a home page design. Simple illustrations, boxes, and colors are most helpful; excessive use of underlines is not. Also, users often dismiss elaborate graphics as ads (such SFX@GSU). All participants appreciated the use of graphics and pictures, as long as it was enhancing or reinforcing a message. Overall, the focus group revealed that GSU library website users are enthusiastic and receptive about a new design, as long as it is user-friendly and enhances their ability to get their work done in a timely fashion. Their design preferences lean toward a more sophisticated look that is easy to navigate, visually appealing, and quick to download (regardless of connection speed). These recommendations were used to develop a new homepage design for the GSU Library Website Homepage. This new proposed homepage design is featured in Figure 3: 5/17/2004 5

6 Figure 2: Current GSU Library Homepage Figure 3: Homepage Design Prototype 5/17/2004 6

7 Study Objectives The GSU Library Homepage Prototype Usability Study seeks to discover user reaction regarding the new design and identify areas (if any) for improvement. Usability is the measure of the quality of a user's experience when interacting with a product or system whether a Web site, a software application, mobile technology, or any user-operated device. Usability is a combination of factors that affect the user's experience with the product or system, including *: Ease of Learning: How fast can a user who has never seen the user interface before learn it sufficiently well to accomplish basic tasks? Efficiency of Use: Once an experienced user has learned to use the system, how fast can he or she accomplish tasks? Memorability: If a user has used the system before, can he or she remember enough to use it effectively the next time or does the user have to start over again learning everything? Error Frequency & Severity: How often do users make errors while using the system, how serious are these errors, and how do users recover from these errors? Subjective Satisfaction: How much does the user like using the system? * Source: With regard to the GSU Library Homepage, our usability goals are to increase user productivity and increase the quality of website visits by reducing (or eliminating) user frustration and confusion. The homepage serves as a portal of crucial tools for our faculty, staff, and student body, and must produce a trustworthy and reliable online experience. For these reasons, it is important to determine if this new proposed homepage design is serving audience needs and providing a pleasant user experience before implementation of the design can take place. 5/17/2004 7

8 Usability Test Method Two common web usability inquiry methods were combined for our study: cognitive walkthrough and task analysis. A cognitive walkthrough involves observing and listening to user s behaviors while they execute familiar tasks and having an informal dialogue regarding the web interface tested (for a measure of qualitative results). A task analysis involves scripted scenarios (designed by principal investigator) for users to complete in order to access ease or difficulty. Both usability test methods should be conducted with a minimum of *12-15 participants (maximum of 20) for meaningful test results. *Source: It is important prior to usability testing to identify the most popular features/sections of the webpage in question. With regard to the GSU Library Homepage, the following areas of interest were targeted for testing: Finding general library information such as: o Map/Directions to GSU Library o Library hours of operation o Phone Number and location of important departments (i.e., Circulation Desk) o Contact information and location of subject reference librarians Utilizing library services online such as: o Finding articles, books and other reference materials online o examine if a book is available or checked out o Accessing Course Reserve materials o Online Interlibrary Loan requests We also wanted to capture user attitudes regarding design considerations specific to web interfaces. In particular, we asked users to rate the following webpage attributes from least important to most important with regard to websites in general and specifically with reference to the new GSU Library homepage design: Appealing color & layout design Easy to navigate & understand Useful information & content Meaningful navigation links; correspond to linked information Number of navigation options available Easy to read text/font size Quality of graphics and/or photos Easy access to the features you use most often 5/17/2004 8

9 GSU IRB approval for the Library Usability Test Study was granted in March The usability test sessions were scheduled to take place in the Center for Teaching & Learning, Library South. The sessions were offered at the following days and times, with testing scheduled on the hour: Wed, April 7 th through Fri, April 9 th 9:00am-5:00pm Saturday, April 10 th 10:00am-3:00pm Monday, April 12 th through Thursday April 15 th 9:00am-5:00pm A target of 20 students for recruitment was set. Each participant would receive candy/snacks and a $5 GSU Panthercard applied credit for their time. Participants were recruited from the focus group recruit list (those who indicated interest in the focus group, but did not participate), notices on the library homepage, signs placed in the library, and word of mouth. Upon arriving to the test location and signing in, a participant would do the following: 1. Read and sign the IRB-based informed consent form. The facilitator would also sign the consent form, and make a copy of the form for the participant. 2. Complete the Pretest Questionnaire. This will capture basic demographic information and technology preferences. 3. Next, he/she would complete the Usability Test Questionnaire using a static (non-functioning) display of the prototype for reference. Ideally, this will be an individual printout or monitor display at the participant s workstation. This will ensure testing of home page design items vs. entire website functionality. 4. Next, he/she would complete a Usability Task Analysis using a functional version of the prototype on their workstation. This would test a combination of home page and website functionality. 5. Last, he/she would complete a one-on-one interview by test facilitator. A blank copy of the consent form, pre-test questionnaire, usability questionnaire, task analysis and postinterview are located in Appendix B of this report. It was determined that all testing should occur one-on-one, meaning participants would be individually tested with a test facilitator present during the entire session. Testing in this manner would reduce influences or distractions that could occur during testing multiple individuals at the same time. The test facilitator s role during testing is to answer any questions, record notes and observations during the session, collect the completed documentation, and administer the post-test interview. Test Facilitator Training for GSU staff was conducted on Monday, April 5 th ; corresponding training documentation is included in Appendix C. During the training, three (3) library student workers participated in a practice 5/17/2004 9

10 run of the usability testing, which revealed no issues with the test instruments. This practice was also helpful for the facilitators to understand the particulars involved with testing. Acknowledgements: Dana Smith compiled and analyzed the test results and authored this report. Doug Goans and Dana Smith served as Principal Investigators for this study. Karen Hopkins, Tamla Williams, Patti Lee and Doug Goans served as Usability Test Facilitators. Many thanks go to Harry Dangle and Faye Borthick in the Center for Teaching and Learning, Tim Merrit in the ITC, Mohammad Gharib in the Library Media Center, and Rod Bustos in the Systems Office for assistance with testing facilities and equipment. Denita Hampton helped recruit participants for the pre-test. Laura Burtle, Jake Houle and Doug Goans also provided advisement, expertise, and input on the project overall. 5/17/

11 Test Results & Analysis Introduction The GSU Library Homepage Usability Testing took place between Wednesday, April 7 th and Thursday, April 15th. The number of participants was 15, consisting of 13 undergraduate and 2 graduate students. The following is a description of the average participant, based on the results gathered from the presession questionnaire: Average age between years old Undergraduate student, upperclassman (junior or senior) status Daily Internet user Comfortable with using Internet (self rating Intermediate to Expert) Uses the GSU Library Website on a weekly basis The students who participated in the usability study came from varied educational backgrounds and majors of study. A breakdown of the various majors is featured below: Major Course of Study marketing policy studies hospitality adm lang. studies no response poli sci bus/finance journalism film prod biology/pre-med crim just account. MPA The following sections will describe the data collected from each aspect of the testing. 5/17/

12 Pre-Test Questionnaire (Demographics) The pre-test questionnaire is used to measure user entry behaviors, attitudes and preferences about the Internet and the GSU Library website. # of responses Age Most participants were years of age 2 undergraduates identified and Oldest identified = It should be noted that the 2 graduate students who participated were in the age range. The individuals identifying as older are all undergraduates, and would be considered non-traditional students. 12 Gender Most participants were male, about 60% of the 15. # of responses male female # of responses Student Classification freshman sophomore junior senior grad student All participants were sophomore classification or above, inferring they had experience with GSU s online presence and the Library. 5/17/

13 While students had experience using the library from their GSU academic experience, the data will show not all have significant experience with using the library s online/electronic features and services. # of responses Online Frequency daily weekly monthly All reported using the Internet frequently Although the majority used the Internet on a weekly basis, they are not using the GSU Library Site that frequently. It can be inferred the participants are using the Internet for communication, entertainment, or other purposes. # of responses Internet Proficiency beginner intermediate advanced One participant rated themselves as beginner The rest of the participants feel comfortable using the Internet. Frequent use of the Internet and (self reported) proficiency seem to go hand in hand with these participants. # of responses GSU Library Website Usage daily weekly monthly "rare" "every 3 months" Two participants added the rare and every 3 months categories. Most participants use the Library site on a weekly basis. 5/17/

14 It should be noted that the individual who reported using the GSU Library site rarely was a senior undergrad student, but did not identify a major. This student may just use the brick and mortar library exclusively. # of responses Preferred Computer Platform mac windows unix other Overwhelmingly, Windows is the preferred operating system. It should be noted the individual comfortable with Macs is majoring in Film Production (where Macs are used almost exclusively). The last item on the questionnaire asked participants to rank (from most to least important) given criteria for evaluating a website. There were ten (10) criteria given ranging from website features to aesthetics and design. The following chart illustrates the criteria our participants identified as most important. Web Criteria Ranked Most Important # of responses short download color/layout easy nav useful info working links number of nav easy to read graphics/pics search The participants are clearly in favor of a website having a short download time, easy navigation, and having useful information. Aesthetics were not deemed very important, as gleaned from the next chart: 5/17/

15 Web Criteria Ranked Least Important # of responses short download color/layout easy nav useful info working links number of nav easy to read graphics/pics search The overwhelming response to the least important factor for a website was the quality of graphics or photos; next was the color & layout. One individual selected working links as being least important, which would indicate their standards for web experience are really low, and/or they have a high level of patience for potentially frustrating web experiences. Usability Questionnaire This questionnaire was given with regard to a graphic (JPEG) display of the prototype design. This would allow for users to take into account the navigation terminology, placement and hierarchy within the layout. It would also allow for users to give their first instinctual answer, since they could not actually click on a functional site to verify their answer. Users were asked to identify which link or button they would select from the design to find the given information (phrased in the form of questions). Out of the 10 questions given, 4 of them resulted in consistent, correct answers from our participants. These questions were: Question 1: How would you find articles online? Participants selected either Finding Articles (button) or Articles (text menu link) both would satisfy finding online articles. Question 5: How would you find the GSU Library hours during Exam Week? All but one participant selected Hours (text menu link); one person selected About the Library both would yield the correct information. Question 6: How would you determine if a book is available for checkout? 5/17/

16 Most users selected Find Books (button) or Books (text menu link); 3 participants did choose Borrow Materials (text menu link) Question 8: How would you find the phone # for the Circulation Desk? All but one participant selected Contact Us (text menu link) which would yield the desired information. One person selected Ask A Librarian (text menu link). The other questions drew varied responses. They are discussed in more detail in the following charts. It should be noted that the correct answers are really the preferred answers given by GSU Library. There is usually more than one path to the desired information. These correct answers are the best (shortest) path to the information requested. Note: For the charts, B = Button, U = Utility Menu, M = Text menu # of responses Question 2: Current GALILEO Password B: Search GALILEO U: Passwords M: Student Services B: Find Books Apparently participants made the association the Galileo link would give the desired information; this is actually incorrect. The correct answer is Passwords only 4 people selected this. This misconception could be due to users unfamiliarity with using GALILEO (and the password). Question 3: Map/Directions to Library # of responses M: Visitor Info M: Contact Us M: About the Library M: More (About Library) The correct answer is Visitor Info ; however the other About Library choices may yield the desired information. 5/17/

17 Contact Us should imply contact information (such as phone, address, ). This may be a good place to provide a redundant or supplemental link to map/directions from (or near) where the address information is located. Question 4: Starting Biology Paper Research # of repsonses The correct answer is Research Guides, which the majority of participants selected. 0 M: Research Guides M: Ask a Librarian Search Box B: Finding articles B: Search GALILEO The other choices could yield the desired information for Biology research, however the route may be more time-consuming. # of responses Question 7: Course Reserve Materials M: Course Reserves M: Special Collections B: Find Books (GIL Online Catalog) M: Ask a Librarian Again, the majority picked the correct answer ( Course Reserves ), but the varied responses indicate unfamiliarity with library online services. Question 9: Biology Librarian Office Hours # of responses M: Visitor Info M: Faculty Services M: Ask a Librarian M: Contact Us M: More (About Library) M: Student Services Search Box The correct selection is Research Guides (which no one selected) A second choice is Contact Us 1 user did select this. The majority of users are making a reasonable connection between Ask a Librarian and seeking office hours for a subject librarian. Also, many of the comments recorded during this questionnaire indicated 5/17/

18 most of our participants were not aware of subject librarians, research guides or how either would be useful. Question 10: Getting a book not at GSU Library # of responses M: Library Service M: Interlibrary Loan M: Borrow Materials M: Contact Us M: Find Information B: Search GALILEO M: Books The correct selection is Interlibrary Loan, which the majority of participants selected. The most plausible explanation for the varied answers is that most participants were not aware of how to use Interlibrary Loan (or did not understand or recognize the terminology). Task Analysis The usability task analysis featured the functional version of the prototype at the participant s workstation. This tested a combination of home page design and website functionality, since the rest of the website kept the current design. This was also an opportunity to gather opinions on other features not operated by GSU Libraries, such as GIL, GALILEO, or ERes. Tasks 1 and 5 were easily handled by users. Each task was completed quickly (based on average time calculated from all responses), and had a high rate of correct responses. A summary of the task details and responses is featured below: Average Time to Complete Task Percentage of Correct Responses Task 1: Locate the current GALILEO password minutes 87% Task 2: Find out why you might NOT be able to renew a book minutes 93% For Tasks 2, 3, and 4, the time to complete the task was varied among all participants, indicating a measure of difficulty. Despite being slower, the correct response rate was fairly high for Tasks 3 and 4; 5/17/

19 Task 2 had a correct response rate of 60%. Typically, a correct response rate of 80% indicates suitable usability and understanding. The varied completion time are illustrated below: ID #235 ID #231 ID #230 ID #220 ID #165 ID #150 ID #110 ID #100 ID #90 ID #70 ID #50 ID #40 ID #30 ID #20 ID #10 Task 2: Psychology Librarian Name & time (minutes) ID #235 ID #231 ID #230 ID #220 ID #165 ID #150 ID #110 ID #100 ID #90 ID #70 ID #50 ID #40 ID #30 ID #20 ID #10 Task 3: Education Article Database (Full-Text) time (minutes) 5/17/

20 Task 4: AAS1000 Course Reserve ID #235 ID #231 ID #230 ID #220 ID #165 ID #150 ID #110 ID #100 ID #90 ID #70 ID #50 ID #40 ID #30 ID #20 ID # time (minutes) Post Test Interview The responses given during the post test interview were very favorable and appreciative of the new homepage design. Average responses are detailed below; users were asked score each criteria between 1 (low) and 5 (high). GSU Library Homepage Criteria Average Score appealing color & design 4.13 easy to navigate & understand 4.00 useful information & content 4.57 navigation links correspond to information 4.37 # of navigation options available 4.57 easy to read text/font size 4.37 quality of graphics and/or photos 4.10 easy access to most popular features /17/

21 Conclusions The following conclusions can be drawn from the usability test data collected: GSU Library Website users liked the new homepage design. The overwhelming preference was for the structured text link menus. By using these links, there was less dependence on the 4 button/icon navigation options and even feedback indicating they needed to be updated (design wise). The users had no problem identifying the preferred homepage links for the following information: finding articles online finding the GSU Library hours, department phone #, and related information determining if a book is available for checkout The users had no problem performing the following online tasks: Locating the current GALILEO password Finding out why one might NOT be able to renew a book The most serious Identification problem for navigation terms occurred with the following: Finding the Biology Reference Librarian s office hours The other identification problems may stem from users being unfamiliar with the library services. This may be countered by a help section or online tutorial. The most serious task performance issues occurred with the following: Finding the Psychology Reference Librarian s name and address The other task performance problems may stem from the third party applications with the GSU Library website. The ones featured in this study to perform database searching and course reserves access are beyond the direct control of Georgia State University. 5/17/

22 Design Recommendations The following design suggestions are recommended: Better terminology regarding Ask a Librarian, Research Guides, and Contact Us and the related information behind these links. An online tutorial to supplement the in-class tutorial offered by GSU Libraries, specifically tailored to online users and corresponding online library services. Add the Georgia State University (GSU) main website link to the utility menu (currently WebCT GoSOLAR Passwords ) Change the Passwords link name to something more intuitive (this may require soliciting suggestions from users). Suggestions include library passwords, off-campus access passwords Also include information about where to look up the current GALILEO password after selecting the GALILEO link (if possible). Provide multiple access (links) to information about Reference/Subject Librarians. For instance, many student sought this information under Ask a Librarian, which is a reasonable deduction however, the corresponding info is not currently there. Include candid photos of students using the library along with the renderings of the new library facilities. 5/17/

23 Appendix A. Homepage Prototype Design Process Prototype #1: Prototype #2: 5/17/

24 Prototype #3: Prototype #4: 5/17/

25 Prototype #5: FINAL Usability Test Prototype Design: 5/17/

26 Appendix B. Usability Test Instruments Spring 2004 Usability Test Questionnaire 1 Which navigation link would you select to find information about the following topics? 1. Finding articles online 2. Current GALILEO password 3. Map/Directions to GSU Library 4. How to get started doing research for a Biology paper 5. Library hours during Exam Week 6. If a book is available or checked out 7. Materials on reserve for a class 8. Circulation Desk Phone Number 9. Office hours of the Biology Librarian 10. Getting a book not owned by Library 5/17/

27 2 Spring 2004 Usability Test Task Analysis Task (1): Locate the current GALILEO password. Task (2): Find out the name of the Psychology librarian and his or her address. Task (3): Find a database that might have full-text articles on the topic of Education. Task (4): Find a list of items on reserve for Laura Burtle s African American Studies class (AAS1000). Task (5): Find a reason why you might NOT be able to renew your book online. 5/17/

28 Spring 2004 Usability Test Post Interview (to be administered by test facilitator): 3 Please rate the new homepage prototype using the criteria below: 1 = Poor 2 = Below Average 3 = Average 4 = Good 5 = Excellent 1. Appealing color & layout design Easy to navigate & understand Useful information & content Navigation links correspond to information Number of navigation options available Easy to read text/font size Quality of graphics and/or photos Easy access to most popular features /17/

29 Appendix C. Test Facilitator Documents Spring 2004 Usability Test Task Analysis Script and Steps for Test Facilitators SETUP Turn on Laptop and set the home page to the IMAGE ONLY version. Clear the browser history cache. Make sure videotape is ready to go. Make sure students have their PantherCard and keep it handy ( they might need it for the first hands-on task with the active site). STEP 1. All participants must read, sign, and date the consent form. Ask if they want a copy. STEP 2. Ask for PantherCard ID to make a copy (photocopy or digital camera shot) so we may put a $5 PantherCash gift on it for participating. 5/17/

30 STEP 3. Read the following to them: Hello. Thank you for participating in our web site usability study. My name is, and I work for the GSU Library. I will be asking you some questions today about our new library home page that is being built. We want to make sure the new library home page is usable and that you are able to find information to help you with your research and class assignments. Therefore, I will be asking you some questions, which you will answer by looking at and using the new home page. The whole study should not take any longer than 40 to 50 minutes. I will be writing down important points you bring up while using the new home page. To make sure we capture all your suggestions, we need you to talk out loud. More importantly, let us know when you re stuck or if something does not make sense. As you us the home page, some of the links may not work as intended since this is a mock-up, or test version of the new home page. I will clue you to stop searching or to move on to the next task if this happens. Keep in mind that we are testing this new design of the library home page, not you! If you find that something does not make sense or the answer isn t obvious, this is the necessary information we need to make changes. Do you have any questions? 5/17/

31 STEP 4. Ask them to fill out the demographic survey. STEP 5. Bring up the IMAGE version of the new home page (added to the favorites list on the laptop) STEP 6. Conduct the 10 question test. They can refer to the list while you fill out your form. Record their selections and any comments they make STEP 7. Bring up the WORKING version of the new home page (set as default home page on the laptop) STEP 8. Conduct the 5 task test. They can refer to the list of tasks while you fill out your form. Ask them to begin and to let you know when they find the answer to the task and when they are moving on to the next task. Record the time they start and end, which links they use and any comments they make. If 5 minutes have passed but they have not completed a task prompt them to move on to the next task. Explain that you will follow up on that task in a post-test interview later. If they are silent you may inquire as to what they are thinking, what parts of the page they are looking at, and so forth. Ask open ended questions to get them to talk (not just questions where they would answer yes or no). STEP 8. Conduct the post-test interview. Tell them they may use the site to click and surf if needed to demonstrate anything they want to talk about or show you. They may refer to the list of rating questions while you write down their ratings and any comments. STEP 9. Show them the style preference choices, circle their preference and write any comments they make. STEP 10. Ask them if they have any other questions or comments. Thank them for participating. Deliver all the materials to Doug in the systems office or arrange for him to pick them up at your office. 5/17/

32 1 Spring 2004 Usability Test Questionnaire Which navigation link would you select to find information about the following topics? 11. Finding articles online 12. Current GALILEO password 13. Map/Directions to GSU Library 14. How to get started doing research for a Biology paper 15. Library hours during Exam Week 16. If a book is available or checked out 17. Materials on reserve for a class 18. Circulation Desk Phone Number 19. Office hours of the Biology Librarian 20. Getting a book not owned by Library 5/17/

33 Spring 2004 Usability Test Task Analysis Please answer the questions to the best of your ability using the website available. 2 Task (1): Locate the current GALILEO password. Time Start: Time End: Answer found?: Click 1: [ Menu or Button or Other ] Click 2: [ Menu or Button or Other ] Click 3: [ Menu or Button or Other ] Click 4: [ Menu or Button or Other ] Click 5: [ Menu or Button or Other ] Comments: 5/17/

34 Task (2): Find out the name of the Psychology librarian and his or her address. Time Start: Time End: Answer found?: Click 1: [ Menu or Button or Other ] Click 2: [ Menu or Button or Other ] Click 3: [ Menu or Button or Other ] Click 4: [ Menu or Button or Other ] Click 5: [ Menu or Button or Other ] Comments: 5/17/

35 Task (3): Find a database that might have full-text articles on the topic of Education. Time Start: Time End: Answer found?: Click 1: [ Menu or Button or Other ] Click 2: [ Menu or Button or Other ] Click 3: [ Menu or Button or Other ] Click 4: [ Menu or Button or Other ] Click 5: [ Menu or Button or Other ] Comments: 5/17/

36 Task (4): Find a list of items on reserve for Laura Burtle s African American Studies class (AAS1000). Time Start: Time End: Answer found?: Click 1: [ Menu or Button or Other ] Click 2: [ Menu or Button or Other ] Click 3: [ Menu or Button or Other ] Click 4: [ Menu or Button or Other ] Click 5: [ Menu or Button or Other ] Comments: 5/17/

37 Task (5): Find a reason why you might NOT be able to renew your book online. Time Start: Time End: Answer found?: Click 1: [ Menu or Button or Other ] Click 2: [ Menu or Button or Other ] Click 3: [ Menu or Button or Other ] Click 4: [ Menu or Button or Other ] Click 5: [ Menu or Button or Other ] Comments: 5/17/

38 Spring 2004 Usability Test Post Interview (to be administered by test facilitator): 3 Q1. What is your favorite thing about the new homepage prototype? Q2. What is your least favorite thing about the new homepage prototype? Please rate the new homepage prototype using the criteria below: 1 = Poor 3 = Average 5 = Excellent 2 = Below Average 4 = Good 1. Appealing color & layout design 2. Easy to navigate & understand 3. Useful information & content 4. Navigation links correspond to information 5. Number of navigation options available 6. Easy to read text/font size 7. Quality of graphics and/or photos 8. Easy access to most popular features 5/17/

39 Spring 2004 Usability Test Style Preference (to be administered by test facilitator): 4 (this link is in the Favorites list on the laptop) Circle their preference and write down any comments. Style # 1 ( what they have been using) Style #2 5/17/