Beyond Lists and Guides

Size: px

Start display at page:

Download "Beyond Lists and Guides"

Joleen Jefferson
5 years ago
Views:

1 Beyond Lists and Guides Using Usability to Help Students Get the Most Out of E-Resources Amy Fry, Electronic Resources Coordinator Bowling Green State University

2 BGSU Project Identify best practices Recommend updates based on these Implement updates Test updated pages with users

3 BGSU s All Research Databases Landing Page

4 BGSU s Databases A-Z List

5 Business Databases-by-Subject List

6 Resource Record for Business Source Complete

7 Databases A-Z list Databases-by-subject lists Full resource records Software Discovery layer or federated search Link name Order of databases-by-subject lists Use of icons/graphics

8 Other surveys of ARL libraries Cohen and Calsada (2003) Found that 66 of 114 academic ARLs used database-driven webpages to present their e-resources in Shorten (2006) Found that 88.6% of ARL libraries had databases A-Z lists in 2003, and 10.5% also categorized them by type. Caudle and Schmitz (2007) Found that 97% of the 99 American academic libraries in ARL had a databases A-Z list, 96% had databases-by-subject lists and 27% had federated searching.

Type of system Homegrown: 71.1% Type of system # of libraries %* Homegrown 81 71.1% Metalib 14 12.3% Innovative 8 7% LibGuides 4 3.5% Xerxes 4 3.

9 Type of system Homegrown: 71.1% Type of system # of libraries %* Homegrown % Metalib % Innovative 8 7% LibGuides 4 3.5% Xerxes 4 3.5% WebFeat % LibData 1 <1% *Percentages are based on 114 libraries (excluding 7 national/special libraries and 4 libraries whose databases pages were behind a login)

Type of system Metalib: 12.3% Type of system # of libraries % Homegrown 81 71.1% Metalib 14 12.

10 Type of system Metalib: 12.3% Type of system # of libraries % Homegrown % Metalib % Innovative 8 7% LibGuides 4 3.5% Xerxes 4 3.5% WebFeat % LibData 1 <1% Metalib at Yale University

Type of system Innovative (III): 7% Type of system # of libraries % Homegrown 81 71.1% Metalib 14 12.

11 Type of system Innovative (III): 7% Type of system # of libraries % Homegrown % Metalib % Innovative 8 7% LibGuides 4 3.5% Xerxes 4 3.5% WebFeat % LibData 1 <1% Innovative (III) at the University of Western Ontario

Type of system LibGuides: 3.5% Type of system # of libraries % Homegrown 81 71.1% Metalib 14 12.

12 Type of system LibGuides: 3.5% Type of system # of libraries % Homegrown % Metalib % Innovative 8 7% LibGuides 4 3.5% Xerxes 4 3.5% WebFeat % LibData 1 <1% LibGuides at the University of Louisville

Type of system Xerxes: 3.5% Type of system # of libraries % Homegrown 81 71.1% Metalib 14 12.

13 Type of system Xerxes: 3.5% Type of system # of libraries % Homegrown % Metalib % Innovative 8 7% LibGuides 4 3.5% Xerxes 4 3.5% WebFeat % LibData 1 <1% Xerxes at New York University

Types of access # of libraries % Databases A-Z 111 97 Databases-bysubject

14 Types of access # of libraries % Databases A-Z Databases-bysubject lists Full resource records All three Queen s University

Types of access # of libraries % Databases A-Z 111 97 Databases-bysubject lists

15 Types of access # of libraries % Databases A-Z Databases-bysubject lists Full resource records All three University of Missouri-Columbia

16 Types of access # of libraries % Databases A-Z Databases-bysubject lists Full resource records All three Full resource record from SUNY Buffalo

18 Order of subject lists Subject list order # of libraries % By relevance % By format 7 7.7% Alphabetical only %

Order of subject lists Subject list order # of libraries % By relevance 38 41.

19 Order of subject lists Subject list order # of libraries % By relevance % By format 7 7.7% Alphabetical only % Full text databases for Art SUNY Albany

20 Order of subject lists Subject list order # of libraries % By relevance % By format 7 7.7% Alphabetical only % Metalib at Northwestern University

21 Use of icons and graphics Libraries using icons or graphics: 64 (56%) Icon Access restrictions 38 More information 27 Full text 9 Magnifying glass (Metalib: search in database) # of libraries 5 Tutorials 4 Funding source 3 Format (audio, etc.) 3 Plus sign (Metalib: add to a set) 2 Social media 2 Metasearch 2 Logo/screenshot 2 RefWorks 1 New 1 Plus-star 1 SFX 1

24 Name of Link Link title begins with # of libraries % Examples Databases 47 41% Databases (30), Databases A-Z (8) Articles % Article Databases (4) Articles & Databases (8) E or Electronic % E-Resources (7), Electronic Resources (5) Find 8 6.8% Find Articles (3) Find Articles & Databases (1) Research 8 6.8% Research Databases (3) Search 4 3.4% Search & Find (2), Search a Database (1) Indexes 2 1.7% Indexes & Databases (1) Indexes & Databases (Articles) (1) Journal 2 1.7% Journal Articles (2) Branded names 2 1.7% Vera: E-Journals & Databases UGA Other 4 < 1% each Resource Gateway Resources More Databases All Databases A-Z and Database Finder Online Research Resources (Databases)

25 BGSU resource records: changes implemented summer 2009 new old

26 Databases-by-Subject lists: changes implemented summer 2009 new old

27 ISO definition of usability: The extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use. Five attributes: Ease of learning Efficiency of use Memorability Error frequency and severity Subjective satisfaction

28 Lehman & Nikkel, 2008 Foster & Gibbons, 2007 Krug, 2006

29 Other library usability studies Hammill (2003) Did common task testing with 52 users at Florida International University Libraries, including finding a named database. Krueger, Ray and Knight (2004) Did common task testing with 134 users at the University of the Pacific Library. Fuller, Livingston, Brown, Cowan, Wood and Porter (2009) Did three rounds of testing with five users each on the databases pages at the University of Connecticut Libraries.

30 Linda Rich Reference Coordinator, Bowling Green State University Libraries, and co-investigator for our usability study.

31 BGSU usability study timeline Identify goals (December 2009) Complete Human Subjects Review Board (HSRB) training (January 2010) Submit HSRB application, including script, recruitment materials, consent form (January 2010) Obtain funding for incentives (January 2010) Test the instrument (February 2010) Recruit participants (February 2010) Complete the testing (February-March 2010) Analyze results (March-April 2010) Present findings and recommendations (April-May 2010)

33 Format of the Study Part I: the home page (on paper) Part II: five tasks on the computer Part III: the databases pages (on paper) Part IV: Likert scale for research guide names Part V: open-ended questions

34 Part I

35 Links I ve used before / # students chosen EBSCO 9 OhioLINK Catalog 9 Course Reserves 7 My Library Account 7 All Research Databases 5 Hours 5 BGSU Libraries Catalog Search box for catalog 4 4 E-Journals, etc. 3 By Course (Class Web Pages) 2 Jobs at the Library 2 11 other links chosen once each

36 Links I find confusing / # students chosen Digital Resource Commons 8 ILLiad 8 News links 5 WorldCat 5 A-Z Library Website Index 4 RefWorks 4 E-Journals, etc. 3 Evaluating and Citing Sources 2 17 other links chosen once each

39 Links I ve used before / # students chosen EBSCO 9 OhioLINK Catalog 9 Course Reserves 7 My Library Account 7 All Research Databases 5 Hours 5 BGSU Libraries Catalog Search box for catalog 4 4 E-Journals, etc. 3 By Course (Class Web Pages) 2 Jobs at the Library 2 11 other links chosen once each

40 Student descriptions of the All Research Databases link: List of subjects for databases Locating academic resources for papers List A-Z, JSTOR, ARTstor JSTOR, Dissertations, LexisNexis

41 Usability Study, Part II Task 1: find a named book (given title and author last name) Task 2: find scholarly articles on (your topic) Task 3: find another source for scholarly articles on (your topic) Task 4: find a named database Task 5: find a named journal article (given an APA-formatted citation)

43 Task 1: find a named book Session # Starting point Initial search # tries Successful? Session 1 Search box for catalog Title 2 Yes Session 2 Search box for catalog Title 3 Yes Session 3 Reserves Title 2 Yes Session 4 Search box for catalog Title & Author 1 Yes Session 5 Search box for catalog Author 4 Yes Session 6 BGSU Libraries Catalog link Title 9 Yes Session 7 Search box for catalog Title 3 Yes Session 8 Search box for catalog Title 7 Yes Session 9 Search box for catalog Title & Author 2 Yes Session 10 BGSU Libraries Catalog link Title 1 Yes Session 11 Advanced Search link Title 1 Yes Session 12 Search box for catalog Title 3 Yes Session 13 Search box for catalog Title 2 Yes Session 14 A-Z Library Website Index Title 3 Yes Session 15 BGSU Libraries Catalog link Author 2 Yes

44 Task 2: find scholarly articles on your topic Session # Starting point # tries Successful? Session 1 EBSCO link on home page 1 Yes Session 2 EBSCO link on home page 1 Yes Session 3 E-journals, etc. 6 No Session 4 All Research Databases 1 Yes Session 5 EBSCO link on home page 1 Yes Session 6 EBSCO link on home page 1 Yes Session 7 EBSCO link on home page 1 Yes Session 8 All Research Databases 1 Yes Session 9 EBSCO link on home page 1 Yes Session 10 EBSCO link on home page 1 Yes Session 11 EBSCO link on home page 1 Yes Session 12 EBSCO link on home page 3 Yes Session 13 EBSCO link on home page 1 Yes Session 14 EBSCO link on home page 1 Yes Session 15 EBSCO link on home page 1 Yes

45 Task 3: find another source for scholarly articles Students who knew how to complete this task Session Strategy Starting point 2 Accessed a known DB All Research Databases 4 Accessed a known DB All Research Databases 9 Accessed a known DB EBSCO link on home page 11 Accessed a known DB All Research Databases 12 Accessed a known e-journal OhioLINK EJC 14 Accessed a known DB Course guides Students who did not how to complete this task but were successful Session Strategy Starting point 3 Used the subjects on the All Research Databases page and chose the first one in her subject list 7 Used the subjects on the All Research Databases page and chose a DB she recognized 8 Googled her topic and Springer Google 10 Used the E-Journals link to find a scholarly journal in his subject area All Research Databases All Research Databases E-Journals

46 Task 3: find another source for scholarly articles Students who could not successfully complete this task Session Strategy Starting point 1 Chose an inappropriate subject and resource from the All Research Databases page 6 Chose an inappropriate subject from the All Research Databases page then became lost in the catalog 13 Browsed by subject under E-Journals E-Journals 15 Chose an inappropriate resource from the All Research Databases page E-Journals, then All Research Databases All Research Databases E-Journals, then All Research Databases

48 Task 4: find a named database Students who successfully completed this task Session Starting point Ending point # tries Successful? 2 Databases A-Z list Yes 7 Databases A-Z list Yes 9 Databases A-Z list Yes 11 Databases A-Z list Yes 4 Databases-by-subject lists Yes 15 Databases-by-subject lists Yes 3 Databases-by-subject lists Search box for catalog 2 Yes 1 Search box for catalog Yes 10 Search box for catalog Yes 6 E-Journals, etc. link All Research Databases title search box 14 All Research Databases page 4 Yes Google 3 Yes

49 Task 4: find a named database Students who could not successfully complete this task Session Starting point Ending point # tries Successful? 5 E-Journals, etc. link All Research Databases page 2 No 8 Databases-by-subject lists Google 2 No 12 A-Z Library Website Index No 13 Databases-by-subject lists No

50 Task 5: find a named article Chosen as initial starting point Link # tried # successful E-Journals, etc. 6 3 EBSCO 4 4 Catalog 2 1 All Research Databases 2 0 Google 1 1 Successful path Link # successful EBSCO 4 Google 4 E-Journals, etc. 3 Catalog 3 Not successful 1 Chosen as search Search # used as first search # successful with this search Article title 7 5 Author 5 2 Journal title 3 7

51 BGSU s All Research Databases Landing Page

52 BGSU s Databases A-Z List

53 Business Databases-by-Subject List

54 Resource Record for Business Source Complete

55 I try to avoid this page. -- graduate student

56 I m not sure what these are. I feel like I should know this. -- graduate student I d probably quit after I got this. -- undergraduate student

57 If I were a business major, I would definitely use this page. -- undergraduate student

61 Important fields # Description 14 Dates 10 Full text 7 License information 6 Subjects 6 Title (resource name) 5 Local contact 4 Coverage load 2 Resource format 2 User support 2 Five other fields chosen once each I usually pay attention to dates and descriptions. Confusing fields # Mobile access 10 Coverage load 6 On-campus access 4 Index to journal articles 3 License information 2 Subjects 2 User support 2 Three other fields chosen once each Do I do all this down here, too? (about coverage load) Unimportant fields # User support 3 Local contact 2 Public note 2 Title (resource name) 2 Authorized users 1 Coverage load 1 Description (long) 1 Index to journal articles 1 MIS (in record) 1 Mobile access 1 Subject 1 I don't pay attention to certain things but that doesn't mean they shouldn't be in there.

62 Conclusions Students stick with what they know.

63 Conclusions Students stick with what they know. Students do what their professors tell them to do.

64 Conclusions Students stick with what they know. Students do what their professors tell them to do. As long as you can search for anything, you can search for it.

65 Conclusions Students stick with what they know. Students do what their professors tell them to do. As long as you can search for anything, you can search for it. Google is powerful.

66 Conclusions Students stick with what they know. Students do what their professors tell them to do. As long as you can search for anything, you can search for it. Google is powerful. Subject lists are for librarians.

68 Recommendations Get specific

69 Recommendations Get specific. + Use relevance ranking.

71 Recommendations Get specific. + Use relevance ranking. Implement a discovery layer!

73 View slides/contact me:

Usability Testing for E-Resource Discovery: How Students Find & Choose E-Resources Using Library Websites

Bowling Green State University ScholarWorks@BGSU University Libraries Faculty Publications University Libraries 9-2011 Usability Testing for E-Resource Discovery: How Students Find & Choose E-Resources