 |
|
University Library Usability Activities Summary: 2003-2006
The library began usability activities in late 2003. We began by inviting students and faculty to participate in a focus group to re-design the home page. Our activities have primarily been focused on the library's home page, access to resources from the home page, and one study focusing on our Research Guides.
2003 Focus Group View Full Report
Background
Twenty-two library web site users met with us to review four prototypes for a new home page and to find out what they felt were the strengths weaknesses of the site. We wanted to know what features and functions had to be preserved in our redesing, and what aspects could be altered and what things were inconsequential.
Findings
- there were too many choices offered on the current design
- graphical icons were highly recognized and valued
- the users were drawn to graphics and color first
- the users would appreciate more "user-centered" features
- the users were enthusiastic and receptive about a new homepage design
Study Questions
- What are the top 3 links you use most often on the GSU Library Homepage?
- What topics catch your eye first on the homepage as designed now?
- What do you like about the homepage design now?
- What don’t you like about the homepage design now, and what do you think can be done to improve it?
- Which design (out of 4) do you prefer most and why?
- Which design do you prefer the least and why?
- What topics catch your eye first on your preferred design?
- What don’t you like about the new designs and what do you think can be done to improve them?
2004 Home Page Prototype Studies (Round 1 Round 2)
Background
Twenty-five students participated in two rounds of testing of our prototype study of the new home page. We built the prototypes from the suggestions and preferences provided by students and faculty in our 2003 focus group study. The conclusions drawn from analysis of the usability test results support the following:
Findings
- The users had no problem identifying the preferred homepage links for 3 out of 10 questions.
- Users had a serious identification problem for navigation terms associated with finding a subject librarian—although they made a reasonable connection with the choices offered.
- The other issues are mostly likely due to the participant's unfamiliarity with online services, library services, or library technologies.
- Users had no problem performing 2 out of 5 tasks given; 2 of the remaining tasks involve third party applications used by the library and out of our control.
- Future design recommendations for new GSU Library homepage based on the test results include:
- Better terminology regarding “Ask a Librarian”, “Research Guides”, and “Contact Us” and the related information behind these links.
- An online tutorial to supplement the in-class tutorial offered by GSU Libraries, specifically tailored to online users and corresponding online library services.
The users had no problem identifying the preferred homepage links for the following information:
- finding articles online
- finding the GSU Library hours, department phone #, and related information
- determining if a book is available for checkout
The users had no problem performing the following online tasks:
- Locating the current GALILEO password
- Finding out why one might NOT be able to renew a book
The most serious Identification problem for navigation terms occurred with Finding the Biology Reference Librarian’s office hours
The other identification problems may stem from users being unfamiliar with the library services. This may be countered by a help section or online tutorial.
The most serious task performance issues occurred with Finding the Psychology Reference Librarian’s name and e-mail address.
The other task performance problems may stem from the third party applications with the GSU Library website. The ones featured in this study to perform database searching and course reserves access are beyond the direct control of Georgia State University.
Study Questions
- Which navigation link would you select to find information about the following topics?
- Finding articles online
- Current GALILEO password
- Map/Directions to GSU Library
- How to get started doing research for a Biology paper
- Library hours during Exam Week
- If a book is available or checked out
- Materials on reserve for a class
- Circulation Desk Phone Number
- Office hours of the Biology Librarian
- Getting a book not owned by Library
- Locate the current GALILEO password.
- Find out the name of the Psychology librarian and his or her e-mail address.
- Find a database that might have full-text articles on the topic of Education.
- Find a list of items on reserve for Laura Burtle’s African American Studies class (AAS1000).
- Find a reason why you might NOT be able to renew your book online.
ROUND TWO
Changes made to the prototype for Round 2 testing included:
- GSU link added to the utility menu
- Ask A Librarian page was redesigned to include a link to the list of our Subject Librarians. (NOTE: this change demonstrably fixed a usability issues discovered in the April usability test).
- Created a new "Off-Campus / Passwords" icon button to replace the Passwords text link formerly placed in the utility menu.
- Added the Ask A Librarian icon button in the masthead.
- Added the Student Links to the utility menu
- Combined the "Renewing Materials" link into the page behind "Borrowing Items"
Combined the "Maps/Directions" link into the page behind "Visitor Info" - Added "How do I..?" to the Find Information menu
Findings
- The users had no problem identifying the preferred homepage links for 4 out of 10 questions.
- Users had a serious identification problem for navigation terms associated with "finding a video on Shakespeare" —although they made reasonable connections with the choices offered.
- The other issues are mostly likely due to unfamiliarity with library services and systems, usability issues present in applications not under library website control, the nature of the user’s information seeking behavior, or lack of clarity in some of the usability test questions.
- Users had no problem performing 2 out of 5 tasks given; 2 of the remaining tasks involve third party applications used by the library and out of our control.
- More work is needed on the link label terminology and associated content of interior pages. Most notably the content found via "Books", "Articles", "Journals", "Contact Us", and "Hours"
- An online tutorial to supplement the in-class tutorial offered by GSU Libraries, specifically tailored to online users and corresponding online library services, should be available.
- The users had no problem identifying acceptable homepage links for the following information:
- Get Maps or Directions to GSU Library
- See if the library has a certain book
- Email a librarian to get help with your research
- Find the office hours of the Psychology librarian
- The users had no problem performing the following online tasks:
- Find out the name of the History librarian and his/her email address
- Find a reason why you might not be able to renew a book
- The most serious Identification problem for navigation terms occurred with Find a video about Shakespeare. The other identification problems may stem from users being unfamiliar with the library services and tools. This may be countered by supplemental help sections or the development of an online tutorial on using the library.
The most serious task performance issues occurred with the following:
- Get the GALILEO password.
- The call number begins with HC435. In what building and on what floor is this item located?
- Find a journal article about management trends in business.
- NOTE: These task performance problems may stem from external applications linked to from the GSU Library website. The GIL and GALILEO interface design, function, and usability are beyond the direct control of Georgia State University and outside the goals of this study. Tasks for this study are deemed successful or acceptable if participants choose links that would result in resources or results related to the task.
Study Questions & Tasks
- What would you click on to…?
- Find and print out the full text of an article from the Journal of Cell Biology
- Get the GALILEO password
- Get Maps or Directions to GSU Library
- Start doing research for a English paper
- Find a video about Shakespeare
- See if the library has a certain book
- Email a librarian to get help with your research
- Find out how to cite a resource for your paper in APA style
- Find the office hours of the Psychology Librarian
- Get a book not owned by GSU Library
- Tasks:
- Locate the current GALILEO password.
- Find out the name of the History librarian and his or her e-mail address.
- Assume you are taking a class in an area new to you (mathematics, women’s studies, geography, or communications). When the professor assigns a paper to you, how would you find out about information resources in that subject area?
- You searched the online catalog and found a book that you need. The call number begins with HC435. In what building and on what floor is this item located?
- You checked out a book but are not ready to return it. Find a reason why you might NOT be able to renew the book’s checkout period online.
- Find a journal article about management trends in business.
Action Items
After the second round we were satisfied that our re-design was acceptable for public launch. We provided a link to the old home page during the following semester as a transitional option for users. Anecdotal evidence suggests that our design is of interest to other libraries and a few students have offered comments in support of the design. However, there is no quantitative or qualitative evidence that our design has improved efficency, effectiveness in student learning.
2004 Research Guides (View Full Report)
Background
Our first foray into studies beyond the home page was with our Research Guides which are developed by our subject liaions librarians. We had recently implemented a content management system to aid the development and maintenance of our guides and wanted to test the interface and menuing with students. The study involved 9 students who were asked task based questions while viewing the research guide.
Findings
- Increase the visibility of Research guides on the home page. There are several ways this can be done:
- Move the research guides from its current location and place it along with GIL and Galileo with the title “Research Guides” and the caption “Browse by Subjects”.
- Create a separate section on the Home page under the heading “Research Guides” containing links to key research guides.
- Leave the research guides link as it is but create a “mouse over” capability that shows an expanded list of subjects. Mouse over capability can help pack a lot more information and provide direct access to some of the research guides. It also serves as an advertisement for the research guides.
- Use a Mouse over capability to once again pack as much information as possible in the Research guide Menu page.
- Use a Yahoo like interface with the main subject and several sub subject guides. Enlarge the search and make it search the research guide content as opposed to merely the title (similar to site search but restricted to the research guides).
- Since the users were searching for information in the main section as opposed to where the information currently resides (in the left navigation bar), it is evident that the “How Do I” needs to be shifted to the main section. The users once again were looking for the information in the main section of the page as against the left navigation section. “Subject and Course Guides” needs to be moved to the main section of the page.
- Once again the users are looking for information in the main section. Restrict the navigation bar to links that enable horizontal navigation (between 2 sites like Related guides) or vertical navigation (to the Research guides Menu). All other features in the site need to be on the main section. This may increase the density of content on the main section but it is evident from the study that the users are willing to take the time to sort through the content in the main section while rarely do they try out other sections of the site (like the navigation bar).
- Move the “Suggested Resources” to the main section of the page.
- Move the “Contact” to the bottom of the main section.
- Replace the “Research Guides Menu” with a single page that allows hierarchical navigation yet shows all the guides broken down by subject. This can be done in the following manner:
- Use a Mouse over capability to once again pack as much information as possible in the Research guide Menu page.
- Use a Yahoo like interface with the main subject and several sub subject guides.
- The navigation and layout of the research guides require to be changed. The following are the key findings of the study.
- The Home page needs to portray the existence of the research guides functionality. Several recommendations have been listed under Task 1 for accomplishing this objective.
- The research menu needs to portray the existence of all the research guides while enabling hierarchical navigation. The search function needs to be emphasized and enhanced to search the content.
- The layout of the research guides needs to be revamped.
- All information needs to be on the page. Move information components (like Subject and Course guides) to the main section of the page.
- Use navigation bar to streamline navigation to related guides and research guide menu.
- Add search function (similar to the search on the research guide menu).
- Use the main section to portray as much information possible about what the research guides can do and reduce emphasis on actual content (like putting a link to EBSCOHOST).
- Move Contact to the Navigation bar.
- Increase focus on presentation, improve the color and enhance the graphics.
Study Questions & Tasks
- You are writing a paper on the topic of African Art. What would you click on to begin?
- You have a paper for a class in Sociology. What would you click on to begin?
- You have a paper for a class in Journalism? What would you click on to begin?
- You have a paper on the topic of “hip-hop”. What would you click on to begin?
- You need information on locating music scores. What do you click on to begin?
- You are looking for information on Latin American Art. What do you click on to begin?
- You are looking for a chemical dictionary. What do you click on to begin?
- You are looking for web sites that might help in your research. What do you click on to begin?
- What person is responsible for this page?
- Take the participant to the Research Guides main menu short list. Show them the navigation section on the page and how it opens up different types of lists. Ask them to surf around a bit with the menus and then explain their preferences and thoughts on the menu hierarchies and navigation.
Action Items
During the process of prototyping it became evident that there are essentially 2 approaches to redesigning the research guides. Further discussion and analysis of this study is recommended for the creation of action items.
Incremental Approach
This approach assumes that one site with some modifications can serve two sets of patrons – Students and Librarians.
- Create prototypes using the results of the study
- Study the usability of the prototypes
- Implement the results
Start from the basics approach.
This approach stems from the belief that the students are the primary patrons of the research guides. Therefore the research guides need to be designed with the students in mind. Currently it is unclear as to who the primary patrons are since the research guides contain information not valuable to the students yet is extremely valuable to the other patrons namely the librarians. Librarians use the research guides for 2 additional purposes:
- Share content with other librarians
- Virtual Storage area: Use the research guides to store information that may be needed for classes.
The approach will result in 2 (virtual) sites, one catering to the students and another catering to the librarians. The student site will be a new design based on the needs of the students. The other site will be the existing site or a new site based on the needs of the librarian.
2005 Home Page Button Report (View Full Report)
The study involved testing user preferences and choices with the addition of one home page icon button and an alternative label for the icon used for the List of Databases. The Liaison Department requested an icon button for the Research Guides and provided their goals, purpose, and preferred labels for the UWG to test. The Electronic Resources Librarian provided alternate labels for the List of Databases icon and goals as well.
The Usability Working Group undertook a paper prototype study of 90 students during October 2005. There were 3 versions of the home page to test (the existing page and two prototypes with new icons/labels) and we tested 30 students on each version asking them 3 questions. An additional 30 students were testing using a laptop to see if the paper study skewed the results. The current home page design and two prototypes were developed for the test.
Findings
Participants are equally as likely to choose text links on the left side of the screen as icons in both paper and laptop-based prototypes.
Study Questions & Tasks
- You have to write a paper for your history class. Where would you go to find resources on your topic?
- Your Psychology professor asks you to use research articles in the next paper you write. Where would you go to look for these?
- Where would you go to look for journal articles?
Action Items
- Add an icon button labeled "Start Your Research" on the home page.
- Change the icon label that reads "Find Articles: List of Databases" to "Find Articles & More: Electronic Resources & Database".
- Implement consistent navigation from the home page and between pages for the List of Databases, the Electronic Journal Locator, and any Instructional pages referring or providing access to these applications.
2006 and Beyond
Usability activites that are being planned include a study for the re-design of our Interlibrary Loan page and the menu/page that displays when a user clicks on the home page icon labeled "Start Your Research". We also have a study involving Instant Messaging in the works.
Author: Doug Goans, Web Development Librarian
