Informed Decisions: The Impact of User Testing in the Design of the Online Catalog Eric Novotny Penn - PowerPoint PPT Presentation

1 / 20
About This Presentation
Title:

Informed Decisions: The Impact of User Testing in the Design of the Online Catalog Eric Novotny Penn

Description:

User Studies at Penn State. Initial catalog study 2002. 18 participants. 9 novices, 9 experienced users. 2nd Usability Study 2004. 8 1st year undergraduates ... – PowerPoint PPT presentation

Number of Views:170
Avg rating:3.0/5.0
Slides: 21
Provided by: University204
Category:

less

Transcript and Presenter's Notes

Title: Informed Decisions: The Impact of User Testing in the Design of the Online Catalog Eric Novotny Penn


1
  • Informed Decisions? The Impact of User Testing
    in the Design of the Online Catalog Eric
    NovotnyPennsylvania State University

2
User Studies at Penn State
  • Initial catalog study 2002
  • 18 participants
  • 9 novices, 9 experienced users
  • 2nd Usability Study 2004
  • 8 1st year undergraduates
  • 3rd Usability Study 2005 (ILink)
  • 8 undergraduate users

3
The Tasks
  • Find an item knowing the title
  • Request delivery of a book
  • Locate an issue of an easy journal by title
  • Locate an issue of a hard journal by title
  • Find 4 books on a topic (Efforts to combat teen
    smoking)

4
The Methodology Verbal Protocols
  • Spoken records of people describing their work
    Observations of individuals performing
    designated tasks in real time.
  • 1st used Sullivan and Seiden Educating Online
    Catalog Users Library Hi Tech, v.3 Issue 10
    p.11-19, 1985

5
Why use Verbal Protocols?
  • Overcome inaccuracies in self-reporting
  • Develop mental model of searchers (what they
    think they are doing)
  • Uncovering (some) motivations
  • Identifying problems and (maybe) solutions

6
Methodology - Weaknesses
  • Results not generalizable
  • Expensive method per user
  • May not offer solutions
  • Analysis can be difficult
  • Observation influences what is being observed
  • Observations are subjective influenced by what
    looking for and prior experience

7
Applying Study Results Problem 1 Known Item
searches
  • Browse underutilized in old catalog interface

8
(No Transcript)
9
Goals in New Interface
  • Reduce screen clutter
  • Replace tabs
  • Add Exact option

10
(No Transcript)
11
Problem 2 I Want It
  • E-mail queries and public service personnel
    indicated confusion over how to have an item
    delivered from another Penn State campus.

12
(No Transcript)
13
(No Transcript)
14
Problem 3 Call Links
  • Hypertext highly appealing
  • Serial call links especially problematic

15
(No Transcript)
16
Interface changes
  • Eliminate Call hyperlink
  • Add Browse Nearby Items on Shelf button

17
(No Transcript)
18
Did the Changes Work?
  • Mixed Bag/Work in Progress
  • Increased use of Browse/Exact for known items
  • Made certain types of searches harder
  • Unintended consequences for Monographic records
  • Serials records still complicated

19
Some desirable features still on the Desiderata
List
  • Relevancy Ranking
  • Serial displays
  • Links to interactive maps for call numbers

20
Questions/Comments
  • For additional information contact
  • Eric Novotny
  • Arts and Humanities Library
  • The Pennsylvania State University
  • University Libraries
  • University Park, PA 16802-1803
  • U.S.
Write a Comment
User Comments (0)
About PowerShow.com