Usability as an Assessment Method: An introduction that examines how usability studies can provide u

1
Usability as an Assessment MethodAn
introduction that examines how usability studies
can provide useful evidence to inform
decision-making

• Information Services Assessment Council
• May 11, 2006

2
assessmentan ongoing process in which services,
resources and performance are measured against
the expectations of users, and improvements are
made to satisfy user needs effectively and
efficiently.
3
What do we need to know?
4
Who can tell us?
5
How can we get the information?
6
What will it enable us to do?
7
How much will it cost?
8
ISO standard

• ISO 9241-11 (1998) Guidance on Usability defines
  usability as
• The extent to which a product can be used by
  specified users to achieve specified goals with
  effectiveness, efficiency and satisfaction in a
  specified context of use.

9
Usability Testing

• A means for measuring how well people can use
  a web page (or a computer interface, document, or
  device) for its intended purpose.

10
Benefits of Usability Testing

• Better user experience
• Better understanding of users
• Lower support costs

11
Conduct a Usability Study When

• Designing a new user interface
• Re-designing an existing interface
• Results will inform specific decisions
• Time and other resources permit

12

• Test early and often

13
Usability Testing Process

• Specify objectives
• Identify tasks
• Get permission from HSCL
• Decide method of capturing results
• Recruit participants
• Choose a facilitator
• Conduct tests

14
Usability Testing Process cont.

• Analyze and report results
• Identify problems and possible solutions
• Do another round of testing to determine if your
  solutions work

15
Specify Objectives

• What do you want to learn?
• How will the information be used?

16
Identify tasks

• Test important features
• Test areas where you expect problems
• Test your assumptions

17
Recording methods

• Observers taking notes
• Note takers and video recording
• Screen capture software
• Software that combines screen capture and video

18
Recruiting Participants

• 3-4 participants per study
• Recruit loosely and grade on a curve.
• - Steve Krug

19
Facilitation

• Get their consent
• Make it clear that youre testing the site, not
  them
• Encourage them to think out loud

20
Analyzing results

• Can they find their way around?
• Look at task completion times
• Watch for head slappers and shocks
• Remember, youre seeing their best behavior

21
Reporting results

• Report problem areas to developers
• Test possible solutions to make sure the chosen
  solution works
• Do a presentation to tell everyone how much
  usability testing improved your site

22
Usability Testing Resources

• Jeffrey Rubins Handbook of Usability Testing
• Steve Krugs Dont Make Me Think! A Common Sense
  Approach to Web Usability
• Steve Krugs site, www.sensible.com

23
Information Services Assessment Council members

• Susanne Clement, Libraries
• Jill Glaser, IT
• Ryan Papesh, NTS
• Thelma Simons, IT
• John Stratton, Libraries
• Bill Myers, IS

24
Call on ISAC members to

• Consult, advise and assist in the development of
  assessment initiatives.
• Identify other campus resources for
  assessment-related services.
• Provide oversight and assure coordination with
  other IS assessment activities.

25

• Assessment presentations available at
• www.informationservices.ku.edu/assessment/