INTERFACE USABILITY EVALUATION FOR DIGITAL GOVERNMENT RESEARCH CENTER (DGRC) - PowerPoint PPT Presentation

Loading...

PPT – INTERFACE USABILITY EVALUATION FOR DIGITAL GOVERNMENT RESEARCH CENTER (DGRC) PowerPoint presentation | free to download - id: e2440-ZDc1Z



Loading


The Adobe Flash plugin is needed to view this content

Get the plugin now

View by Category
About This Presentation
Title:

INTERFACE USABILITY EVALUATION FOR DIGITAL GOVERNMENT RESEARCH CENTER (DGRC)

Description:

First DGRC Interface: Original Interface (Link) Second DGRC Interface: Fisheye Interface (Link) ... Zoom In, Zoom Out (Link) Searchlight (Link) Content Visualization ... – PowerPoint PPT presentation

Number of Views:50
Avg rating:3.0/5.0
Slides: 31
Provided by: jul50
Category:

less

Write a Comment
User Comments (0)
Transcript and Presenter's Notes

Title: INTERFACE USABILITY EVALUATION FOR DIGITAL GOVERNMENT RESEARCH CENTER (DGRC)


1
(No Transcript)
2
(No Transcript)
3
(No Transcript)
4
(No Transcript)
5
Methodology Flowchart - Past
Stage One
Timeline
Start of DGRC Project (Link)
Fall 1999
First DGRC Interface Original Interface (Link)
Evaluation Started
Fall 2001
Development of Evaluation Plan (Link)
Second DGRC Interface Fisheye Interface (Link)
Responses To Fisheye Interface (Link)
Analysis of DataGate Interface (Link)
  • Interview of Experts (Link)
  • Define Users
  • User Needs, Behaviors, Preferences, Reactions

6
Methodology Flowchart - Present
Timeline
Stage Two
Formative-Illuminative Evaluation (Link)
Spring 2002
  • Resource Analysis on Census Data (Link)
  • Interview Experts for Census Data Analysis
  • Fisheye Interface Research
  • Innovative Designs with Fisheye Applications
  • Componential Analysis on Fisheye Features
  • (Link)

Census Characteristics and Interface
Possibilities (Link)
Refine Heuristics for GUI
In Progress
Present
User and Environment Profiles
Design User and Task Analysis
7
Methodology Flowchart - Future
Timeline
Stage Three
Fall 2002
Development of Future Plans (Link)
  • Perform User and Task Analysis
  • Think Aloud
  • Interview with Heuristics

Prototype Testing
Usability Testing
Summative Evaluation With Questionnaire
8
About the Project
  • Project Description
  • Video Clip
  • Project Description (Judith Klavans)
  • Rationale for Evaluation (Judith Klavans)
  • Project Presentation
  • Video Clip
  • Project Presentation (Surabhan Temiyabutr)
  • Screen Shot
  • Old DGUI
  • New DGUI
  • Gummy Bear Show
  • Websites
  • DGUI
  • Old Gummy Bear Show
  • Colorful Gummy Bear Show

9
Development of Evaluation Plan
  • Goals of Evaluation
  • optimize the effectiveness of the interface,
  • identify usability problems,
  • provide feedback on the overall functionality,
  • anticipate changes in user need that might drive
    future development,
  • validate the design,
  • indicate the extent to which the interface
    improves on previous interfaces.
  • Methods
  • Heuristics
  • User and Task Analysis

10
Heuristics for Database Interface
  • Usability inspection method targeting interface
    design by judging
  • compliances to principles for successful design.
  • Design
  • Adapted from existing research on interface
    design
  • Modified for Database
  • Heuristic categories
  • Appearance, Language, Functionality, Structure,
    Assistance
  • Evaluators
  • Library Staff

11
User and Task Analysis
  • Process
  • Task Scenarios
  • Observation
  • Interview
  • Goal
  • User Behaviors
  • User Intuitiveness for Different Groups of Users
  • Strengths and Weaknesses of the Design
  • Participants
  • Content Experts
  • Government Agency Workers
  • Faculty and Students

12
Responses To Fisheye Interface
  • Interviewees
  • EDS librarians
  • Jane Weintrop
  • Nicole Fox
  • Reference Desk librarians
  • Jerry Breeze
  • Alysse Jordan

13
Analysis of DataGate Interface
  • Purpose
  • Understand User Behaviors with Database
  • Query Log Analysis of EDS DataGate by Nicole Fox
  • Flexibility in Choosing Variables
  • Options to Sets of Variables
  • Options to Adjust Individual Variable
  • Keyword Search Search Methods and Syntax
  • All vs. Any
  • And vs. Or
  • Modification of Queries
  • From General to Specific
  • From Specific to General

14
Interview Findings
  • User Type Identification
  • User Goals
  • Kinds of Questions
  • Brief History of Search
  • Types of Searches
  • Related Terms for Searches
  • Selecting the database
  • Learning to Use the Interface
  • Students Searching Styles
  • Searching Styles of Fisheye Design
  • Flexibility to Searching Styles
  • Helping the User Define the Search
  • Standardize Problem
  • Librarians Duty
  • Suggestions for the Fisheye Design

15
Interview Findings
  • User Type Identification
  • Novice and Power/Expert Users
  • Related Terms for Searches
  • Difficulty of Use of Alternative Terms
  • Learning to Use the Interface
  • Innovative Interface
  • Need Orientation and Time to Familiarize with the
    Interface
  • Helping the User Define the Search
  • Help users to Visualize the Context and Structure
    of Information
  • Definition and Redefinition of Search
  • These issues need to be considered in all rich
    databases. All these issues were
  • shared with the team and considered in the
    further development of our
  • heuristics.

16
Formative-Illuminative Evaluation
  • Playing Formative Role with Illuminative Goals
  • Inform Design Decisions
  • Change from Energy to Census data
  • Anchoring the Focus on Census would allow
  • Contribution to Census
  • Testing the Interface with Existing Datasets
  • Data is rich and accessible
  • There is enough of a user knowledge base to test
  • Findings are Transferable to Energy, Labor, or
    other Census data.

17
Resource Analysis on Census Data
  • Census Data Characteristics
  • User (Link)
  • Variables (Link)
  • Presentation Forms (Link)
  • Geographical References (Link)

18
Users
  • Why define users?
  • To Create Task Scenario for User and Task
    Analysis
  • How?
  • Interview Experts
  • Regarding characteristics of PUMS
  • Identify Target Users that
  • Do not require to identify specific small
    geographic areas
  • Have knowledge, access, and time to program and
    process the samples
  • Define Purposes and Tasks that involve
  • Cross-Variables Research
  • Study Relationships among variables not shown in
    existing tabulations
  • Concentrate on the characteristics of
    specifically defined populations

19
User Types
Academic Disciplines Functions Non-Academic General Public
Novice Basic Research Course Assignments Personal Use Residence Relocation
Power/ Expert Research Librarians Researchers cross-variables in research Population Ethnicity Education Marriage Employment Residence Housing Etc. Business Use Marketing
Groups
Expertise
20
Variables
  • Information Organization
  • Hierarchical Structure
  • Massive Amount
  • Terminology
  • Some Variable Definitions Have Changed from
    Census to Census
  • Terminology is Not Always Obvious.
  • For example, there is no one variable for
    ethnicity. Asian ethnicity is coded in the
    detailed race variable, Hispanic ethnicity in the
    detailed Hispanic origin field, and European
    ethnicity in the ancestry variable.
  • Different Census Questions Performed in Different
    Years

21
Presentation Forms
  • Using Geographic Information Systems (GIS)
  • Using Dynamic Query Maps
  • Dynamic Queries http//www.cs.umd.edu/hcil/eosdis
  • Applicable to All Types of Data

22
Geographical References
  • Geographic Boundaries Change Over Time.
  • i.e. Zip codes, definition of blocks
  • Geographic Areas Are Unique to Census
  • i.e. Tracts, Blocks and Block Groups.
  • PUMS 5 Only 100,000 people are included.
  • Geographic Areas Are Identified by Codes.
  • The Same Common Names May Be Used for Different
    Geographic Areas.
  • i.e. New York is a state, metropolitan area, and
    county.

23
Fisheye Interface Research
  • Fisheye Applications
  • Purposes
  • Searching Innovative Designs Using Fisheye
    Features for Reference
  • Explore the Use of the Fisheye Features for
    Usability Analysis
  • Emend Heuristics for Database Interface Using
    Fisheye Features
  • Features
  • Seeing Full Context while Focusing on Selected
    Items
  • Content Visualization (Link)
  • Dynamic Menu (Link)
  • Zoom In, Zoom Out (Link)
  • Searchlight (Link)

24
Content Visualization
  • Information Retrieval While Seeing the Full
    Content
  • PhotoFinder Project http//www.cs.umd.edu/hcil/ph
    otolib/
  • A Hierarchical FocusContext Method for Image
    Browsing http//www.viktoria.informatik.gu.se/grou
    ps/play/demos/hierarchical/

25
Dynamic Menu
  • Demonstration of How the Interface Can Compromise
    Oversized Categories.
  • Magnification on Items with Visual Display of
    Full Content
  • Fisheye Menu http//www.cs.umd.edu/hcil/fisheyeme
    nu/
  • Sony Music 100 Years Soundtrack for A Century
    http//millennium.sonymusic.com/
  • Visualization Menu Jazz http//www.cs.umd.edu/hci
    l/jazz/

26
Zoom In, Zoom Out
  • Being Able to Manipulate the Level of
    Magnification
  • The SmartMoney Map of the Market
    http//www.smartmoney.com/marketmap/
  • The Zoom Browser Applet http//www.viktoria.inform
    atik.gu.se/groups/play/demos/zoombrowser/applet/

27
Searchlight
  • Present Definition of the Selected Items
  • Provide Synonyms
  • Show Relationships Between Terms
  • Example
  • Race \ ethnic origin ancestry \ place of
    birth
  • educational attainment \ highest education
    allocation
  • PUMA (above 100,000) state \ county \
    groups of counties
  • Show Number of Possible Results
  • Notes on the limitations of data. Make the users
    aware of the small area data modification due to
    the confidentiality protection.
  • Display Cross-References Among Different Databases

28
Census Characteristics and Interface Possibilities
  • Variables
  • Hierarchical Structure
  • Massive Amount
  • Terminology
  • Definitions Change
  • Obscure Terminology
  • Census Question Change
  • Geographical References
  • Boundaries Change
  • Unique Boundaries
  • Codes for Areas
  • Various Meanings for Same Names
  • Content Visualization
  • Display Information Organization
  • Dynamic Menu
  • Magnification on Selected Items with Full Content
  • Zoom In, Zoom Out
  • Manipulate the Level of Magnification
  • Searchlight
  • Multiple Layers of Display
  • Alternative Terms
  • Definition of Terms
  • Alternative Pathways
  • Create Dynamic Maps

29
Planning
  • User and Task Analysis
  • Task Scenarios for Different User Groups
  • Prototype Testing.
  • Testing with Heuristics
  • Evaluate with Individual Features
  • How effective is it? Are the results transferable
    to the usability of its totality?
  • Define Minimum Functions in the Stage of
    Development
  • What are the basic criteria? How complete should
    the prototype be in order to get meaningful
    results in functionality?
  • Usability Testing
  • Questionnaire

30
Discussion
  • We would like to invite discussion on experience
    in conducting formative evaluation, which
    provides proper feedback to the design team when
    the design is at its prototype stage.
About PowerShow.com