Successful Web Survey Methodologies for Measuring the Impact of Networked Electronic Services MINES

1
Successful Web Survey Methodologies for
Measuring the Impact of Networked Electronic
Services (MINES for LibrariesTM)

• Brinley Franklin and Terry Plum
• August 18, 2005

2
Overview

• Issues in Web-Based Surveys
• Open Access Beyond Vendor Supplied Data
• An Infrastructure of Assessment
• The Assessment Gateway
• MINES for LibrariesTM
• MINES for LibrariesTM in North American Libraries

3
Issues in Web-Based Surveys

• Vendor Supplied Data
• International Standards for vendor supplied data
  (like Project Counter) are helpful and trusted
• Vendor supplied data tends to be gross usage
  counts
• Usage Surveys
• Can go beyond gross usage counts using sampling
• Have sets of issues that must be addressed (see,
  for example, Holly Gunn, Web-based Surveys
  Changing the Survey Process, First Monday, Issue
  7, 2002 and D.A. Dillman, Mail and Internet
  Surveys, The Tailored Design Method. 2nd ed.,
  2000)

4
Open Access --Beyond Vendor Supplied Data

• ISO standards for the electronic collection
  include e-books, electronic databases, ejournals,
  and digital documents. Free internet resources
  are counted separately.
• Other electronic resources are important,
  including
• Digital libraries
• Pre-print and post-print servers
• Open access journals
• Open access repositories (e.g., institutional
  repositories)

5
An Infrastructure of Assessment
6
The Assessment Gateway
7
MINES for LibrariesTM

• MINES is a transaction-based research methodology
  consisting of a web-based survey form and a
  random moments sampling plan.
• MINES typically measures who is using electronic
  resources, where users are located at the time of
  use, and their purpose of use.
• MINES was adopted by the Association of Research
  Libraries (ARL) as part of the New Measures
  toolkit in May, 2003.
• MINES is different from other electronic resource
  usage measures that quantify total usage (e.g.,
  Project COUNTER, E-Metrics) or measure how well a
  library makes electronic resources accessible
  (LibQualTM).

8
MINES for LibrariesTM
9
Demographics by Location of UserU.S. Main
Libraries
MINES for Libraries
On Campus, Not in the Libraryn 6,391
Inside the Libraryn 9,172
Off-Campusn 4,953
10
MINES for Libraries
Demographics by Location of User U.S. Medical
Libraries
Off-Campus n 5,133
On Campus, Not in the Library n 19,582
Inside the Library n 6,819
11
MINES for LibrariesTM
Demographics by Location of User Ontario Council
of University Libraries
On Campus, Not in the Library n 7,090
Off-Campus n 9,163
Inside the Library n 4,047
12
MINES for LibrariesTM
Location of Electronic Resources Users
U.S. Main Libraries Total Usersn 25,698
U.S. Medical Libraries Total Users n 31,883
OCUL (Canada) Libraries Total Usersn 20,300
13
Successful Web Survey Methodologies for
Measuring the Impact of Networked Electronic
Services (MINES for LibrariesTM)

• brinley.franklin_at_uconn.edu
• terry.plum_at_simmons.edu
• http//www.minesforlibraries.org