Webmetrics Workshop
-
Upload
omar-gardner -
Category
Documents
-
view
22 -
download
1
description
Transcript of Webmetrics Workshop
![Page 1: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/1.jpg)
Webmetrics Workshop
American Library AssociationChicago, IL
June 24, 2004
Martha KyrillidouDirector, ARL Statistics and Measurement Program
Association of Research Libraries
www.statsqual.org
StatsQUAL™
![Page 2: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/2.jpg)
www.statsqual.org
ARL Roles
![Page 3: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/3.jpg)
www.statsqual.org
ARL Statistics and Measurement
…To describe and measure the performance of research libraries and their
contribution to
teaching, research, scholarship and community
service …
![Page 4: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/4.jpg)
www.statsqual.org
Web Presence
![Page 5: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/5.jpg)
www.statsqual.org
Future of New Measures Initiative
• Incorporation of some new data elements in traditional surveys
• Development of workshops and consulting services for performance measures
• Establishment of data gathering and statistical analysis tools
![Page 6: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/6.jpg)
www.statsqual.org
What do we mean by E-Metrics within ARL?
• DigiQUAL
• MINES for Libraries
• ARL Supplementary Statistics
• Project COUNTER
![Page 7: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/7.jpg)
www.statsqual.org
It’s…? “familiar” and digital
![Page 8: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/8.jpg)
www.statsqual.org
Developing DigiQUAL Survey Items
• Background: ServQUAL ->LibQUAL ->DigiQUAL– LibQUAL dimensions of library service quality
DigiQUAL: 12 themes of DL service quality
Accessibility Collection building DL as community for users Copyright
Navigability Resource use ...developers Role of federations
Interoperability Evaluating collections ...reviewers DL sustainability
![Page 9: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/9.jpg)
www.statsqual.org
Building a Survey (cont.)
CustomizeSurvey
Issue: Flexibility vs. Standardization
![Page 10: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/10.jpg)
www.statsqual.org
Implementing Survey - Incentives
Issues: must be easily transferable, requires email address - clear IRB
![Page 11: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/11.jpg)
www.statsqual.org
What is MINES for Libraries™
• MINES is a research methodology consisting of a web-based survey form and a sampling plan.
• MINES measures who is using electronic resources, where users
are located at the time of use, and their purpose of use.
• MINES was adopted by the Association of Research Libraries (ARL) as part of the “New Measures” toolkit in May, 2003.
• MINES is different from other electronic resource usage measures that quantify total usage (e.g., COUNTER, EQUINOX, E-Metrics, ICOLC Guidelines, ISO and NISO standards) or measure how well a library makes electronic resources accessible (LibQual+TM).
![Page 12: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/12.jpg)
www.statsqual.org
MINES for Libraries™ Methodology
• A representative sampling plan, including sample size, is determined at the outset. Typically, there are 48 hours of surveying over 12 months at a medical library and 24 hours a year at a main library.
• Random moment/web-based surveys are employed at each site.
• Participation is usually mandatory, negating non-respondent bias, and is based on actual use in real-time.
• Libraries with database-to-web gateways or proxy re-writers offer the most comprehensive networking solution for surveying all networked services users during survey periods.
![Page 13: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/13.jpg)
www.statsqual.org
![Page 14: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/14.jpg)
www.statsqual.org
What do we mean by E-Metrics within ARL?
• DigiQUAL
• MINES for Libraries
• ARL Supplementary Statistics
• Project COUNTER
![Page 15: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/15.jpg)
www.statsqual.org
BackendDatabase
o Data Extraction & Normalization
o Library and Vendor Profiles
o Report Request and Generation
o Usage Aggregation
o Comparison
User Interface
VariousData
Elements
DatabaseQuery &
DataRetrieval
Figure1. Key Processes for a Central Repository for Vendor Usage Statistics
UsageStatistics
UsageStatistics
UsageStatistics
UsageStatistics
![Page 16: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/16.jpg)
www.statsqual.org
BackendDatabases
o Data Extraction & Normalization
o Library and Vendor Profiles
o Report Request and Generation
o Usage Aggregation
o Comparison
User Interfaces
VariousData
Elements
VariousData
Elements
DatabaseQuery &
DataRetrieval
Figure2. Key Processes for Decentralized Repositories forVendor Usage Statistics
UsageStatistics
UsageStatistics
UsageStatistics
UsageStatistics
o Report Request and Generation
o Usage Aggregation
o Comparison
o Data Extraction & Normalization
o Library and Vendor Profiles
DatabaseQuery &
DataRetrieval
![Page 17: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/17.jpg)
www.statsqual.org
o Report Request and Generation
o Usage Aggregation
o Comparison
DatabaseVendors
User Interface
Figure 3. Key Processes for Distributed Access to Vendor Usage Statistics
UsageStatistics
UsageStatistics
UsageStatistics
UsageStatistics
Gateway
GatewayWeb Service Request &
Data Retrieval
Gateway
Gateway
![Page 18: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/18.jpg)
www.statsqual.org
Interpreting results from individual libraries in the context of other sites
Analysis & Reporting - Issues
![Page 19: Webmetrics Workshop](https://reader036.fdocuments.us/reader036/viewer/2022081519/568138a8550346895da06738/html5/thumbnails/19.jpg)
www.statsqual.org