1 11-20-14/Greenberg Metadata Quality and Capital Disseminators and Service Providers November 20,...

1 11-20-14/Greenberg

Metadata Quality and Capital

Disseminators and Service ProvidersNovember 20, 2014

Jane GreenbergProfessor, College of Computing & InformaticsDirector, Metadata Research Center


Your data is only as good

as your metadataMetadata is a first class object

Toothbrush


The topic…

Good enough is not bad (DRYAD)(DRYAD)

ROI – return on investment (CAPITAL)(CAPITAL)

RDA – Research Data Alliance (COMMUNITY)…. time permitting(COMMUNITY)…. time permitting


Pre-populated metadatafield


Data downloads reuse citation

Observations, motivating study of metadata capital1.Metadata generation costs money

2.Metadata reuse is a BIG a BIG part part of Dryad’s workflow3.Metadata reuse via OAI4.Metadata reuse via data sharing, reuse, and repurposing

Download 10678 times

Journal Re.Wrkfl

Blackout

AmNtrl N NMBE N NBioRisk Y NBMJ Open

Y N

…. Y

Type Total 30 days

Data packages 6781 198

Data files 20832 957

Journals 361 72

Authors 24166 3312

Downloads 635348 37611

• Journals (80+…PLOS): http://datadryad.org/pages/integratedJournals

• X >10GB = $15,$10+

http://datadryad.org/pages/integratedJournals




TechnologyDSpace DOIs via CDL/DataCiteCC0 (<m> + data)Integration with specialized repositories and databasesFederated searching with TreeBASE and KNB LTERTreeBASE submission (OAI-PMH)GenBank (currently in development)

Governance““non-profit status, 12 non-profit status, 12 member Board of Directors”member Board of Directors”

Sets policy, goals•science, journals, societies, OCLC, MS

2006 Dryad development – NESCent +<MRC>•Stakeholders: journals, publishers and scientific societies, and researchers.

2009-2012: Interim Board

$ PAYMENT-Sept. 1,2014


Singapore Framework

Dryad DCAP, ver. 3.0bibo (The Bibliographic Ontology)dcterms (Dublin Core terms)dryad (Dryad) DwC (Darwin Core)

Vision1.Simple: automatic metadata gen; heterogeneous datasets *Data-package centric2.Interoperable: harvesting, cross-system searching 3.Semantic Web compatible: sustainable; supporting machine processing

Greenberg, et al, 2009, Metadata Best Practice for a Scientific Data Repository, JLM, DOI:10.1080/19386380903405090.


Metadata research & developmentMetadata research & development1.Curation workflow - cognitive walkthroughs2.Dryad metadata scheme development - crosswalk analyses (Dube, et al, 2007; Carrier, et al, 2007; White et al., 2008, Greenberg, et al, 2010; Greenberg 2009; 2010)3.Metadata reuse - content analysis (Greenberg, IDCC Research Summit, 2010) 4.Instantiation - multi-method study (comprehensions assessment) (Greenberg, RDAP, 2010, UNAM 2012)5.Name-authority control - exploratory study (Haven, 2009, INLS 720)6.KO/metadata community practices - Concurrent triangulation mixed methods (survey + simulation experiment) (White, 2010, ASIST, 2010 JLM)7.Metadata functions - quantitative categorical analysis (Willis, Greenberg, and White, 2010, CODATA, 2012, JASIST) 8.Vocabulary needs (HIVE) (HIVE) – mapping study (Greenberg, 2009, CCQ; Scherle, 2010, Code4Lib)9.Metadata theory – deductive analysis (Greenberg, 2009)

Interoperability slope

Semantic ontologies

Researcher names

Agency/institution

Package metadata harvested from email

Subj. 177 (gr. 97%, rd. 2%, bl. 1%)

Contr. 101 (gr. 99%, bl. 1%)


The leap - capital to metadata capital

An economic concept (Weber, 1905; Smith’s, 1776) • Business and operations (net gains or losses)• Finances, goods and services, and public needs• Intellectual capital, social capital• a tangible result, value increase

Metadata as an asset, a product • Reuse of good quality metadata increase

value of initial investment• Poor quality may reduce metadata capital ?

• Metadata reuse prevalence • Cooperative cataloging , CIP, ISBD, MARC, FRBR,

LCC, VIAF, OAI-PMH, CrossRef, PubMed, Zotero, BibTex, DataCite. Linked data/Semantic Web, PIDs, etc.

Modified Capital-sigma notation

Reuse

nR + ∑ ai = R + a1 + a2 +a3 + …an

i=1R = value of the metadata recordi= number of usagesa = incremental increase in valuen = maximum number of reuse


Author/Submitter | Curator

100 metadata instantiations•8 of 12 metadata properties had reuse @ 50% or greater•5 of 8 confirmed reuse at• 80% or higher. •Basic bib. vs. complex

Author

Subject

Dcterms.spatial

DwC.ScientificName

Modified Capital-sigma notation for linked data linked data

Reuse of linked data concept/URI

P = Determined by the number of terms in an ontology, labor hours to generate, integrate, etc,

25

Helping Interdisciplinary Vocabulary Engineering (HIVE)HIVE)

C V cost, interoperability, and usability constraintsC V cost, interoperability, and usability constraints Linked Open Vocabulary initiative, to support inter/transdisciplinary…. SKOS (a little dumb) AMG + machine learning approach for integrating discipline terminologies


~~~~Amy~~~~Amy

Meet Amy Zanne. She is a botanist.

Like every good scientist, she publishes, and she deposits data in Dryad.

Amy’s dataAmy’s data


Successive growth rates

N∑ ic = Θ (nc +1) i=1

Cycles…

What about successive growth rate tied to a concept? A concept can be

• in ~ vernacular to canonical• fall by the wayside, less popular• out (deprecated)


Conclusion…other Valuation Approaches

Market cap of Facebook per user: $40 – $300 Revenues per record per user: $4 – $7 per year

• Facebook• Experian

Market prices of personal data:

• $0.50 for street address• $2.00 for date of birth• $8 for social security number• $3 for driver’s license number• $35 for military record

SOURCE: OECD. Exploring the Economics of Personal Data: A Survey of Methodologies for Measuring Monetary Value. OECD Digital Economy Papers. Office for Economic Cooperation and Development Publishing, 2013.

Concluding remarks

Interest….traction Limitations: bad data,

cost/value We should care about

cost Metadata capital can

contextualize Generic formula for

further research


Metadata Standards Directory Working Group….

Jane Greenberg, Alex Ball, Keith Jeffery, Rebecca Koskela


“…develop a collaborative, open directory of metadata standards applicable to scientific data”Stakeholders: Researchers, data managers, data scientists, tool developers, repositories, agencies, societies (RDA’s growing community)

Goals and workplan - DCC Disciplinary Directory: http://www.dcc.ac.uk/resources/metadata-standards


Acknowledgments Dryad Consortium Board, journal partners, and data authors NESCent: Laura Wendell (Executive Director), Hilmar Lapp,

Heather Piwowar, Peggy Schaeffer, Ryan Scherle, Todd Vision (PI)

**Drexel/UNC <Metadata Research Center>: Jose R. Pérez-Agüera, Sarah Carrier, Elena Feinstein, Lina Huang, Robert Losee, Hollie White, Craig Willis, Jane Smith, Shea Swuager, Liz Turner, Christine Mayo, Adrian Ogletree, Erin Clary

U British Columbia: Michael Whitlock NCSU Digital Libraries: Kristin Antelman HIVE: Library of Congress, USGS, and The Getty Research

Institute; and workshop hosts Yale/TreeBASE: Youjun Guo, Bill Piel DataONE: Rebecca Koskela, Bill Michener, Dave Veiglais, and

many others British Library: Lee-Ann Coleman, Adam Farquhar, Brian Hole Oxford University: David Shotton


http://datadryad.org http://blog.datadryad.org http://datadryad.org/wiki

http://code.google.com/p/[email protected]

Facebook: Dryad Twitter: @datadryad

http://ils.unc.edu/mrc/hive/ http://code.google.com/p/hive-mrc/

Metsdata Reserch Center: http://cci.drexel.edu/mrc

http://datadryad.org http://blog.datadryad.org http://datadryad.org/wiki

http://code.google.com/p/[email protected]

Facebook: Dryad Twitter: @datadryad

http://ils.unc.edu/mrc/hive/ http://code.google.com/p/hive-mrc/

Metsdata Reserch Center: http://cci.drexel.edu/mrc


Sustainability: Plan Comparison

Payment Plan Member Non-member Minimum purchase

1. Voucher Plan USD$65 per data package

USD$70 per data package 25 vouchers

2. Deferred Payment Plan

USD$70 per data package

USD$75 per data package 1 yr contract

3. Subscription Plan

Annual fee based on USD$25 per published research article

Annual fee based on USD$30 per published research article

2 yr contract

For individuals:Pay on acceptance NA

USD$80 per data package, payable by the submitter

1 data package


More on grown and sustainability Membership: http://datadryad.org/pages/

membershipOverview Pricing and sponsorship of

deposits: http://datadryad.org/pages/pricing

Journal integration: http://datadryad.org/pages/

journalIntegration

1 11-20-14/Greenberg Metadata Quality and Capital Disseminators and Service Providers November 20,...

Documents

Transcript of 1 11-20-14/Greenberg Metadata Quality and Capital Disseminators and Service Providers November 20,...