Data Citation Update
Transcript of Data Citation Update
Data Citation UpdateDavid Kernohan
Image: dkernohan (cc-by)
02/05/2023
Contents
» Data download metrics» Collaboration» Understanding citation
Jisc Journal Research Data Policy Registry
02/05/2023
IRUS for Research Data
» Added compatibility with Figshare – brought in four new institutions (Salford, Sheffield, Loughborough, Cranfield).
» Compatibility with Elsevier PURE – still teething troubles.
» Pursuing discussions with Thompson Reuters (Converis)
» Ongoing work on API (based on SUSHIlite)
Jisc Journal Research Data Policy Registry
02/05/2023
Collaboration (1)
»Linked to ongoing NIH-supported BioCaddie project, hosted by the Force11 Collaboration
»Aimed at developing an implementation pathway for the JDDCP principles…
The Data Citation Implementation Pilot (DCIP)
Jisc Journal Research Data Policy Registry
02/05/2023
Collaboration (2)
»International group managed by Counter – aims to codify practice for research data downloads
»“Making Data Count” is a collaborative project led by California Digital Library, PLOS and DataOne.
http://mdc.lagotto.io
COUNTER/MDC/Jisc Research Data sub-group
Jisc Journal Research Data Policy Registry
Complexities of Citation
This section draws on unpublished work commissioned by Jisc from Cameron Neylon. For preference, please cite from Cameron’s final report rather than this presentation.
Citation and referencing are central
» Citation is one of the few universal practices across all of research
» Important (some would say too important) in research evaluation
» An important component of how researchers see their own work
➤ Not surprising that citation is seen as a tool for developing, implementing, and promoting policy.
» Examples include citation advantage for OA, making sure preprints are “citeable”, data and software citation
We don’t understand citation and referencing
1.Why do we account appearance in a reference list, not the number of times an article is referenced?
2.Why do we award a full count to all authors of an article rather than dividing up the credit? What is the best way to divide it up?
3.Are all citations equally valuable? Is a citation from a highly cited paper worth more or worth less?
02/05/2023
Why is this important for data citation?
» Citation practices have developed over centuries – there are strengths but also flaws..
» These lead to serious issues around the way citations are used for recognition.
» Similar questions are frequently posed in mainstream scientometrics.
» RD metrics gives us a “blank slate”: a chance to develop a more useful system.
Jisc Journal Research Data Policy Registry
02/05/2023
What is citation? What is it for?
Jisc Journal Research Data Policy Registry
Normative motivations• Recognising
contributions• Assigning credit• Providing supporting
evidence
Social Constructivist Motivations• Pleasing referees and
editors• Creating community
identity• Persuasion, reputation
building
Related to generally understood community expectations of behaviour and culture in the creation of knowledge
Related to unstated or unrecognised social and contextual behaviour that is not connected to knowledge creation
Defining Contexts for Motivations
Consensus in referencing community
Literalness(consistency ofmeaning between referred work and referencing work)
LowLow
High
High
Misattribution,Reinterpretation,Idiosyncratic negative,Revolutionary
Substantive, organicCreative connection,Unusual quotation
Perfunctory, ceremonial,Common direct quoteConventional interpretation,Paradigmatic
Ritual negative,Common misattributionConventional transformationObliteration by incorporation
Adapted from Small (2004), Scientometrics, 60(1): 71-79
Citation and referencing are complex
These are challenging problems because:» There are many different activities» By many different agents (people, organisations…)
» With many different motivations
There is no one thing which is “citation” done by a single group for a single purpose, but many different activities, by different people, with multiple and differing motivations.
Who•Authors•Journals•Indexes•Evaluators
What•Referencing•Formatting•Collecting Citations•Generating metrics
Why•Rules•Norms•Persuasion•Identity
Citation and referencing are complex
A general framework for understanding will have to integrate how different actors (the who) do a range of different things (the what) and what incentives and motivations affect (and effect) those practices (the why)
Defining Contexts for Motivations
Consensus in referencing community
Literalness(consistency ofmeaning between referred work and referencing work)
LowLow
High
High
Misattribution,Reinterpretation,Idiosyncratic negative,Revolutionary
Substantive, organicCreative connection,Unusual quotation
Perfunctory, ceremonial,Common direct quoteConventional interpretation,Paradigmatic
Ritual negative,Common misattributionConventional transformationObliteration by incorporation
Adapted from Small (2004), Scientometrics, 60(1): 71-79
Defining Contexts for Motivations
Consensus in referencing community
Literalness(consistency ofmeaning between referred work and referencing work)
LowLow
High
HighMisattribution,Reinterpretation,Idiosyncratic negative,Revolutionary
Substantive, organicCreative connection,Unusual quotation
Perfunctory, ceremonial,Common direct quoteConventional interpretation,Paradigmatic
Ritual negative,Common misattributionConventional transformationObliteration by incorporationSocial Constructivist Motivations
Normative Motivations
Adapted from Small (2004), Scientometrics, 60(1): 71-79
That gives us who and why but not what
»This has been a problem in the past›Are we talking about the author adding the reference (in the text, in the bibliography?) the journal having restrictions on what’s citeable (or how many citations are permitted), or the work of the indexor in creating the citation?
»We need a way of being precise about what is being done at each stage of a complex process.
Meaningfulness over the course of process
Info
rmat
ion/
Mea
ning
Citation
Citation count
H-indexReference
02/05/2023
Meaningfulness over the process
» Is this the same for data citation?
»How do the two edges connect?
Jisc Journal Research Data Policy Registry
Signs and References: Pierce’s Sign Triad
Sign-vehicle
ReferantInterpretant
Adapted from the work of CS Pierce
Signs and References: Pierce’s Sign Triad
Sign-vehicle
ReferantInterpretant
In text reference
Work referred toMeaning in context
Reference
Signs and References: Pierce’s Sign Triad
Bibiliography entry
Work referred toMeaning in context
Reference Citation
Citation (in index)
Connection (Absent) referring text
A references transformed to a citation
Bibliography entry
Work referred toMeaning in context
Reference Citation
Citation (in index)
Connection (Absent) referring text
Indicator
Drawing on work by P Wouters and others
05/02/2023
02/05/2023
Further work
»Expand and develop the semiotic approach to carefully define the processes occurring in the citation life cycle. Place these processes in their social, cultural and technological context to identify how community norms and individual choices affect them.
»Support the development of large scale open datasets that support large scale analysis of the context and manipulation of references and citations eg conduct a literature wide analysis of citation contexts
»Expand both of these to include new forms of target referent (data, software, online materials)
»Develop the semiotic approaches to provide a sound basis for a theoretical framing of data and analysis quality issues.
Jisc Journal Research Data Policy Registry
Follow the project
» blog: https://rdmetrics.jiscinvolve.org/ » webpage:
https://www.jisc.ac.uk/rd/projects/research-data-metrics-for-usage » IRUS portal available to users (images above)02/05/2023Title of presentation (Insert > Header & Footer > Slide > Footer > Apply to all) 25