Heesang Jeon, Principal Product Manager
25th June 2021
SciVal
What have we done and
what’s coming in 2021?
South Korea User Group
• 3 July, 2019
• Robber t jan Kalf fand Chr is Jam es
1. What have we been working on?
2. A view into our kitchen
3. Where are we going?
Agenda
Meet the team
Product team User ExperienceSoftware Development Analytics
SciVal today
• Global market leader
• More than 1,400 customers, across 80 countries. Predominantly academic institutions.
• Strong customer base in China, UK, US, Japan and Australia
• Corporate customers include Unilever, Siemens, Boeing
• Several funding organizations andnational government bodies
• Cover more than 20k institutions in SciVal
Unique Users global + 44% YTD
Data enhancements - 20,225 Institution Profiles to date
We have added ~4,000 profiles in 2020, 1,150 of them were corporate profiles.
Institution
OrgDB
Manualcuration
2ndLineSupport
IPW
Customers/Customer Consultants
10,400
16,070
20,042
6,048 7,061
8,609
1,613
5,044 6,163
2018 2019 2020
Over the last 12 months – 10 releases with over
75 notable release items
Enhanced interface:
• New graphics• Matrix table• Chord diagram
• Roof-shaped matrix• Heatmaps
• Timeline motion chart• Reference lines • Bubble chart
• Draggable wheel tooltips• Improved homepage
New metrics:
• THE Rankings metrics• Open Access analysis• Authorship
• Topics for Research Areas• Scopus Source as a new entity type
Over the last 12 months – 10 releases with over
75 notable release items
• THE World University Rankings 2021
• 112 New Topics and 1 new Topic Cluster
• Update to SDGs + free layer (scival.com/sdg)
• Increase export from 20k to 100k
• Enhancements to import large hierarchies over multiple sessions
• Additional metrics guidance and enhanced Support Center
• Curated Research Areas – including COVID-19 and Quantum tech
• Report templates – share and edit user defined + Word export
• API updates
Let’s take a quick look at the
highlights!Time to go online
1. What have we been working on?
2. A view into our kitchen
3. Where are we going?
Agenda
SciVal’s design principles
Accuracy Flexibility Transparency
Our innovation projects
Customer collaboration Project team Experiments
Interviews (needs & problem)
Testing
Prototype feedback
UX designer
Engineers
Data scientists
Product Manager
Paper experiments
Designs
PrototypesSME
1. What have we been working on?
2. A view into our kitchen
3. Where are we going?
Agenda
We’re playing in a dynamic and exciting market
• The needs of our customers are evolving• Competition is intensifying
1. Increasing competitiveness / high stakes attached to research investment decisions => Strategic Planning Use Case
2. Push for broader impact measures => need to diversify SV beyond
bibliometric indicators
Our Product Strategy addresses these dynamics
Grow the core value proposition
Expansion of baseline data sets
Capability investments
We’re focussing on 9 Innovation themes within these objectives
New module: outside-in perspective for strategic research planning, providing funding insights & benchmarking from funding agency awarded grants
Deeper insights & benchmarking for your university ranking strategyUniversity Ranking
enhancements
Deeper Research Performance analysis
Faster data processing
Custom Area of Research definition & global library
Funding insights & benchmarking
Societal impact insights & benchmarking
New module: insights & benchmarking for societal impact. Policy citations, SDGs and attention metrics likely for MVP, followed by clinical citations
Perform more fine-grained analysis
Handle more data & datatypes. Faster processing of data, more subject classifications, larger limits, etc.
Better define area or analysis, predefined hot topics by editors and customer shared research areas
Onboarding new users
Institution hierarchies
Improved collaboration analysis
Help get new users up to speed quickly. Give content at login. Guide users on responsible use of metrics etc
Easier overviews and benchmarking on the hierarchy within an institution
Discover new collaboration partners by analyzing citation networks
SciVal Roadmap – Summary (subject to change)
Innovation Theme
MVP
NOAM - MVP Region 2 - MVP
MVP
THE WUR 2022
Export report as Word doc
Automated update from OrgDB (Scopus)
Discovery
Problem–Solution fit with 5 col laborating customers
Migration ongoing
Authorship analysis – res group
Problem–Solution fitOpportunity
Q1 Q2 H2
Solution-Market fit
More subject class (BM) onlyFlexible date ranges in Collab
Global l ibrary of research areas(editor defined)
Export to VOSviewer
Discovery & prototyping
New SDGs
University Ranking enhancements
Deeper Research Performance analysis
More scalable, faster and flexible data processing
Custom Area of Research definition & global library
Onboarding new users
Institution hierarchies
Improved collaboration analysis
Funding insights & benchmarking
Societal impact insights & benchmarking
Enhanced customisation Global l ibrary of research areas(customer shared)
Linking Collaboration and
Trends through Topics
22,500 Inst Profiles
More FWCI transparency
Enhanced guidance for new usersA/B TestingDiscovery – Scopus to SciVal
New Topics
OrgID as used by THE (snapshot)
Elasticsearch delivers 70% BM metrics
Additional RAs
Better HQ management
Problems:
Regional Collaboration:
Need
Insights & benchmarking for societal impact
As a research leader I need to demonstrate societal impact to improve the
perception of the university (in the public, international students strategic
international partnerships), to support national assessment impact case studies
and to support grant applications
→ Societal impact is hard to define
→ The main method currently, impact case studies, are extremely labor intensive
→ Baseline data sets still to be defined (policy, attention, media and SDGs)
APAC & MAEU: Problem – Solution fit stage • Define baseline set of organizations,
• First paper experiments,
• Looking for additional candidates
EMLA & NOAM: Problem – Solution fit stage • Needs & problem interviews
SciVal Rankings enhancementsRobust information and transparency around the bibliometrics used in the THE World University Rankings
SciVal Rankings enhancements enable you to:
• Analyze, understand and generate insights based on the actual FWCI and Citation
Scores used to make up 38.5% the THE WUR score, rather than proxies developed
in-house
• Benchmark at the THE subject level for deeper understanding of your university’s
position and to inform faculty and department level plans
• Analyze, benchmark and produce peer comparison reports across all bibliometric
drivers directly in the Benchmarking module
• Analyze the trends in the bibliometric drivers to enrich your understanding and inform
plans accordingly
• Remove the need for manual curation and the development of proxy indicators
SciVal: Robust information and transparency around
the bibliometric dataset considered in 38.5% of the
Overall Score in the THE World University rankings
SciVal Rankings enhancements – complimentary to THE
DataPoints
THE DataPoints: Understanding institutional performance is essential for universities to advance in their strategic goals
and to help them to present themselves in rankings. THE
DataPoints unlocks the data behind the rankings, and
provides visibility of institutions’ performance in a global
context.
Problems:
Regional Collaboration:
Need
Benchmarking funding performance in areas of research, using a baseline set of Funders.
As a research leader, I want a full perspective on funding for our strategic
research planning tasks, so that we can make better investment, hiring and
collaboration decisions
→ External perspective on funding is missing, both regionally & globally
→ Hard to get data about the dynamics at research area (topic) level
→ Information on foundations, corporate funding and smaller funders is missing
→ Benchmarking on funding performance against peers or aspirant institutions is
NOT happening
→ Funding forecasting done at a central level is not evidence driven at the
moment
NOAM: Market-Solution fit stage.
Collaborating with 5 customers on running strategic research planning
projects
APAC: Problem-Solution fit stage
Initial discussions started, looking for additional candidates
Address funding insight needs in strategic
research planningProposition: Benchmarking funding performance at a Topic Group level
US Federal funders, foundations and major international funders Major international funding bodies
from research intensive regions
.. we’ll grow the list with
your feedback
Analyze the funding landscape in a focus area
Get funding trends
on:
• # Funders in
this area
• # institutions
are getting
funded
• Median
awarded grant
• Awards volume
Analyze a focus area – Funders, Institutions
and Topics
• Is a Funder’s investment going
up / down?
• Who else got grants from the
Funder?
• Institution (future
collaborator/competitor?)
• PI (future hire?)
• What researchers are getting
funded?
• Awarded grants
• Topics
• What are the resulting
publications from the research?
Analyze who and what the Funders are supporting
Compare funding in your strategic research
focus areas or Funders
Funding view of my research
portfolio
• Compare your focus research
areas or Funders against
each other and global trends
Licensing and
other IP income
Spinouts
(capital gains)
Patents
(forward citations)
Patents
(forward citations)
Research
Publications
Patents
Ran
kin
gs &
Natio
nal
Assessm
en
ts
Tuition fees
(international
students)
Research
income
Collaboration
opportunities
Researchers
Output Outcome / Impact
Outcomes not
related to patentsOther factors
Evaluation Indirect Benefit
Why patents matter to universities
Research
Publications
Ran
kin
gs &
Natio
nal
Assessm
en
ts
Tuition fees
(international
students)
Research
income
Collaboration
opportunities
Researchers
Output Outcome / Impact
Outcomes not
related to patentsOther factors
Evaluation Indirect Benefit
Opportunity – Impact, Rankings & Assessments
Licensing and
other IP income
Spinouts
(capital gains)
Patents
(forward citations)
Patents
(forward citations)
Patents
Top innovative
universities
GVM Taiwan University
Rankings
Top innovative
universities
GVM Taiwan University
Rankings (PAI)
Top innovative
universities
Elsevier provide research-
citing patents data to THE
and GVM. GVM also uses
Patent Asset Index.
SV economic impact metrics
not good enough in isolation,
without ability to drill down.
Narratives or case studies
need details, not just numbers
UCD and Imperial
college – they
couldn’t figure out
why they slipped
down in the Reuters
ranking. Insights
needed.
Thank youQuestions?
Top Related