WP4/T4.1

D4.1

Detailed Report

on

Indicators

Overall stragtegy

Case studies

Types of networks

Types of impact indicators

(Network) Model definition

Algorithm (indicators on models)

WP2 Conceptual Model

WP4 Indicators

General description

Development of novel structural indicators measures

1) The measures are to be capable of grasping the structural impact of an individuals’ activity. The indicators should incorporate the state-of-the art developments in social network analysis.

2) The measures should be able to account for multiple aspects of a researcher’s impact. Indicators should be robust, scalable, parameterizable, and adjustable to different evaluation purposes.

3) The measures should mirror effects in a broader domain than that of the scholarly community.

4) Indicators should either form a toolkit with elements adapted to the SISOB use cases, or highly flexible measures applicable to and being expressive for multiple domains.

Structure

T4.1 Define and classify the objectives to measure related to social aspects and levels

- Study, detect and categorize the social aspects to be measured- Explore state-of-the art perspectives via mapping the literature on the topic

D4.1 Report of indicators considering social aspects and their: Detailed report on indicators, considering theobjectives to measure related to social aspects and levels. (M6)

General principles (cf. Richard, WP2)

• D4.1 can ideally be conceived as a comprehensiverequirement analysis.

• In particular:

• Considering the concepts of impact assessment and evaluation in R&D policy research

• Mapping existing approaches

• In the three given domain (case studies)

• Analyzing them against the SISOB vision on monitoring science

• Identifying missing dimensions and related variables

• Measures? (Depends on scope of D4.1)

Mapping

Comparison

Relation to D2.1

• Overlap in Mapping existing approaches

• BUT…

• D2.1:

• Review of existing methodological frameworks SISOB is to utilize and elaborate on (mostly SNA)

• D4.1:

• Review of existing indicators and measures SISOB is to utilize and elaborate on: domain-specific SNA models (case studies)

• From SNA models: „reverse egnineering” to obtain dimensions

MTA to D4.1

1. Use of SNA-related indicators in science policy studies: mapping the literature

1.1 Identitication of dimensions of existing measurements1.2 Providing a system for existing indicators, based on 1.2

Bibliometric study: macro-level overview

Extracting dimensions and relation to Conceptual Model

Tasks and partners in D4.1

Section Related Case study Contributors

1. Use of SNA-related indicators in science policy studies: mapping the literature1.1 Identification of dimensions of existing measurements1.2 Providing a system for existing indicators, based on 1.1

All MTA,RICYT,UMA

2. Mobility indicators: Analysis of mobility specific SNA-related indicators and their use in mobility research2.1 Mapping mobility indicators in existing SNA-applications2.2 Requirement analysis of improving measurements and indicators based on 1.1 in accordance with the conceptual model

Mobility FR,CICE

3. Knowledge sharing dimensions and indicators1.1 Systematizing SNA-models and respective measurements and indicators1.2 Requirement analysis of improving measurements and indicators based on 1.1 in accordance with the conceptual model

Knowledge sharing

UDE,CICE

4. Indicators for the impacts of the peer-review process4.1 Specification/formal definition of potential impacts to be modelled4.2 Requirement analysis based on existing SNA-approaches for identified impacts to be modelled

Peer review FrontiersIn