ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems...

75
The impact of R&I projects: beyond lip service Loredana Marmora Ankara, 11 January 2018

Transcript of ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems...

Page 1: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

TheimpactofR&Iprojects:beyondlipserviceLoredana MarmoraAnkara,11January2018

Page 2: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Who we are• Research, innovation andpolicy support• Interdisciplinarity• The impact in the H2020 proposals• Understand the evaluationprocess• Ingredients of a research project

Intheagenda

Page 3: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Who we are

Page 4: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

ISINNOVA, the Institute of Studies for the Integration of Systems, is anItalian private research and consulting firm supporting international,national and local public bodies for the analysis, the design, theimplementation and the evaluation of sustainable policies in the fieldof transport and mobility, energy and environment, long-termscenarios and governance.www.isinnova.org

Key Facts:• Active since 1971• 20 consultants with an international and multi-disciplinary background• Participation in over 80 European projects• Management of some of the most significant European projects (FP4, FP5,

FP6, FP7 and Horizon 2020)

About us

Page 5: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Having supported the decision-making of national, regional and local authoritiesin and outside Europe for decades, ISINNOVA is today an expert advisor on policyintegration, giving a special focus to policy effectiveness, cost sustainability andrelated technologies.ISINNOVA can be a strategic partner for administrations and bodies wishing toimplement sustainable development solutions.The wide array of services and solutions proposed by ISINNOVA includes:• ProjectManagement

– Expertise covering the full life-cycle of a project (more than 80 projects): identification offinancing schemes; drafting the project proposal; establishing an ad-hoc projectconsortia; coordination of project activities according to specific procedural rules; finalreporting.

• Evaluation and Impact Assessment– On three areas: Strategic Environmental Assessment; Energy Externalities Assessment;

Technology/Intelligent Transport Systems (ITS) Efficiency Assessment• Decision Support Systems

– Providingsophisticatedtheoreticalandtechnicaltoolscapableofanalysing systemicproblemsandsituations;

– Proprietaryinteractiveanduser-friendlysoftwareapplicationsfortheconstructionofmathematicalforecastingmodelsandthedefinitionoffuturescenarios.

Our services

Page 6: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

AreasofExpertise

Transport andUrbanMobilityOurexpertiseintransportandurbanmobility includes social,economicandenvironmentalaspectsofroad,rail,water,airandmulti-modal transport.Wefacilitatecitiesandregionsinpreparingforincreasingmobility demandswhileaddressing complexproblemsunique totheirindividual area.

EnergyandEnvironmentResearch,assessment, anddevelopment ofsustainable energyandenvironmentalpracticesisakeyareaofourwork.Ourknowledgeofinternalandexternalinfluences onalternativeenergyperspectives andourbroadnetworkacrossEuropeandbeyondhelpusinnovateandfosterlastingchange.

Foresight andGovernanceForesightandgovernancereferstothesocialandbehaviouralaspectsofdecisions, policies andgoverningpractices.Ourholisticapproachtosolutions inthisdomain incorporatesallareasofhumansociety,including socialandeconomicjustice,responsible business practices,anduniversalaccess.

Page 7: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Research,innovation andpolicysupport

Page 8: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

WhatdoweexpectfromR&Ipolicies?Moreandbetterknowledge

Butalso(increasinglyso)

Ø Solveproblems• Bridging thescience-industrygap• Addressingthetensionbetween‘national-local’dynamicsandglobalizationdynamicsof

knowledgeproductionandinnovation• Policyinstrumentmixesforeffectivelystimulatinginnovationandentrepreneurship

Ø Generateopportunities• Stimulatinginnovationinthepublic sector• Thedemand-side,technologyprocurement,&mission-orientedmeasures• Design&competitiveness• ThethirdsectorintheR&Isystem(non-profit/philantropic organizations)

Ø Buildupcapacity• Europeanuniversities inachangingworld• Research infrastructure• Innovationisnotonlyanoutcome,itisacapacityandastateofmindinpeople,infirms,in

organizations

Research,innovationandpolicysupport

Frommarket-failuretoasystematic-approachofR&IpolicySocietalchallenges

Page 9: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

EUSocietalChallenges

Research,Innovationandsupportpolicies

Climateaction,environment,resourceefficiencyandraw

materials

Secure,cleanandefficientenergy

Foodsecurity,sustainableagricultureandforestry,marineandmaritimeandinlandwaterresearch,and

theBioeconomy

Health,demographicchangeandwellbeing

Smart,greenandintegratedtransport

Europeinachangingworld- inclusive,

innovativeandreflectivesocieties

Securesocieties-protectingfreedomandsecurityofEuropeandits

citizens

Page 10: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Horizon2020andtheSocialchallenges

ExcellentScience§ EuropeanResearchCouncil§ Frontierresearchbythebestindividualteams

§ FutureandEmergingTechnologies§ Collaborativeresearchtoopennewfieldsofinnovation

§MarieSkłodowska Curieactions§ Opportunitiesfortrainingandcareerdevelopment

§ Researchinfrastructures(includinge-infrastructure)§ Ensuringaccess toworld-classfacilities

IndustrialTechnologies§ Leadershipinenablingandindustrialtechnologies§ ICT,nanotechnologies,materials,biotechnology,manufacturing,space

§ Accesstoriskfinance§ Leveragingprivatefinanceandventurecapitalforresearchandinnovation

§ InnovationinSMEs§ FosteringallformsofinnovationinalltypesofSMEs

SocietalChallenges§ Health,demographicchangeandwellbeing

§ Foodsecurity,sustainableagriculture,marineandmaritimeresearch&thebioeconomy

§ Secure,cleanandefficientenergy

§ Smart,greenandintegratedtransport

§ Climateaction,resourceefficiencyandrawmaterials

§ Europeinachangingworld:Inclusive, innovativeandreflectivesocieties

§ Securesociety

EuropeanInstituteofInnovationandTechnology(EIT)

SpreadingExcellenceandWideningParticipation

Sciencewithandforsociety

JointResearchCenter(JRC)

Euratom

Page 11: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

ExcellentScience§ EuropeanResearchCouncil§ Frontierresearchbythebestindividualteams

§ FutureandEmergingTechnologies§ Collaborativeresearchtoopennewfieldsofinnovation

§MarieSkłodowska Curieactions§ Opportunitiesfortrainingandcareerdevelopment

§ Researchinfrastructures(includinge-infrastructure)§ Ensuringaccess toworld-classfacilities

IndustrialTechnologies§ Leadershipinenablingandindustrialtechnologies§ ICT,nanotechnologies,materials,biotechnology,manufacturing,space

§ Accesstoriskfinance§ Leveragingprivatefinanceandventurecapitalforresearchandinnovation

§ InnovationinSMEs§ FosteringallformsofinnovationinalltypesofSMEs

SocietalChallenges§ Health,demographicchangeandwellbeing

§ Foodsecurity,sustainableagriculture,marineandmaritimeresearch&thebioeconomy

§ Secure,cleanandefficientenergy

§ Smart,greenandintegratedtransport

§ Climateaction,resourceefficiencyandrawmaterials

§ Europeinachangingworld:Inclusive, innovativeandreflectivesocieties

§ Securesociety

EuropeanInstituteofInnovationandTechnology(EIT)

SpreadingExcellenceandWideningParticipation

Sciencewithandforsociety

JointResearchCenter(JRC)

Euratom

Horizon2020andtheSocialchallenges

Page 12: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

R&Idrivenbysocietalchallenges

Scientific &Technological

R&I

Addressing grandsocietal challenges

?

Page 13: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

R&Idrivenbysocietalchallenges

Scientific &Technological

R&I

Addressing grandsocietal challenges

Technologicalinnovation

solutions

Page 14: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

R&Idrivenbysocietalchallenges

Scientific &Technological

R&I

Addressing grandsocietal challenges

Technologicalinnovation

Identification ofRTD priorities

Socio-economicResearch -

Social innovation

solutions

solutions

Page 15: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• FullyfledgedspecificSSHtopics(researchinSSH)asessentialtoensurethatH2020deliversvalueandbenefitstosociety

• SSHrelatedtasksunderdifferentsectors/topics(researchwithSSH)Ø SomeexamplesoftheroleofSSHare:Ø Smart,greenandintegratedtransport,SSHresearchanalysesthesocio-

economicaspectsoftransport,prospectivestudiesandtechnologyforesight;Ø Climateactionandresourceefficiency,SSHresearchtacklesthecultural,

behavioural,socio-economicandinstitutional changeinordertomovetoamoreself-reliantandresourceefficienteconomy;

Ø Europeinachangingworld,therewillbearangeoftopicscoveringareaslikenewideas,strategiesandgovernancestructuresforovercomingthecrisisinEurope,innovationinthepublicsectorenabledbyICT,businessmodelinnovation,social innovation,Europeanculturalheritage,history,cultureandidentity;

• SSHfullyintegratedinprojectteamsØ Multi- VsInter- VsTrans-disciplinarity

EmbeddingSSHinH2020…andoldstory

Page 16: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Integrating(disciplinary)knowledge

TargetedS&T

Research

Societalchallenges

SSHResearch

KeyEnabling

Technologies

Page 17: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Micro/nano electronics• Nanotechnologies• Industrialbiotechnologies• Advancedmaterials• Photonics• Advancedmanufacturingtechnologies

KeyEnablingTechnologies

Page 18: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

The10toptechnologiesofthefuture

2014 20151. Bodyadaptedwearableelectronics 1. Fuelcellvehicles

2. Nanostructuredcarboncomposites

2. Next-generationrobotics

3. Miningmetalsfromdesalinationbrine

3. Recyclablethermosetplastics

4. Gridscaleelectricitystorage 4. Precisegenetic-engineeringtechniques

5. Nanowirelithium-ionbatteries 5. Additivemanufacturing

6. Screenless display 6. Emergentartificialintelligence

7. HumanMicrobiomeTherapeutics 7. Distributedmanufacturing

8. RNA-basedTherapeutics 8. ‘Senseandavoid’drones

9. QuantifiedSelf(PredictiveAnalytics)

9. Neuromorphic technology

10. Brain-computerInterfaces 10. DigitalgenomeAdapted fromWorld Economic Forum, 2014&2015

Page 19: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

The10toptechnologiesofthefuture

Adapted fromWorld Economic Forum, 2014&2015

2014 20151. Bodyadaptedwearableelectronics 1. Fuelcellvehicles

2. Nanostructuredcarboncomposites

2. Next-generationrobotics

3. Miningmetalsfromdesalinationbrine

3. Recyclablethermosetplastics

4. Gridscaleelectricitystorage 4. Precisegenetic-engineeringtechniques

5. Nanowirelithium-ionbatteries 5. Additivemanufacturing

6. Screenless display 6. Emergentartificialintelligence

7. HumanMicrobiomeTherapeutics 7. Distributedmanufacturing

8. RNA-basedTherapeutics 8. ‘Senseandavoid’drones

9. QuantifiedSelf(PredictiveAnalytics)

9. Neuromorphic technology

10. Brain-computerInterfaces 10. Digitalgenome

Page 20: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Integrating (disciplinary)knowledge

TargetedS&T

Research

Societalchallenges

SSHResearch

KeyEnabling

TechnologiesSystemsinnovation

Towardsamission-orientedFP9?

Page 21: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Interdisciplinarity

Page 22: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• DirectvsindirectimpactsØ ComparingachievementtoobjectivesØ Checkingthetimefactor

• Failureà noSEeffects• Delayà SEeffectstoappearlater• Conditionalityà needforadditionalactions

Basicconcepts

Page 23: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Impactassessment:longtermprocess

INPUT OUTPUT RESULTS/OUTCOME

IMPACTS(economic,social,environmental)

ProgrammeEnd

Programmeduration(approx.5years) Until2to5years

UNTIL10TO20ANDMOREYEARSAFTERTHEENDOFTHEPROGRAMME

BasedonEx-anteassessmentoftheFP7Researchprogramme- Generalprocessandtime-frame

Page 24: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• DirectvsindirectimpactsØ ComparingachievementtoobjectivesØ Checkingthetimefactor

• Failureà noSEeffects• Delayà SEeffectstoappearlater• Conditionalityà needforadditionalactions

• SEimpactvsSEdimensionØ Inputs(dimension)Ø Outputs(impacts)

Basicconcepts

Page 25: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Assessmentframework:SEimpactandSEdimension

QUALITATIVE ASSESSMENT QUANTITATIVE ASSESSMENT

INPUTS

(SE DIMENSION)

ð SE topics addressed ð Multidisciplinarity

of research teams

ð Amount of resources − Staff − Budget

ð Other input variables

OUTPUTS (SE IMPACT)

ð Societal changes induced

ð SE systems affected ð Policy actions

generated ð Identification of

further research needs

ð Changes in SE performance − Welfare − Other SE performance

variables (environment, health, etc.)

ð Efficiency in the use of resources (i.e. I/O ratios)

Page 26: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Projectsresultsarepolicyrelevantiftheyarecitedinpolicydocuments• Search(primarilythroughEURLEX)forreferencestoKBBEprojectsin“policy

documents”,i.e.Ø CommissionworkingdocumentsØ Communications toCouncil,EP,EESCØ Regulation/DirectivesØ ReportstoCouncil,EP,EESCØ Green/WhitePapersØ Writtenquestions (EP)Ø Opinions (EESC)

PolicyImpactAssessment(expost)…theapproach

BasedonEx-anteassessmentoftheFP7Researchprogramme- Generalprocessandtime-frame

Page 27: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

EnvironmentR&Ipolicycitations

0

2

4

6

8

10

12

14

16

1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011

PolicydocsinEURLEXw/oWrittenQuestions (/1000) Policycitations ofenv.projects

Page 28: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Interdisciplinarity

• Multidisciplinarity=juxtaposition

• Interdisciplinarity=interaction

• Trans-disciplinarity=integration

Complexity

Page 29: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• ObjectivesnotalignedØ Scientificprogressvs.societalproblemsolving

• Language(unwilling?)• Academicbadhabitofworkingin(disciplinary)

isolation:thefishtank syndrom• Disciplinarycarrierpaths

Barrierstointedisciplinarity

Page 30: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• CombiningnaturalscienceswithSSH• Integrationofdifferentthematicdisciplines

(transport+energy+environment+landuse…)

• Verticalintegration(policydrivenR&I)

• Combiningqualitativeandquantitativemethods

Inter(trans)disciplinarity andSSH

Capabilityofanalysingcomplexsystems

Capabilityofinvolving relevantstakeholdersalong theentireprocessofpolicy/decisionmaking

Page 31: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Anexample

QUAL

QUAL/QUANT

QUANT

QUANT

QUAL

Page 32: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• CombiningnaturalscienceswithSSH• Integrationofdifferentthematicdisciplines

(transport+energy+environment+landuse…)

• Verticalintegration(policydrivenR&I)

• Combiningqualitativeandquantitativemethods• Impactassessmentandintegrated(social)cost/benefit

analysis

Inter(trans)disciplinarity andSSH

Capabilityofanalysingcomplexsystems

Capabilityofinvolving relevantstakeholdersalong theentireprocessofpolicy/decisionmaking

Page 33: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Contributiontothethree“sustainabilitypillars”:economy,societyandenvironmentØ EconomicimpactsmeasuredthroughindicatorsØ Environmentalandsocialnotmeasurablethroughstandard

quantitativevariables• Lackofacomprehensiveandsystematicframeworktomonitorandmeasuresocio-economicimpacts

• Quantitativeevidenceisscarce

Impactsoftheresearchpolicy

Page 34: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

EconomicimpactsareasMacroeconomiceffectsoftechnologicalprogress

P.Zagamé2015

Benefitsprimarilyassessed(andRTDinvestmentsjustified)intermsofmacro-economicimpacts(GDPandjobsforsocietyasawhole)

Page 35: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Socialimpactsareas(1/2)

Page 36: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Socialimpactsareas(2/2)

Page 37: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Environmentalimpactsareas(1/2)

Page 38: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Environmentalimpactsareas(2/2)

Page 39: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Ø CertainlyoneofthemostdifficulttoassessØ Onefocus:tacklereal/perceivedbarriersthatdeterdisadvantagesgroups

toenteringtoscientificeducationsandcarriersØ SocialexclusionalsoaddressedbytransportEUprojectsØ Directconnectionbetweensocialcohesionandpenetrationofmobile

communicationtechnologiesanddevices

Ø Participation,withdirectcontributions,tointernationalorganisationhasbeenincreasinglypromotedinpreviousFPs

Ø Differenteconomicandmethodologicalapproach

Socialimpactsareas- examples

Assessing the Social and Environmental Impacts of European Research – Report to Commission

Page 40: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Theimpacts intheH2020proposals

Page 41: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Theproposalshouldhaveanimpactorientedapproachdeliveringsolutionsaddressingkeysocietalandtechnicalchallenges

• Impact(aswellasInnovation)mustbe:Ø Addressedinallsectionsoftheproposal,notjusttheimpactsectionØ Managedinallstagesofaproject,notjustafterresultshavebeen

created

• Benefits(henceimpact)doesnothavetobefinancial• Theimpactoftheinnovationcanbesocietal,research,

environmental,technical,commercial,educationaloranythingthatdeliversbenefits/addressesaneed

Impactsaspectsintheproposal

Page 42: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• ProposalsectionsØ PARTA:administrativesection

• Administrativeinformationaboutpartners• keywords• abstract

Ø PARTB:theproposal• Sections1to3

• 1- Excellence(science)• 2- Impact• 3- QualityandEfficiencyoftheImplementation

• Sections4-5• 4- MembersoftheConsortium• 5- EthicsandSecurityIssues

Impacts intheH2020proposals/projects

Butnotonly….

Page 43: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Contributiontotheexpectedimpactsmentionedintheworkprogramme (undertherelevanttopic)

• Otherimpactsnotmentionedintheworkprogramme,thatwould:Ø enhanceinnovationcapacity;Ø createnewmarketopportunities,Ø strengthencompetitivenessandgrowthofcompanies,Ø addressissuesrelatedtoclimatechangeortheenvironment,orØ bringotherimportantbenefitsforsociety

• Describeanybarriers/obstacles,andanyframeworkconditions(suchasregulation,standards,publicacceptance,etc.),thatmaydeterminewhetherandtowhatextenttheexpectedimpactswillbeachieved.

Impacts:section2.1“Expectedimpacts”

Page 44: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Definitionofthe“Disseminationandexploitation”ofresultsØ Provideadraft‘planforthedisseminationandexploitationoftheproject's

results’Ø Showhowtheproposedmeasureswillhelp toachievetheexpectedimpactof

theproject.Ø Includeabusinessplanwhererelevant.Ø Includeinformationonhowtheparticipantswillmanagetheresearchdata

generatedand/orcollectedduring theprojectØ Outlinethestrategyforknowledgemanagementandprotection

• DescriptionoftheCommunicationactivitiesØ Describetheproposed communicationmeasuresforpromoting theprojectand

itsfindings during theperiodofthegrant.

Impacts:section2.2“Measurestomaximiseimpact”

Page 45: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

“Yourplanforthedisseminationandexploitationoftheproject'sresultsiskeytomaximising theirimpact”.

(H2020template)

Noimpacts

iftheresultsarenotusedand

thecallchallengesarenotaddressed

Impactandcommunication/dissemination

Page 46: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

disseminationvscommunication

Communication DisseminationAbouttheproject andtheresults About theresultsonly

Multipleaudiences(beyond theproject-includingmediaandthepublic)

Audiencethatmay usetheresults(e.g.professional organisations,policymakers, scientific)

Informandreachouttosociety,showthebenefitsofresearch

Enableuseanduptakeofresults

Adapted fromECslides “Adresssing ImpactandExploitation inHorizon 2020proposals”

InformingabouttheprojectInformingaboutresultsMakingresultsavailableforuse

Newsletter

Pressrelease

Projectfactsheet,brochures

Socialmedia(blogs,twitter,etc)

Training/demonstrations

Videos, interviews

Articlesinmagazines

Conferences,presentations

Scientificpublications

Policybriefs

Sharingresultsononlinerepository(software,researchdata,etc.)

ProjectWebsite

Page 47: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

disseminationvsexploitation

Dissemination ExploitationDescribingandmakingavailableresults sothattheycanbeused

Makinguseofresults,forscientific,societaloreconomicpurposes

Audiences thatmaymakeuseofresults

Groupsandentitiesthataremakingconcreateuseofresults

Allresults whicharenotrestrictedduetotheprotectionofIP,securityrulesorlegitimateinterests

Allresultsgeneratedduringproject.Participantshallmakebesteffortstoexploittheresultsitowns

Adapted fromECslides “Adresssing ImpactandExploitation inHorizon 2020proposals”

Makingresultsavailable Facilitatingfurtheruseofresults Makinguseofresults

Scientificpublication

Pressbrief

Training/workshops

Scaringresultsononlinerepository

Furtherresearch Service

Copyrightmanagement

DMP

Activestakeholder/userengagement

Patent Spin-off/start-up

PhDthesis Product

Policychange

Openlicenses

Innovationmanagement

Disseminationandexploitationgotogether!

Page 48: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

1. Excellence2. Impact3. Implementation

• 5pointeach(totalscore:15)• Threshold:3percriterion• Atleast10intotal

• Fortheevaluationoffirst-stageproposalsunderatwo-stagesubmissionprocedure,onlythecriteria‘excellence’and‘impact’willbeevaluated

(thresholdforbothindividualcriteriawillbe4)

H2020EvaluationCriteria

Page 49: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Typeofactions

Indirectcost:25%ofdirectcosts(excludingsubcontractandthirdpartycosts)

Research&InnovationAction

Research&InnovationAction

•R&Dtoestablishnewknowledgeorexplorethefeasibilityofaneworimprovedtechnology,product,process,serviceorsolution(includingbasicandappliedresearch,technologydevelopmentandintegration,testingandvalidationonasmall- scaleprototypeinalaboratoryorsimulatedenvironment)•Funding rate:100%

InnovationActionInnovationAction

• Innovationactivitiesdirectlyaimingatproducingplansandarrangementsordesignsfornew,alteredorimprovedproducts,processesorservices(includingprototyping,testing,demonstrating,piloting,large-scaleproductvalidationandmarketreplication)

• Fundingrate:70%(100%forno-profitorganisations)

Coordination&SupportAction

Coordination&SupportAction

•Accompanyingmeasuressuchasstandardization,dissemination,awareness-raisingandcommunication,networking,coordinationorsupportservices,policydialoguesandmutuallearningexercisesandstudies(includingdesignstudiesfornewinfrastructureandcomplementaryactivitiesofstrategicplanning,networkingandcoordinationbetweenprogrammesindifferentcountries)•Fundingrate:100%

Page 50: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Typeofactions/“Impact”asawardcriteria

RIA IA CSA

Expected impactslistedintheworkprogrammeundertherelevanttopic

• Enhancinginnovationcapacityandintegrationofnewknowledge;

• StrengtheningthecompetitivenessandgrowthofcompaniesbydevelopinginnovationsmeetingtheneedsofEuropeanandglobalmarkets;and,whererelevant,bydeliveringsuchinnovationstothemarkets;

• Anyotherenvironmentalandsociallyimportantimpacts(notalreadycoveredabove);

• Effectivenessoftheproposedmeasurestoexploitanddisseminatetheprojectresults(includingmanagementofIPR),tocommunicatetheproject,andtomanageresearchdatawhererelevant.

• Effectivenessoftheproposedmeasurestoexploitanddisseminatetheprojectresults(includingmanagementofIPR),tocommunicatetheproject,andtomanageresearchdatawhererelevant.

Eachsub-criterioncorresponds toanassignedscore!!!

Page 51: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

0: Theproposalfailstoaddressthecriterionunderexaminationorcannotbejudgedduetomissingorincompleteinformation1: Poor.Thecriterionisaddressedinanadequatemanner,orthere areseriousinherentweaknesses.2: Fair.Whiletheproposalbroadlyaddressesthecriterion,there

aresignificantweaknesses.3: Good.Theproposaladdressesthecriterionwell,although

improvementswouldbenecessary.4: Verygood.Theproposaladdressesthecriterionverywell,although certainimprovementsarestillpossible.5: Excellent.Theproposalsuccessfullyaddressesallrelevantaspectsof thecriterioninquestion.Anyshortcomingsareminor.

Evaluationscores

Page 52: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Calltitleandidentificationcode(e.g.MG-4.3-2017:InnovativeapproachesforintegratingurbannodesintheTEN-Tcorenetworkcorridors)

• Specificchallenge• Scope• Expectedimpact• Typeofaction• Budget• Deadline

Impactssectioninthecall

Page 53: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• I3U“InvestigatingtheImpactoftheInnovationUnion”projectØ Duration:2015-2018/Budget:2,931K€ /9partnersin9differentcountries

Ø ExpectedimpactssetoutintheworkprogrammeØ ContributiontothegovernanceofinnovationatEUandMSlevelØ ImpactoneconomicresearchØ ImpactonrelevantcommunitiesandonsocietyatlargeØ +diagrams

Exampleofsection2.1inanongoingproject

Page 54: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Calltitle:Sustainable Food Security– Resilientandresource-efficient value chain

Ø DisseminationandexploitationofresultsØ Communicationactivities(visualidentity,website,socialmedia,

newsletter)Ø 2DedicatedWPs:

• Multi-stakeholderaction• Disseminationandexploitation

Ø +tables,figuresanddiagrams

Exampleofsection2.2inaproposalundernegotiation

Page 55: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Understandtheevaluationprocess

Page 56: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Evaluationprocess

ProgettualitàEuropea

FullProposal

Proposalforms

Evaluators

Eligibility

Evaluators Evaluators

PanelSubmission ConsensusIndividualevaluation Finalisation

ESRs(EvaluationSummaryReports)&Proposalsinsuggestedpriorityorder

CriteriaCriteria Criteria

COMMISSION

Role ofexperts

Thresholds

Finalrankinglist

Rejectionlist

COMMISSION

Page 57: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Individualassessmentoftheproposals

ProgettualitàEuropea

Proposal X

Proposal X

Proposal X

IARexpert 1

IAR expert 2

IAR expert 3

Consensus meeting

CR

“Remote” Brussels

Proposal XIAR expert 4

IAR = Individual Assessment Report CR = Consensus Report

There are usually between 3 and 5 experts allocated to each proposal

Page 58: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Receiptbeforedeadline• Minimumnumberofpartners• Completenessofproposal• "Outofscope"

EligibilitycheckPerformedbyECstaffbeforeevaluation

Page 59: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Allexpertshavingreadthesameproposalmeetinaconsensusmeetingtodiscusstheproposal

• ObjectiveistoreachanagreementonscoreandcommentsØ ItisnormalforindividualviewstochangeduringthediscussionØ ThefinalresultisNOTanaveragescoreofindividualscoresbuta

built-upconsensusbasedonthecommentsØ Ifdeadlock:minorityvieworextraevaluatorsarecalledin

• Oneexpertactsasrapporteur(draftstheCR)• MeetingmoderatedbyECstaff

Ø Impartialmoderation:noopinionbutnotpassiveØ ProvidesinformationifnecessaryØ EthicalReviewFormtobefilledinifapplicable

Consensusmeeting

Page 60: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• AllexpertsarejointlyresponsiblefortheCRdraftedbytheRapporteur

• Qualityisveryimportant:thisisthebasisofthetextgivenasfeedbacktoapplicants!Ø Clearandfairassessmentofproposalwithjustifications,feedback

onweaknessesandstrengths• Tobeavoided:

Ø RecommendationsinviewofresubmissionØ Non-constructivelanguageandexpressions

• Moderatorchecksconsistencybetweenscoresandcomments

• Proof-readingbynativeEnglishspeakerisprovided

Consensus report(CR)

Page 61: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Objective:establisharankedlistofproposalseligibleforfunding- onePanelperbudgetline(topicoractivitypanels)

• Meetingbetweenevaluators,moderatedbyECstaff• Discussconsistencyofscoresandcomments,minorityviews,

proposalswithequalscores,etc.• Recommendpriorityorder(hierarchyofcriteriacanbeapplied)and

possiblechangesinscoresorCRcomments• Providecomments,recommendationsontheranking,beconstructive• FinaliseEvaluationSummaryReports(tobesenttoapplicants)• Attheend,allexpertssignthePanelReport

Final panelmeeting

Page 62: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• InitialinformationlettertoCoordinatorwithESR(EvaluationSummaryReports)Ø Excellentqualityisnecessary:coherenceandlanguageØ Transparencyandcredibilityoftheprocess

• Redressprocedures- forcomplaintsonevaluationresults• Drawupfinalrankinglist• InformationtoProgrammeCommittee• “Non-Negotiation”withfundedproposals• Consultation/informationofProgrammeCommittee• OfficialCommissiondecisionforfunding• Grantagreementissued(proposalbecomesproject)

Follow-uppost-evaluation (ECstaff)

Page 63: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Ingredients ofaresearch project

Page 64: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Whichistheproblemtobesolved?• WhyaddressitatEuropean/internationallevel

(insteadofnationallevel)?• Istheproposedsolutionalreadyavailable?• Whatwillhappeniftheresearchwillbefunded?• Whytheproposedconsortiumshouldbefunded?

Key questions

Page 65: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Individualqualityofthepartners• Multidisciplinariety• Stakeholders’involvement• Long-standingexperiencein

communication/dissemination• Long-standingexperienceincoordination• Interestinworkingtogetherandshare

results/experiences

Theconsortium

Page 66: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Tocomplytothedescriptionofthecall/topic• Tostartfromtheend:evaluationprocessandcriteria• Tohavea“good”ideaandconsortiumisnotenough• Toclearlystatethefinalobjectivesandhowtheywill

bereached:Ø MethodsandapproachesØ Examplesofpotentialdevelopments

Contents (1/2)

Page 67: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Todefinethe“impacts”isprobablythehardestpart:Ø Avoidbanality/redundancyØ Ensuremeasurability,relevancetotheEuropeanpoliciesØ Proposeconcreateandinnovativedisseminationactions.

• Keepattentiontothelanguageandstyle:theevaluatorscouldbenot“experts”inthetopicasyouare!

Contents (2/2)

Page 68: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Toidentifythetechnicalofficerofthecall• Tocontrolif,amongpartners,somebodyknows

her/him• Tomakequestions/askforclarificationsevenif…• Youmightnotexpectsubstantialcontributions!• Evenifsimplified,theadministrativeprocedures

remainssignificant:Ø TrustthecoordinatorØ AsksupporttotheEChelpdesks

Liaise withtheCommission

Page 69: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• DoyoureallywanttobeaCoordinator?• Toestablishagoodconsortium:

Ø Thehardestpart!Ø Startassoonaspossible(evenbeforethe

publicationofthefinalversionofthecall)Ø Tohaveaproposaloutlinehelpstoengagepartners

Key elements

Page 70: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• bottom-upapproachØ Defineroles(atleastWPleaders)Ø WPleadersdraftinputØ Coordinatorcollectanddrafttheproposal

• top-downapproachØ DefineageneralcommonagreementamongpartnersØ Coordinatordraftsthefirstversionoftheproposaland

circulateittocollectscomments/ideas,etc.

Proposal drafting (1/2)

Page 71: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Pros Cons

Bottom-up Democraticprocess:toensureagood levelofcreativity(withreferencetocontributions andmultidisciplinarity)

ItrequiresseveralinteractionsandmediationeffortsTimeconsumingAtleastapreparatorymeetingwithpartners

Top-down Coherenceandconsistencyofthefinal“product”(contentsandstyle)Short timefordraftingRecognisetheroleofthecoordinator

ItrequiresahugeeffortsconcentratedonfewpeopleUndemocraticprocess:fewinteractionsamongpartners

Proposal drafting (2/2)

Page 72: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Timing:Ø 2/3months(basedonthecomplexityofthe

proposal)Ø Todefinethepartnershipassoonaspossible(at

leastthe“core”consortium)• Cost

Ø Between2and5PMs(basedonthecomplexityoftheproposal,theexperienceofthestaffandthesizeoftheproject)

Resourcesneededtoprepareaproposal

Page 73: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

• Selectthemostsuitablepartnersfortheproject:fittingthecontextandthetypeofcall/project

• Select partnerswithrelevant(technical)experiencetoaddresstheissuesinthecall

• Ensuregeographicalbalance,varietyinthetypeandcompetencesoftheselectedorganisations (synonymofbalancedbudget)

• Ensure jointwritingoftheproposalandreliabilityofthepartnership(leaderships)

Partnership:successfactors

Page 74: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Questions?

Page 75: ISINNOVA The impact of the R&I projects · Technology/Intelligent Transport Systems (ITS)EfficiencyAssessment ... , responsible business practices, and universal access. Research,

Thank you foryour attention!

[email protected]

www.isinnova.org