TheimpactofR&Iprojects:beyondlipserviceLoredana MarmoraAnkara,11January2018

• Who we are• Research, innovation andpolicy support• Interdisciplinarity• The impact in the H2020 proposals• Understand the evaluationprocess• Ingredients of a research project

Intheagenda

Who we are

ISINNOVA, the Institute of Studies for the Integration of Systems, is anItalian private research and consulting firm supporting international,national and local public bodies for the analysis, the design, theimplementation and the evaluation of sustainable policies in the fieldof transport and mobility, energy and environment, long-termscenarios and governance.www.isinnova.org

Key Facts:• Active since 1971• 20 consultants with an international and multi-disciplinary background• Participation in over 80 European projects• Management of some of the most significant European projects (FP4, FP5,

FP6, FP7 and Horizon 2020)

About us

Having supported the decision-making of national, regional and local authoritiesin and outside Europe for decades, ISINNOVA is today an expert advisor on policyintegration, giving a special focus to policy effectiveness, cost sustainability andrelated technologies.ISINNOVA can be a strategic partner for administrations and bodies wishing toimplement sustainable development solutions.The wide array of services and solutions proposed by ISINNOVA includes:• ProjectManagement

– Expertise covering the full life-cycle of a project (more than 80 projects): identification offinancing schemes; drafting the project proposal; establishing an ad-hoc projectconsortia; coordination of project activities according to specific procedural rules; finalreporting.

• Evaluation and Impact Assessment– On three areas: Strategic Environmental Assessment; Energy Externalities Assessment;

Technology/Intelligent Transport Systems (ITS) Efficiency Assessment• Decision Support Systems

– Providingsophisticatedtheoreticalandtechnicaltoolscapableofanalysing systemicproblemsandsituations;

– Proprietaryinteractiveanduser-friendlysoftwareapplicationsfortheconstructionofmathematicalforecastingmodelsandthedefinitionoffuturescenarios.

Our services

AreasofExpertise

Transport andUrbanMobilityOurexpertiseintransportandurbanmobility includes social,economicandenvironmentalaspectsofroad,rail,water,airandmulti-modal transport.Wefacilitatecitiesandregionsinpreparingforincreasingmobility demandswhileaddressing complexproblemsunique totheirindividual area.

EnergyandEnvironmentResearch,assessment, anddevelopment ofsustainable energyandenvironmentalpracticesisakeyareaofourwork.Ourknowledgeofinternalandexternalinfluences onalternativeenergyperspectives andourbroadnetworkacrossEuropeandbeyondhelpusinnovateandfosterlastingchange.

Foresight andGovernanceForesightandgovernancereferstothesocialandbehaviouralaspectsofdecisions, policies andgoverningpractices.Ourholisticapproachtosolutions inthisdomain incorporatesallareasofhumansociety,including socialandeconomicjustice,responsible business practices,anduniversalaccess.

Research,innovation andpolicysupport

WhatdoweexpectfromR&Ipolicies?Moreandbetterknowledge

Butalso(increasinglyso)

Ø Solveproblems• Bridging thescience-industrygap• Addressingthetensionbetween‘national-local’dynamicsandglobalizationdynamicsof

knowledgeproductionandinnovation• Policyinstrumentmixesforeffectivelystimulatinginnovationandentrepreneurship

Ø Generateopportunities• Stimulatinginnovationinthepublic sector• Thedemand-side,technologyprocurement,&mission-orientedmeasures• Design&competitiveness• ThethirdsectorintheR&Isystem(non-profit/philantropic organizations)

Ø Buildupcapacity• Europeanuniversities inachangingworld• Research infrastructure• Innovationisnotonlyanoutcome,itisacapacityandastateofmindinpeople,infirms,in

organizations

Research,innovationandpolicysupport

Frommarket-failuretoasystematic-approachofR&IpolicySocietalchallenges

EUSocietalChallenges

Research,Innovationandsupportpolicies

Climateaction,environment,resourceefficiencyandraw

materials

Secure,cleanandefficientenergy

Foodsecurity,sustainableagricultureandforestry,marineandmaritimeandinlandwaterresearch,and

theBioeconomy

Health,demographicchangeandwellbeing

Smart,greenandintegratedtransport

Europeinachangingworld- inclusive,

innovativeandreflectivesocieties

Securesocieties-protectingfreedomandsecurityofEuropeandits

citizens

Horizon2020andtheSocialchallenges

ExcellentScience§ EuropeanResearchCouncil§ Frontierresearchbythebestindividualteams

§ FutureandEmergingTechnologies§ Collaborativeresearchtoopennewfieldsofinnovation

§MarieSkłodowska Curieactions§ Opportunitiesfortrainingandcareerdevelopment

§ Researchinfrastructures(includinge-infrastructure)§ Ensuringaccess toworld-classfacilities

IndustrialTechnologies§ Leadershipinenablingandindustrialtechnologies§ ICT,nanotechnologies,materials,biotechnology,manufacturing,space

§ Accesstoriskfinance§ Leveragingprivatefinanceandventurecapitalforresearchandinnovation

§ InnovationinSMEs§ FosteringallformsofinnovationinalltypesofSMEs

SocietalChallenges§ Health,demographicchangeandwellbeing

§ Foodsecurity,sustainableagriculture,marineandmaritimeresearch&thebioeconomy

§ Secure,cleanandefficientenergy

§ Smart,greenandintegratedtransport

§ Climateaction,resourceefficiencyandrawmaterials

§ Europeinachangingworld:Inclusive, innovativeandreflectivesocieties

§ Securesociety

EuropeanInstituteofInnovationandTechnology(EIT)

SpreadingExcellenceandWideningParticipation

Sciencewithandforsociety

JointResearchCenter(JRC)

Euratom

ExcellentScience§ EuropeanResearchCouncil§ Frontierresearchbythebestindividualteams

§ FutureandEmergingTechnologies§ Collaborativeresearchtoopennewfieldsofinnovation

§MarieSkłodowska Curieactions§ Opportunitiesfortrainingandcareerdevelopment

§ Researchinfrastructures(includinge-infrastructure)§ Ensuringaccess toworld-classfacilities

IndustrialTechnologies§ Leadershipinenablingandindustrialtechnologies§ ICT,nanotechnologies,materials,biotechnology,manufacturing,space

§ Accesstoriskfinance§ Leveragingprivatefinanceandventurecapitalforresearchandinnovation

§ InnovationinSMEs§ FosteringallformsofinnovationinalltypesofSMEs

SocietalChallenges§ Health,demographicchangeandwellbeing

§ Foodsecurity,sustainableagriculture,marineandmaritimeresearch&thebioeconomy

§ Secure,cleanandefficientenergy

§ Smart,greenandintegratedtransport

§ Climateaction,resourceefficiencyandrawmaterials

§ Europeinachangingworld:Inclusive, innovativeandreflectivesocieties

§ Securesociety

EuropeanInstituteofInnovationandTechnology(EIT)

SpreadingExcellenceandWideningParticipation

Sciencewithandforsociety

JointResearchCenter(JRC)

Euratom

Horizon2020andtheSocialchallenges

R&Idrivenbysocietalchallenges

Scientific &Technological

R&I

Addressing grandsocietal challenges

?

R&Idrivenbysocietalchallenges

Scientific &Technological

R&I

Addressing grandsocietal challenges

Technologicalinnovation

solutions

R&Idrivenbysocietalchallenges

Scientific &Technological

R&I

Addressing grandsocietal challenges

Technologicalinnovation

Identification ofRTD priorities

Socio-economicResearch -

Social innovation

solutions

solutions

• FullyfledgedspecificSSHtopics(researchinSSH)asessentialtoensurethatH2020deliversvalueandbenefitstosociety

• SSHrelatedtasksunderdifferentsectors/topics(researchwithSSH)Ø SomeexamplesoftheroleofSSHare:Ø Smart,greenandintegratedtransport,SSHresearchanalysesthesocio-

economicaspectsoftransport,prospectivestudiesandtechnologyforesight;Ø Climateactionandresourceefficiency,SSHresearchtacklesthecultural,

behavioural,socio-economicandinstitutional changeinordertomovetoamoreself-reliantandresourceefficienteconomy;

Ø Europeinachangingworld,therewillbearangeoftopicscoveringareaslikenewideas,strategiesandgovernancestructuresforovercomingthecrisisinEurope,innovationinthepublicsectorenabledbyICT,businessmodelinnovation,social innovation,Europeanculturalheritage,history,cultureandidentity;

• SSHfullyintegratedinprojectteamsØ Multi- VsInter- VsTrans-disciplinarity

EmbeddingSSHinH2020…andoldstory

Integrating(disciplinary)knowledge

TargetedS&T

Research

Societalchallenges

SSHResearch

KeyEnabling

Technologies

• Micro/nano electronics• Nanotechnologies• Industrialbiotechnologies• Advancedmaterials• Photonics• Advancedmanufacturingtechnologies

KeyEnablingTechnologies

The10toptechnologiesofthefuture

2014 20151. Bodyadaptedwearableelectronics 1. Fuelcellvehicles

2. Nanostructuredcarboncomposites

2. Next-generationrobotics

3. Miningmetalsfromdesalinationbrine

3. Recyclablethermosetplastics

4. Gridscaleelectricitystorage 4. Precisegenetic-engineeringtechniques

5. Nanowirelithium-ionbatteries 5. Additivemanufacturing

6. Screenless display 6. Emergentartificialintelligence

7. HumanMicrobiomeTherapeutics 7. Distributedmanufacturing

8. RNA-basedTherapeutics 8. ‘Senseandavoid’drones

9. QuantifiedSelf(PredictiveAnalytics)

9. Neuromorphic technology

10. Brain-computerInterfaces 10. DigitalgenomeAdapted fromWorld Economic Forum, 2014&2015

The10toptechnologiesofthefuture

Adapted fromWorld Economic Forum, 2014&2015

2014 20151. Bodyadaptedwearableelectronics 1. Fuelcellvehicles

2. Nanostructuredcarboncomposites

2. Next-generationrobotics

3. Miningmetalsfromdesalinationbrine

3. Recyclablethermosetplastics

4. Gridscaleelectricitystorage 4. Precisegenetic-engineeringtechniques

5. Nanowirelithium-ionbatteries 5. Additivemanufacturing

6. Screenless display 6. Emergentartificialintelligence

7. HumanMicrobiomeTherapeutics 7. Distributedmanufacturing

8. RNA-basedTherapeutics 8. ‘Senseandavoid’drones

9. QuantifiedSelf(PredictiveAnalytics)

9. Neuromorphic technology

10. Brain-computerInterfaces 10. Digitalgenome

Integrating (disciplinary)knowledge

TargetedS&T

Research

Societalchallenges

SSHResearch

KeyEnabling

TechnologiesSystemsinnovation

Towardsamission-orientedFP9?

Interdisciplinarity

• DirectvsindirectimpactsØ ComparingachievementtoobjectivesØ Checkingthetimefactor

• Failureà noSEeffects• Delayà SEeffectstoappearlater• Conditionalityà needforadditionalactions

Basicconcepts

Impactassessment:longtermprocess

INPUT OUTPUT RESULTS/OUTCOME

IMPACTS(economic,social,environmental)

ProgrammeEnd

Programmeduration(approx.5years) Until2to5years

UNTIL10TO20ANDMOREYEARSAFTERTHEENDOFTHEPROGRAMME

BasedonEx-anteassessmentoftheFP7Researchprogramme- Generalprocessandtime-frame

• DirectvsindirectimpactsØ ComparingachievementtoobjectivesØ Checkingthetimefactor

• Failureà noSEeffects• Delayà SEeffectstoappearlater• Conditionalityà needforadditionalactions

• SEimpactvsSEdimensionØ Inputs(dimension)Ø Outputs(impacts)

Basicconcepts

Assessmentframework:SEimpactandSEdimension

QUALITATIVE ASSESSMENT QUANTITATIVE ASSESSMENT

INPUTS

(SE DIMENSION)

ð SE topics addressed ð Multidisciplinarity

of research teams

ð Amount of resources − Staff − Budget

ð Other input variables

OUTPUTS (SE IMPACT)

ð Societal changes induced

ð SE systems affected ð Policy actions

generated ð Identification of

further research needs

ð Changes in SE performance − Welfare − Other SE performance

variables (environment, health, etc.)

ð Efficiency in the use of resources (i.e. I/O ratios)

• Projectsresultsarepolicyrelevantiftheyarecitedinpolicydocuments• Search(primarilythroughEURLEX)forreferencestoKBBEprojectsin“policy

documents”,i.e.Ø CommissionworkingdocumentsØ Communications toCouncil,EP,EESCØ Regulation/DirectivesØ ReportstoCouncil,EP,EESCØ Green/WhitePapersØ Writtenquestions (EP)Ø Opinions (EESC)

PolicyImpactAssessment(expost)…theapproach

BasedonEx-anteassessmentoftheFP7Researchprogramme- Generalprocessandtime-frame

EnvironmentR&Ipolicycitations

0

2

4

6

8

10

12

14

16

1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011

PolicydocsinEURLEXw/oWrittenQuestions (/1000) Policycitations ofenv.projects

Interdisciplinarity

• Multidisciplinarity=juxtaposition

• Interdisciplinarity=interaction

• Trans-disciplinarity=integration

Complexity

• ObjectivesnotalignedØ Scientificprogressvs.societalproblemsolving

• Language(unwilling?)• Academicbadhabitofworkingin(disciplinary)

isolation:thefishtank syndrom• Disciplinarycarrierpaths

Barrierstointedisciplinarity

• CombiningnaturalscienceswithSSH• Integrationofdifferentthematicdisciplines

(transport+energy+environment+landuse…)

• Verticalintegration(policydrivenR&I)

• Combiningqualitativeandquantitativemethods

Inter(trans)disciplinarity andSSH

Capabilityofanalysingcomplexsystems

Capabilityofinvolving relevantstakeholdersalong theentireprocessofpolicy/decisionmaking

Anexample

QUAL

QUAL/QUANT

QUANT

QUANT

QUAL

• CombiningnaturalscienceswithSSH• Integrationofdifferentthematicdisciplines

(transport+energy+environment+landuse…)

• Verticalintegration(policydrivenR&I)

• Combiningqualitativeandquantitativemethods• Impactassessmentandintegrated(social)cost/benefit

analysis

Inter(trans)disciplinarity andSSH

Capabilityofanalysingcomplexsystems

Capabilityofinvolving relevantstakeholdersalong theentireprocessofpolicy/decisionmaking

• Contributiontothethree“sustainabilitypillars”:economy,societyandenvironmentØ EconomicimpactsmeasuredthroughindicatorsØ Environmentalandsocialnotmeasurablethroughstandard

quantitativevariables• Lackofacomprehensiveandsystematicframeworktomonitorandmeasuresocio-economicimpacts

• Quantitativeevidenceisscarce

Impactsoftheresearchpolicy

EconomicimpactsareasMacroeconomiceffectsoftechnologicalprogress

P.Zagamé2015

Benefitsprimarilyassessed(andRTDinvestmentsjustified)intermsofmacro-economicimpacts(GDPandjobsforsocietyasawhole)

Socialimpactsareas(1/2)

Socialimpactsareas(2/2)

Environmentalimpactsareas(1/2)

Environmentalimpactsareas(2/2)

Ø CertainlyoneofthemostdifficulttoassessØ Onefocus:tacklereal/perceivedbarriersthatdeterdisadvantagesgroups

toenteringtoscientificeducationsandcarriersØ SocialexclusionalsoaddressedbytransportEUprojectsØ Directconnectionbetweensocialcohesionandpenetrationofmobile

communicationtechnologiesanddevices

Ø Participation,withdirectcontributions,tointernationalorganisationhasbeenincreasinglypromotedinpreviousFPs

Ø Differenteconomicandmethodologicalapproach

Socialimpactsareas- examples

Assessing the Social and Environmental Impacts of European Research – Report to Commission

Theimpacts intheH2020proposals

• Theproposalshouldhaveanimpactorientedapproachdeliveringsolutionsaddressingkeysocietalandtechnicalchallenges

• Impact(aswellasInnovation)mustbe:Ø Addressedinallsectionsoftheproposal,notjusttheimpactsectionØ Managedinallstagesofaproject,notjustafterresultshavebeen

created

• Benefits(henceimpact)doesnothavetobefinancial• Theimpactoftheinnovationcanbesocietal,research,

environmental,technical,commercial,educationaloranythingthatdeliversbenefits/addressesaneed

Impactsaspectsintheproposal

• ProposalsectionsØ PARTA:administrativesection

• Administrativeinformationaboutpartners• keywords• abstract

Ø PARTB:theproposal• Sections1to3

• 1- Excellence(science)• 2- Impact• 3- QualityandEfficiencyoftheImplementation

• Sections4-5• 4- MembersoftheConsortium• 5- EthicsandSecurityIssues

Impacts intheH2020proposals/projects

Butnotonly….

• Contributiontotheexpectedimpactsmentionedintheworkprogramme (undertherelevanttopic)

• Otherimpactsnotmentionedintheworkprogramme,thatwould:Ø enhanceinnovationcapacity;Ø createnewmarketopportunities,Ø strengthencompetitivenessandgrowthofcompanies,Ø addressissuesrelatedtoclimatechangeortheenvironment,orØ bringotherimportantbenefitsforsociety

• Describeanybarriers/obstacles,andanyframeworkconditions(suchasregulation,standards,publicacceptance,etc.),thatmaydeterminewhetherandtowhatextenttheexpectedimpactswillbeachieved.

Impacts:section2.1“Expectedimpacts”

• Definitionofthe“Disseminationandexploitation”ofresultsØ Provideadraft‘planforthedisseminationandexploitationoftheproject's

results’Ø Showhowtheproposedmeasureswillhelp toachievetheexpectedimpactof

theproject.Ø Includeabusinessplanwhererelevant.Ø Includeinformationonhowtheparticipantswillmanagetheresearchdata

generatedand/orcollectedduring theprojectØ Outlinethestrategyforknowledgemanagementandprotection

• DescriptionoftheCommunicationactivitiesØ Describetheproposed communicationmeasuresforpromoting theprojectand

itsfindings during theperiodofthegrant.

Impacts:section2.2“Measurestomaximiseimpact”

“Yourplanforthedisseminationandexploitationoftheproject'sresultsiskeytomaximising theirimpact”.

(H2020template)

Noimpacts

iftheresultsarenotusedand

thecallchallengesarenotaddressed

Impactandcommunication/dissemination

disseminationvscommunication

Communication DisseminationAbouttheproject andtheresults About theresultsonly

Multipleaudiences(beyond theproject-includingmediaandthepublic)

Audiencethatmay usetheresults(e.g.professional organisations,policymakers, scientific)

Informandreachouttosociety,showthebenefitsofresearch

Enableuseanduptakeofresults

Adapted fromECslides “Adresssing ImpactandExploitation inHorizon 2020proposals”

InformingabouttheprojectInformingaboutresultsMakingresultsavailableforuse

Newsletter

Pressrelease

Projectfactsheet,brochures

Socialmedia(blogs,twitter,etc)

Training/demonstrations

Videos, interviews

Articlesinmagazines

Conferences,presentations

Scientificpublications

Policybriefs

Sharingresultsononlinerepository(software,researchdata,etc.)

ProjectWebsite

disseminationvsexploitation

Dissemination ExploitationDescribingandmakingavailableresults sothattheycanbeused

Makinguseofresults,forscientific,societaloreconomicpurposes

Audiences thatmaymakeuseofresults

Groupsandentitiesthataremakingconcreateuseofresults

Allresults whicharenotrestrictedduetotheprotectionofIP,securityrulesorlegitimateinterests

Allresultsgeneratedduringproject.Participantshallmakebesteffortstoexploittheresultsitowns

Adapted fromECslides “Adresssing ImpactandExploitation inHorizon 2020proposals”

Makingresultsavailable Facilitatingfurtheruseofresults Makinguseofresults

Scientificpublication

Pressbrief

Training/workshops

Scaringresultsononlinerepository

Furtherresearch Service

Copyrightmanagement

DMP

Activestakeholder/userengagement

Patent Spin-off/start-up

PhDthesis Product

Policychange

Openlicenses

Innovationmanagement

Disseminationandexploitationgotogether!

1. Excellence2. Impact3. Implementation

• 5pointeach(totalscore:15)• Threshold:3percriterion• Atleast10intotal

• Fortheevaluationoffirst-stageproposalsunderatwo-stagesubmissionprocedure,onlythecriteria‘excellence’and‘impact’willbeevaluated

(thresholdforbothindividualcriteriawillbe4)

H2020EvaluationCriteria

Typeofactions

Indirectcost:25%ofdirectcosts(excludingsubcontractandthirdpartycosts)

Research&InnovationAction

Research&InnovationAction

•R&Dtoestablishnewknowledgeorexplorethefeasibilityofaneworimprovedtechnology,product,process,serviceorsolution(includingbasicandappliedresearch,technologydevelopmentandintegration,testingandvalidationonasmall- scaleprototypeinalaboratoryorsimulatedenvironment)•Funding rate:100%

InnovationActionInnovationAction

• Innovationactivitiesdirectlyaimingatproducingplansandarrangementsordesignsfornew,alteredorimprovedproducts,processesorservices(includingprototyping,testing,demonstrating,piloting,large-scaleproductvalidationandmarketreplication)

• Fundingrate:70%(100%forno-profitorganisations)

Coordination&SupportAction

Coordination&SupportAction

•Accompanyingmeasuressuchasstandardization,dissemination,awareness-raisingandcommunication,networking,coordinationorsupportservices,policydialoguesandmutuallearningexercisesandstudies(includingdesignstudiesfornewinfrastructureandcomplementaryactivitiesofstrategicplanning,networkingandcoordinationbetweenprogrammesindifferentcountries)•Fundingrate:100%

Typeofactions/“Impact”asawardcriteria

RIA IA CSA

Expected impactslistedintheworkprogrammeundertherelevanttopic

• Enhancinginnovationcapacityandintegrationofnewknowledge;

• StrengtheningthecompetitivenessandgrowthofcompaniesbydevelopinginnovationsmeetingtheneedsofEuropeanandglobalmarkets;and,whererelevant,bydeliveringsuchinnovationstothemarkets;

• Anyotherenvironmentalandsociallyimportantimpacts(notalreadycoveredabove);

• Effectivenessoftheproposedmeasurestoexploitanddisseminatetheprojectresults(includingmanagementofIPR),tocommunicatetheproject,andtomanageresearchdatawhererelevant.

• Effectivenessoftheproposedmeasurestoexploitanddisseminatetheprojectresults(includingmanagementofIPR),tocommunicatetheproject,andtomanageresearchdatawhererelevant.

Eachsub-criterioncorresponds toanassignedscore!!!

0: Theproposalfailstoaddressthecriterionunderexaminationorcannotbejudgedduetomissingorincompleteinformation1: Poor.Thecriterionisaddressedinanadequatemanner,orthere areseriousinherentweaknesses.2: Fair.Whiletheproposalbroadlyaddressesthecriterion,there

aresignificantweaknesses.3: Good.Theproposaladdressesthecriterionwell,although

improvementswouldbenecessary.4: Verygood.Theproposaladdressesthecriterionverywell,although certainimprovementsarestillpossible.5: Excellent.Theproposalsuccessfullyaddressesallrelevantaspectsof thecriterioninquestion.Anyshortcomingsareminor.

Evaluationscores

• Calltitleandidentificationcode(e.g.MG-4.3-2017:InnovativeapproachesforintegratingurbannodesintheTEN-Tcorenetworkcorridors)

• Specificchallenge• Scope• Expectedimpact• Typeofaction• Budget• Deadline

Impactssectioninthecall

• I3U“InvestigatingtheImpactoftheInnovationUnion”projectØ Duration:2015-2018/Budget:2,931K€ /9partnersin9differentcountries

Ø ExpectedimpactssetoutintheworkprogrammeØ ContributiontothegovernanceofinnovationatEUandMSlevelØ ImpactoneconomicresearchØ ImpactonrelevantcommunitiesandonsocietyatlargeØ +diagrams

Exampleofsection2.1inanongoingproject

• Calltitle:Sustainable Food Security– Resilientandresource-efficient value chain

Ø DisseminationandexploitationofresultsØ Communicationactivities(visualidentity,website,socialmedia,

newsletter)Ø 2DedicatedWPs:

• Multi-stakeholderaction• Disseminationandexploitation

Ø +tables,figuresanddiagrams

Exampleofsection2.2inaproposalundernegotiation

Understandtheevaluationprocess

Evaluationprocess

ProgettualitàEuropea

FullProposal

Proposalforms

Evaluators

Eligibility

Evaluators Evaluators

PanelSubmission ConsensusIndividualevaluation Finalisation

ESRs(EvaluationSummaryReports)&Proposalsinsuggestedpriorityorder

CriteriaCriteria Criteria

COMMISSION

Role ofexperts

Thresholds

Finalrankinglist

Rejectionlist

COMMISSION

Individualassessmentoftheproposals

ProgettualitàEuropea

Proposal X

Proposal X

Proposal X

IARexpert 1

IAR expert 2

IAR expert 3

Consensus meeting

CR

“Remote” Brussels

Proposal XIAR expert 4

IAR = Individual Assessment Report CR = Consensus Report

There are usually between 3 and 5 experts allocated to each proposal

• Receiptbeforedeadline• Minimumnumberofpartners• Completenessofproposal• "Outofscope"

EligibilitycheckPerformedbyECstaffbeforeevaluation

• Allexpertshavingreadthesameproposalmeetinaconsensusmeetingtodiscusstheproposal

• ObjectiveistoreachanagreementonscoreandcommentsØ ItisnormalforindividualviewstochangeduringthediscussionØ ThefinalresultisNOTanaveragescoreofindividualscoresbuta

built-upconsensusbasedonthecommentsØ Ifdeadlock:minorityvieworextraevaluatorsarecalledin

• Oneexpertactsasrapporteur(draftstheCR)• MeetingmoderatedbyECstaff

Ø Impartialmoderation:noopinionbutnotpassiveØ ProvidesinformationifnecessaryØ EthicalReviewFormtobefilledinifapplicable

Consensusmeeting

• AllexpertsarejointlyresponsiblefortheCRdraftedbytheRapporteur

• Qualityisveryimportant:thisisthebasisofthetextgivenasfeedbacktoapplicants!Ø Clearandfairassessmentofproposalwithjustifications,feedback

onweaknessesandstrengths• Tobeavoided:

Ø RecommendationsinviewofresubmissionØ Non-constructivelanguageandexpressions

• Moderatorchecksconsistencybetweenscoresandcomments

• Proof-readingbynativeEnglishspeakerisprovided

Consensus report(CR)

• Objective:establisharankedlistofproposalseligibleforfunding- onePanelperbudgetline(topicoractivitypanels)

• Meetingbetweenevaluators,moderatedbyECstaff• Discussconsistencyofscoresandcomments,minorityviews,

proposalswithequalscores,etc.• Recommendpriorityorder(hierarchyofcriteriacanbeapplied)and

possiblechangesinscoresorCRcomments• Providecomments,recommendationsontheranking,beconstructive• FinaliseEvaluationSummaryReports(tobesenttoapplicants)• Attheend,allexpertssignthePanelReport

Final panelmeeting

• InitialinformationlettertoCoordinatorwithESR(EvaluationSummaryReports)Ø Excellentqualityisnecessary:coherenceandlanguageØ Transparencyandcredibilityoftheprocess

• Redressprocedures- forcomplaintsonevaluationresults• Drawupfinalrankinglist• InformationtoProgrammeCommittee• “Non-Negotiation”withfundedproposals• Consultation/informationofProgrammeCommittee• OfficialCommissiondecisionforfunding• Grantagreementissued(proposalbecomesproject)

Follow-uppost-evaluation (ECstaff)

Ingredients ofaresearch project

• Whichistheproblemtobesolved?• WhyaddressitatEuropean/internationallevel

(insteadofnationallevel)?• Istheproposedsolutionalreadyavailable?• Whatwillhappeniftheresearchwillbefunded?• Whytheproposedconsortiumshouldbefunded?

Key questions

• Individualqualityofthepartners• Multidisciplinariety• Stakeholders’involvement• Long-standingexperiencein

communication/dissemination• Long-standingexperienceincoordination• Interestinworkingtogetherandshare

results/experiences

Theconsortium

• Tocomplytothedescriptionofthecall/topic• Tostartfromtheend:evaluationprocessandcriteria• Tohavea“good”ideaandconsortiumisnotenough• Toclearlystatethefinalobjectivesandhowtheywill

bereached:Ø MethodsandapproachesØ Examplesofpotentialdevelopments

Contents (1/2)

• Todefinethe“impacts”isprobablythehardestpart:Ø Avoidbanality/redundancyØ Ensuremeasurability,relevancetotheEuropeanpoliciesØ Proposeconcreateandinnovativedisseminationactions.

• Keepattentiontothelanguageandstyle:theevaluatorscouldbenot“experts”inthetopicasyouare!

Contents (2/2)

• Toidentifythetechnicalofficerofthecall• Tocontrolif,amongpartners,somebodyknows

her/him• Tomakequestions/askforclarificationsevenif…• Youmightnotexpectsubstantialcontributions!• Evenifsimplified,theadministrativeprocedures

remainssignificant:Ø TrustthecoordinatorØ AsksupporttotheEChelpdesks

Liaise withtheCommission

• DoyoureallywanttobeaCoordinator?• Toestablishagoodconsortium:

Ø Thehardestpart!Ø Startassoonaspossible(evenbeforethe

publicationofthefinalversionofthecall)Ø Tohaveaproposaloutlinehelpstoengagepartners

Key elements

• bottom-upapproachØ Defineroles(atleastWPleaders)Ø WPleadersdraftinputØ Coordinatorcollectanddrafttheproposal

• top-downapproachØ DefineageneralcommonagreementamongpartnersØ Coordinatordraftsthefirstversionoftheproposaland

circulateittocollectscomments/ideas,etc.

Proposal drafting (1/2)

Pros Cons

Bottom-up Democraticprocess:toensureagood levelofcreativity(withreferencetocontributions andmultidisciplinarity)

ItrequiresseveralinteractionsandmediationeffortsTimeconsumingAtleastapreparatorymeetingwithpartners

Top-down Coherenceandconsistencyofthefinal“product”(contentsandstyle)Short timefordraftingRecognisetheroleofthecoordinator

ItrequiresahugeeffortsconcentratedonfewpeopleUndemocraticprocess:fewinteractionsamongpartners

Proposal drafting (2/2)

• Timing:Ø 2/3months(basedonthecomplexityofthe

proposal)Ø Todefinethepartnershipassoonaspossible(at

leastthe“core”consortium)• Cost

Ø Between2and5PMs(basedonthecomplexityoftheproposal,theexperienceofthestaffandthesizeoftheproject)

Resourcesneededtoprepareaproposal

• Selectthemostsuitablepartnersfortheproject:fittingthecontextandthetypeofcall/project

• Select partnerswithrelevant(technical)experiencetoaddresstheissuesinthecall

• Ensuregeographicalbalance,varietyinthetypeandcompetencesoftheselectedorganisations (synonymofbalancedbudget)

• Ensure jointwritingoftheproposalandreliabilityofthepartnership(leaderships)

Partnership:successfactors

Questions?

Thank you foryour attention!

LoredanaMarmoralmarmora@isinnova.org

www.isinnova.org