EPSRC, its Application and Peer Review Process

Dr Emma King

Myths, legends of EPSRC and its peer review system

If you make your proposal cheaper, the If you make your proposal cheaper, the chances of being funded…chances of being funded…

a) Increasea) Increase

b) Remain the sameb) Remain the same

c) Decreasec) Decrease

The maximum duration of a project is…The maximum duration of a project is…

a) 3 yearsa) 3 years

b) 5 yearsb) 5 years

c) There is no maximumc) There is no maximum

Project students…Project students…

a) Have a maximum duration of 3 yearsa) Have a maximum duration of 3 years

b) Have a flexible durationb) Have a flexible duration

c) Should be worked into the gravec) Should be worked into the grave

Impact is…Impact is…

a) A needless burden that peer review a) A needless burden that peer review doesn’t take any notice ofdoesn’t take any notice of

b) The primary criterion for assessmentb) The primary criterion for assessment

c) Considered by reviewers in their c) Considered by reviewers in their assessment and as one of the secondary assessment and as one of the secondary criteria at panel.criteria at panel.

Of the nominated reviewers…Of the nominated reviewers…

a) At least one is asked to commenta) At least one is asked to comment

b) At least one is guaranteed to commentb) At least one is guaranteed to comment

c) None will be askedc) None will be asked

If a proposal receives a strongly negative If a proposal receives a strongly negative reviewer comment the applicant should…reviewer comment the applicant should…

a) Ignore it - the panel will make its own judgementa) Ignore it - the panel will make its own judgement

b) Respond with a detailed rebuttalb) Respond with a detailed rebuttal

c) Give up as the proposal is doomedc) Give up as the proposal is doomed

Resources on funded grants are cut…Resources on funded grants are cut…

a) When justified by peer reviewa) When justified by peer review

b) b) To meet the budget of each panelTo meet the budget of each panel

c) c) At the sole discretion of the panelAt the sole discretion of the panel

The criteria for the 12 month cooling-off The criteria for the 12 month cooling-off period for unsuccessful applicants are…period for unsuccessful applicants are…

a) a) Three or more proposals ranked in the bottom half OR an overall personal success rate of less than 25% within a two year period.

b) b) Three or more proposals ranked in the bottom half AND / OR an overall personal success rate of less than 25% within a two year period.

c) c) Three or more proposals ranked in the bottom half AND an overall personal success rate of less than 25% within a two year period.

You can call or email us…You can call or email us…

a) By appointmenta) By appointment

b) At any timeb) At any time

c) Via your head of departmentc) Via your head of department

Format of the session

Brief introduction to EPSRC,

EPSRC Application process,

Case for support and choosing nominated reviewers,

How to apply,

EPSRC peer review process,

Responding to reviewers,

Roles of panel members, EPSRC,

What happens next?

Brief Introduction to EPSRC

The Engineering and Physical Sciences Research Council

We are the main UK government agency for funding research and training in engineering and physical sciences.

We invest around £850 million a year so the UK will be prepared for the next generation of technological change.

One of seven Research Councils.

The whole EPSRC picture

Living with environmental change (£9M) Global threats to security (£6M)Ageing: life-long health and wellbeing (£11M)

Values are commitment 2008-11

Essential Platform Programme Structure

Cross-Disciplinary Interface

Information & Communications Technology

Materials, Mechanical & Medical Engineering

Mathematical Sciences

Physical Sciences

Process, Environment & Sustainability

Public Engagement

Research Infrastructure & International

Commitment Budget 2008-2011£866m (grants) £592m (people)

Mission and User-Led Programmes

Digital Economy

Energy Multidisciplinary Applications

Energy Research Capability

Nanoscience through Engineering to Application

Towards Next Generation Healthcare

Commitment budget 2008/11 £398

Knowledge Transfer

User-Led Knowledge & Skills

User-Led Research

Commitment budget 2008/11 £482

Research Grants: Research Base

No closing dates,

Any topic in EPSRC’s remit,

Research direction decided by applicant,

Primary assessment criterion is quality,

Highly flexible – support from £1k £5m, can include;

Travel grant;

Visiting fellow;

Project students;

Proof of concept;

Equipment.

Research Grants: Targeted Calls

For research in a particular subject area:

Proposal must meet certain criteria to be considered against the call,

Assessment criteria will be given,

Fixed closing date, often an outline stage,

Latest calls for proposals at www.epsrc.ac.uk,

Sign up for an automatic e-mail alert.

Application process – what to include

A standard proposal has:

Application form (JeS form).

Case for support to include:

Track record of applicants (max 2 sides of A4),

Description of proposed research (max 6 slides of A4),

Diagrammatic work-plan (1 side of A4),

Justification of Resources (up to 2 sides of A4),

Pathways to impact (up to 2 sides of A4),

Annexes – only allowed:

Letters of support,

Equipment quotes,

CV for visiting Researchers and RAs (max 2 pages each of A4).

Good Work Plans

Are clear and easy to read.

Describe the work that is proposed, so:

Match the work packages in the case for support,

Show how the work packages are linked.

Explain the different roles in the proposal.

Justification of Resources (JoR)

A separate document to the case for support.

Should clearly describe what is being asked for, how much and why you need it,

Should justify every item you request in your JeS form, apart from the estates and indirect costs,

PI and CoI time should be justified rather than the cost.

Poor JoRs: Lists without including a justification of why it is needed.

Hard to read, layout doesn’t follow the costings on the JeS form.

Misses out justifications for costings in the JeS form.

Costs/items in the JeS form don’t match the ones in the JoR.

Doesn’t to justify the PI and CoI time in the grant.

Doesn’t justify or explain the travel and subsistence section.

Mix up pooled technicians with infrastructure technicians.

Ask for money to supervise PhD students – not allowed.

Pathways to Impact

Research Council description:

‘The demonstrable contribution that excellent research makes to society and the economy.’

Aims:

NOT to change the type of research,

To encourage applicants to think about the potential impact of their research at the time of planning it,

‘Impact’ does not equal ‘applied’ or ‘industry’.

Pathways to Impact Implication for applicants:

Two new sections on Jes form:

Impact summary,

Academic beneficiaries.

Case for support attachment:

Pathways to impact – separate document expanding information in summary.

Resources:

Ask for and justify what you need,

Consider timescales of a project.

Letters of Support

Only include if they add to the proposal.

For example, letters that say “I support this proposal and look forward to the results” are not strengthening the case for the proposal.

Good letters of support are those that contribute to the proposal (in cash or in kind).

Note that letters of support can not be added to the proposal after it has been submitted through JeS.

Writing the Case for support

Considerations before applying:

Idea should be: cutting edge science; creative; value for money; adventurous; have significant impact (on whom)?

Is this appropriate for collaboration?

Is this suitable for a multi-project application?

Is this multi-disciplinary?

Suitable for long-term (more than 36 months)?

Should/could this be a feasibility study?

Look at the reviewer forms,

(on website at: http://www.epsrc.ac.uk/Forms/Reviewers/default.htm).

Emphasise – these are the people to convince; they are the experts in the research field. Be clear about the ideas and management issues. Provide a good, clear and concise work-plan.

Panel Assessment Criteria.

For targeted calls – objective of the call and criteria.

Consider the audience you are writing to:

Advice on choosing nominated reviewersChoose:

People who are experts in the research field and/or able to judge the value of the research to people who might use its results.

Don’t choose:

Someone who has a close working relationship in the past e.g. PhD supervisor.

Or now e.g. project partner, someone from the same organisation as the PI or CoIs.

More than one reviewer from the same organisation.

How to apply

EPSRC Staff can NOT access JeS.

Proposals can NOT be submitted after a call closing date / time.

Once a proposal is submitted, it can NOT be changed.

To note:

Checks on costings, documentation are performed at the registration stage. Once registered, any amendments needed, proposal will have to be rejected.

JoRs are checked just before the reviewers are added. If incorrect, it will be returned to the PI to amend. Have one chance to amend, if still not right will be rejected.

Top tips Speak to your Research Office for costings and how to use JeS,

Get someone who is successful at getting funding from EPSRC to read through your proposal,

Ask to see successful grant applications and unsuccessful,

Get someone who is on EPSRC peer review college to read your grant and to assess it as a reviewer would.

Peer Review Process

The Peer Review Process

Standard – reviewers then panel.

Targeted – vary according to the scheme/call,

this could be:

Panel only,

Reviewers then interviews etc.

The Peer Review Process

Proposal Portfolio Manager

Reviewers:One from ProposerTwo from College

EPSRCCollege

PI Response

Unsupportive

Rejection

Supportive

Peer ReviewPanel

Rank Order

Head of Programme

Budgetfrom Council

FundNot Fund

Who are the reviewers?

Approach at least:

One of three reviewers nominated by applicant – (think carefully who you nominate),

Two members of the EPSRC College of experts.

May also approach:

Other independent reviewers,

Previous reviewers for continuity for invited resubmissions.

Research Base Panel Reviewer Criteria

Assess against:

Excellence,

Novelty, timeliness, context, ambition, adventure, methodology.

Impact,

Beneficiaries, collaborators, dissemination, knowledge exchange.

Applicant,

Skills, track record, research partners,

ability to deliver.

Resources & Management.

Overall assessment.

Assess whole proposal as:

Very strong – fully meets criteria.

Strong – broadly meets criteria.

Good – meets criteria with minor weaknesses.

Meets criteria but with clear weaknesses.

Does not meet one or more criterion.

Flawed.

Applicant Response to Reviewers

Panels place great emphasis on the usefulness and

quality of the response.

Lack of suitable response to key issues may lead to a

lower ranking of a really good proposal.

Read reviewer comments carefully and provide a

balanced response.

Respond to ALL reviewer comments (five working

days to respond).

Role of the Panel

Their primary role is:

To generate a rank ordered list of research proposals in priority order for funding.

Based on:

The assessment of the reviewers.

The proposer’s response to reviewers.

Technical assessments from facilities (if relevant).

Role of the EPSRC at the Panel

The role of EPSRC Officials is to:

Facilitate the meeting,

Offer guidance on EPSRC rules and procedures,

Record decisions and comments,

Feedback any advice from the Panel to applicant.

Outside the meeting:

To determine the funding cut-off and allocation of resources to the competing proposals.

The Panel Process

Two speakers per proposal – one expert, one generalist.

Speakers score each section of the reviewer form (quality, impact, applicant(s) ability, resources and management) based on the reviewer comments and PI response to these.

Overall score - based on the individual criterion scores.

Speakers and panel agree overall score and rank position, based on the speaker pre-scores and discussions.

Note: scores are only a tool used at panel to generate the rank ordered list. Rank position is important not the score.

What happens next?

Funding meeting with HoP and convenor – funding decisions made.

Confirmation letter within two weeks after the panel.

Feedback – only if panel direct.

What happens if the proposal is not funded?

Resubmissions:

No longer accept uninvited resubmissions.

Definition: any proposal submitted to EPSRC through any funding scheme,

Or any proposal considered by another funding scheme.

If a proposal is submitted and it’s a resubmission, then it will be rejected. Count as unsuccessful application.

12 month cooling-off period for unsuccessful applicants

Why are we doing this?

To help alleviate pressure on all involved in peer review.

What is the criteria for selection?

PIs who have three or more proposals within a two year period ranked in the bottom half of the prioritisation list or rejected before panel, AND an overall personal success rate of less than 25% over the same two years.

When does the policy come into place?

April 2010.

Monthly email to affected applicants, copied to RO.

Applicants meeting the criteria: allowed to submit one application during the next 12 months and asked to review their resubmission behaviour.

What is the purpose of the cooling-off period?

For applicants to assess submission behaviour and, if appropriate, seek advice from colleagues about the application process or submission strategy.

How will a cooling-off period end?

Automatically ends 12 months after the start date. We will expect to receive details about what steps have been taken to address issues with submission behaviour.

What happens if the proposal is funded?

Offer letter pack is sent.

Pack includes starting certificate.

Once the PI starts the project, your finance office submits the starting certificate.

Do you want to find out more information?

See www.epsrc.ac.uk:http://www.epsrc.ac.uk/funding/Pages/default.aspx

http://www.epsrc.ac.uk/funding/apprev/Pages/default.aspx

http://www.epsrc.ac.uk/funding/forms/Pages/default.aspx

Come to a EPSRC Study Day:http://www.epsrc.ac.uk/about/partner/universities/Pages/studydays.aspx

Contact: emma.king@epsrc.ac.uk

01793 44 4419.