Writing a Successful XSEDE Proposal
description
Transcript of Writing a Successful XSEDE Proposal
![Page 1: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/1.jpg)
April 21, 2023
Writing a Successful XSEDE Proposal
Ken Hackworth
XSEDE Allocations Coordinator
![Page 2: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/2.jpg)
Outline• References & Terms• Main Document and guidelines for XSEDE Research (XRAC)
RequestI. Research ObjectivesII. Computational Methodology (and Applications/Codes
to be used)III. Application Efficiencies IV. Computational Research PlanV. Justification for SUs (TB) requestedVI. Additional considerations
![Page 3: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/3.jpg)
Outline continued:
• Other Documents (*Progress Report and Publications for Renewals)• Review Criteria• Overview of Proposal (Request) Types and Actions• XSEDE Awards (Allocations)• XSEDE Systems (Resources)• Procedures for submitting Allocation request
![Page 4: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/4.jpg)
The Lingo
• Startup Development/testing/ porting/benchmarking
• Education Classroom, Training• Research Program (usually funded)
• PI Principal Investigator• POPS Partnerships Online Proposal System • XRAC XSEDE Resource Allocations Committee• SU Service Unit = 1 Core-hour
Allocation Request Types
3 Types ofXSEDEProjects
![Page 5: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/5.jpg)
“Traditional” v. Community
• XRAC proposals are accepted in four general categories of research activities– Single Principal Investigator– Large research Collaborations (e.g., MILC consortium)– Community Consortiums (e.g., NEES)– Community Services (e.g., XSEDE Gateways)
• The general requirements for proposals of all four types remain largely the same.– Whether requesting compute, storage, visualization,
or advanced support or some combination
![Page 6: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/6.jpg)
General Proposal Outline
I. Research ObjectivesII. Computational methodology (Applications/Codes)III. Application efficienciesIV. Computational Research PlanV. Justification for SUs(TB) requestedVI. Additional considerations
Note: Sections III and IV are often integrated.
![Page 7: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/7.jpg)
I. Research Objectives
• Traditional proposals– Describe the research activities to be pursued
• Community proposals– Describe the classes of research activities that the proposed effort will
support.• Keep it short: You only need enough detail to support the
methods and computational plan being proposed.• TIP—Reviewers don’t want to read the proposal you
submitted to NSF/NIH/etc., but they need to see if you have merit-reviewed (grant) funding.
![Page 8: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/8.jpg)
II. Computational Methods (and Applications/Codes used)• Very similar between traditional and community proposals.• For compute requests
– Describe the Applications and components you will use.– Describe the methods/algorithms employed in your computational
research– Describe code development/features/advances ‘home-grown’ codes.
• For storage requests– Provide description of data to be stored (organization, formats,
collection mechanisms, permissions granted or received)– Describe the amount and expected growth of data to be stored.
![Page 9: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/9.jpg)
III. Application Efficiencies
• Very similar between traditional and community proposals.• For compute requests
– Explain why you chose specific resources for your applications. – Provide performance and scaling details on problems and test cases
similar to those being pursued. (What is the appropriate scale for your problem?)
– Ideally, provide performance and scaling data collected by you for the specific resource(s) you are requesting.
• For storage requests– Explain the efficiency of your storage algorithms and protocols. – Describe and estimate the expected costs of scaling to larger data sets
and a larger number of clients.
![Page 10: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/10.jpg)
IV. Computational Research Plan
• Traditional proposals– Explicitly describe the problem cases you will examine
• BAD: “…a dozen or so important proteins under various conditions…”• GOOD: “…7 proteins [listed here; include scientific importance of these
selections somewhere, too]. Each protein will require [X] number of runs, varying [x] parameters [listed here] [in very specific and scientifically meaningful ways]…”
• Science Gateway proposals– Explicitly describe the typical use-case(s) that the gateway supports
and the type of runs that you expect users to make– Describe how you will help ensure that the community will make
scientifically meaningful runs (if applicable)• BAD: “…the gateway lets users run NAMD on XSEDE resources…”• BETTER: “…users will run NAMD jobs on [biological systems like this]…”• BETTER STILL: “…the gateway allows users to run NAMD jobs on up to 128
processors on problem sizes limited [in some fashion]…”
![Page 11: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/11.jpg)
V. Justification of SUs, TBs
• Traditional, Research proposals– If you’ve done sections II, III and IV well, this section
should be a straightforward math problem– For each research problem, calculate the SUs required
based on runs (base units) defined in IV and the timings in section III, broken out appropriately by resource
• Reasonable scaling estimates from test-case timing runs to full-scale production runs are acceptable.
– Clear presentation here will allow reviewers to award time or storage in a rational fashion
– Analogous calculations should apply for storage requests
![Page 12: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/12.jpg)
V. Justification of SUs, TBs
• Community (gateway-type) proposals– The first big trick: Calculating SUs when you don’t know the precise
runs to be made a priori.– renewIn Year 2 and beyond
• Start with an estimate of total usage based on prior year’s usage patterns and estimate for coming year’s usage patterns.
• From this information, along with data from sections IV and III, you can come up with a tabulation of SU estimates.
– Year 1 requires bootstrapping• Pick conservative values (and justify them) for the size of the community
and runs to be made, and calculate SUs.• TIP—Start modestly. If you have ~0 users, don’t expect the reviewers to
believe that you will get thousands (or even hundreds) next year.
– Analogous calculations for TBs of storage needed
![Page 13: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/13.jpg)
VI. Additional Review Considerations
Ability to complete the work plan described(more significant for larger requests)– Sufficient merit-reviewed funding– Staff, both number and experience
Local computing environment Special Needs Other access to HPC resources
– (e.g., Campus centers, DOE centers, etc.)
![Page 14: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/14.jpg)
VI. Additional Considerations
Community (gateway) proposals these components can provide key details:– Community Support and Management Plan
• Describe the gateway interface — in terms of how it helps community burn SUs or access TBs.
• Describe plans for growing the user community, “graduating” users to Research allocation awards, regulating “gateway hogs”
– Progress report• The actual user community and usage patterns• Manuscripts thanking this service, or list articles referencing
XSEDE. – Local computing environment– Other HPC resources
![Page 15: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/15.jpg)
Renewals require a Progress Report
• For Research Project Renewal and Supplement Requests– Summary of Scientific Discoveries– Accomplishments of Computation Plan
• Usage• Achievements of the Computations (more detail than summary).
– Specify the number of publications, conferences, reportsthat result from XSEDE support.
– Contributions to other research efforts. (experimental/computational/instrumental, etc.).
![Page 16: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/16.jpg)
Other Documents:
Required:• CVs for PIs and Co-PIs (2 pages)• List of Publications resulting from the XSEDE allocation
Optional:– Code Performance & Scaling (If it won’t fit in Main Doc.)– Special Requirements – References (If they won’t fit in Main Doc.)– Other
![Page 17: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/17.jpg)
Proposal Review Criteria• Methodology
For compute requests, the choice of applications, methods, algorithms and techniques to be employed to accomplish the stated objectives should be reasonably justified. While the accomplishment of the stated objectives in support of the science is important, it is incumbent on proposers to consider the methods available to them and to use that which is best suited.(For storage requests, the data usage, access methods, algorithms and techniques to be employed to accomplish the stated research objectives should be reasonably justified. For shared collections, proposers must describe the public or community access methods to be provided.)
• State Appropriateness of Computations for Scientific SimulationsThe computations must provide a precise representation of the physical phenomena to be investigated. They must also employ the correct methodologies and simulation parameters (step size, time scale, etc.) to obtain accurate and meaningful results.
• Describe the Efficiency in Usage of ResourcesThe resources selected must be used as efficiently as is reasonably possible. To meet this criterion for compute resources, performance and parallel scaling data should be provided for all applications to be used along with a discussion of optimization and/or parallelization work to be done to improve the applications.
(For storage resources, information on required performance and expected access patterns should be provided for all data and collections to be stored and used along with a discussion of work done or planned to improve the efficiency of the data use.)
• Computational Research PlanExplain computational steps to accomplish science. Give details of computational costs. (Justification)
![Page 18: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/18.jpg)
XSEDE ProjectsAn XSEDE Project is like a bank account for allocations.
– It is permanent, only one per PI.– It holds a year’s worth of allocation (on 1 or more systems)– PI’s request an allocation renewal each year thereafter.– An Allocation awarded to a New Request creates an XSEDE
Project.
A PI’s Computational Projects evolve over the years. – Computational Projects begin, end and extend.– In subsequent years successful Renewal Requests provide
allocations for new Computational Projects under the same XSEDE Project. Your XSEDE Project remains the same.
– A Renewal Requests is just like New Request, but must contain a Progress Report of last year’s Computational Projects and list of publications from past year’s allocation.
![Page 19: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/19.jpg)
Eligibility
• Principal investigator (PI) must be a researcher or educator at a U.S.-based institution, including federal research labs or commercial organizations, (Commercial requests must guarantee that their results are publically available, and work must be in collaboration with an open science organization.)
• A postdoctoral researcher is eligible to be a PI.
• A qualified advisor may apply for an allocation for his or her class; but a high school, undergraduate or graduate student may not be a PI.
![Page 20: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/20.jpg)
Overview: Research Request
• Web forms: Investigator, Grants, Resource Request,…• Requires Main Doc. = “proposal” (pdf upload) & CV• Reviewed by experts in same Field of Science• 2.5 months from deadline to award availability• Details:
– Allocation Size: Unlimited– Reviewed: Quarterly– Deadlines: 15th of October, January, April, July– Awards Begin: 1st of January, April, July, October
portal.xsede.org AllocationsSubmit/Review Request **
![Page 21: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/21.jpg)
Overview: Startup/Education Requests
• Web forms: Investigator, Resource Request,…
• Requires only an abstract and CV• Reviewed by a XSEDE Staff (Startup Allocations Committee)
• 2 weeks from submission to award availability• For code devel / performance eval / small-scaling computations /
classroom & training instruction• Details:
– Request limit: 200,000 SUs total or combination of all resources requested– Reviewed: within 2 weeks of submission– Deadlines: None– Awards Begin: within 2 weeks of submission
portal.xsede.org AllocationsSubmit/Review Request **
![Page 22: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/22.jpg)
Proposal Document(s)
Key to a successful review:• Adhere to page limits!• “Justify” allocation request.
https://www.xsede.org/web/xup/allocation-policies**
Pg. limit: DOES INCLUDE FIGURES & TABLES.
• CV (s) required for all requests.• Abstract for startup/education request
(in forms, or as a PDF document)• Proposal “Main Document” for Research request
(renewals/supplements)
![Page 23: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/23.jpg)
The Award = Allocation• One per PI (generally)• 1-year duration• Unused SUs are forfeited at the
end of an award period• Progress report required for
renewal requests.• Add users to a grant via XSEDE
User Portal4 quarters = 1 yr allocation period
Submission Review Award
Advance
Time to renew
![Page 24: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/24.jpg)
The Resources: Computehttps://www.xsede.org/resources/overview
HPC Systems: (Kraken, Ranger, Lonestar, Steele, Trestles, Blacklight, Keeneland, Quarry, Gordon)
Advanced VIS Systems: (Longhorn, Nautilus, Spur)
HTC Systems: (Condor and OSG)
Storage Systems: (local resource storage)
![Page 25: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/25.jpg)
The Resources: Extended Collaborative Support(ECS)
• Dedicated, but limited, XSEDE staff assistance (request FTE months)
• 5 Questions which are part of resource request section of application
• Reviewers rate need for ECS (0-3)
https://www.xsede.org/ecss
![Page 26: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/26.jpg)
The Process: Steps
• Assess Systems: https://www.xsede.org/resources/overview• Determine Type of Project• Login: portal.xsede.org AllocationsSubmit/Review Request **
(“Create portal login” if first time.) • Select Action (New, Renewal, Suppl/Just/Prog/Ext/Trans/Adv)• Select project Type (Research; Startup/Edu < 200K SUs)• Fill in forms: PI/Co-PI Info, Proposal Info, Supporting
Grants, Resource Request (alloc. request/machine).• Upload proposal document(s): (Main Doc., CVs, etc.).• Update at anytime and “Save to date”• Click “Final Submission” when finished (but can still
change)
![Page 27: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/27.jpg)
Login at portal.xsede.org
![Page 28: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/28.jpg)
Example Form: New Project
![Page 29: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/29.jpg)
Example Form: PI entry page
![Page 30: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/30.jpg)
Example Form: PI entry page, populating with Portal information
Clicking on this box will auto-populate this page with your portal information
![Page 31: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/31.jpg)
Example proposal submission: Title, Abstract, FOS and Keywords
![Page 32: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/32.jpg)
Example proposal submission: Supporting grants
![Page 33: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/33.jpg)
Example proposal submission: Resource request page
![Page 34: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/34.jpg)
Example proposal submission: Resources request page (continued)
![Page 35: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/35.jpg)
Example proposal submission: Document upload page
![Page 36: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/36.jpg)
Example proposal submission: Document upload (continued)
Check mark confirms I have uploaded CV
![Page 37: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/37.jpg)
Example proposal submission: Saving and Final Submission
![Page 38: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/38.jpg)
Example proposal submission: Saving and Final Submission
![Page 39: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/39.jpg)
Example proposal submission: Successful submission
![Page 40: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/40.jpg)
Pending Request
![Page 41: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/41.jpg)
Approved Request
![Page 42: Writing a Successful XSEDE Proposal](https://reader036.fdocuments.us/reader036/viewer/2022081513/5681474b550346895db48eed/html5/thumbnails/42.jpg)
Interesting Facts
• ~600 research requests per year• ~800 other requests• ~3.5B SUs requested(3.2B are research requests)
• ~1.8B SUs awarded(1.6B are research awards)