The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data...
Transcript of The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data...
![Page 1: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/1.jpg)
Edward Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
The Importance of Cyberinfrastructure for Research
and Education
Edward Seidel
Director, Office of Cyberinfrastructure
National Science Foundation
Louisiana State University
![Page 2: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/2.jpg)
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
Edward Seidel
Complex ProblemsRequire advanced CI
![Page 3: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/3.jpg)
Edward Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
An Important Complex ProblemWhere is it going to go?
![Page 4: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/4.jpg)
Edward Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
Collaborations for Complex ProblemsGreat Challenge of 21st Century
• Every field of science
• General Relativity
• High Energy Physics
• Geosciences, Bio, SBE...
• And all combinations...
• Cyberinfrastructure & SBE play central role in collaborations for complex problems
• No single community can attack challenges
• Technical and social/behavioral
• Compute & Data intensive
• OCI, SBE emerging together as critical
Data Tsunami
![Page 5: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/5.jpg)
Edward Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
Collaborations for Complex ProblemsGreat Challenge of 21st Century
• Every field of science
• General Relativity
• High Energy Physics
• Geosciences, Bio, SBE...
• And all combinations...
• Cyberinfrastructure & SBE play central role in collaborations for complex problems
• No single community can attack challenges
• Technical and social/behavioral
• Compute & Data intensive
• OCI, SBE emerging together as critical
Data Tsunami
![Page 6: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/6.jpg)
Edward Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
Science, Engineering, Society are being Transformed
• Complex problems require totally new methodologies
• Scale computing beyond current experience...
• Large scale data, beyond...
• Large scale collaborations, beyond...
• Good news!
• Cyberinfrastructure!
• Not so good news!
• We are not moving fast enough, spotty CI coverage!
![Page 7: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/7.jpg)
Edward Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
4. Learning & Work Force Needs & Opportunities
1.Virtual Organizations for
Distributed Communities
2. High Performance Computing
3. Data & Visualization/Interaction
NSF Vision
![Page 8: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/8.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
National CI Blueprint
![Page 9: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/9.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
National CI Blueprint
![Page 10: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/10.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
National CI Blueprint
Track 2
Track 2
Track 2
![Page 11: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/11.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
National CI Blueprint
Track 1
Track 2
Track 2
Track 2
![Page 12: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/12.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
Viz
XD
National CI Blueprint
Track 1
Track 2
Track 2
Track 2
![Page 13: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/13.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
Viz
XD
National CI Blueprint
Track 1
Track 2
Track 2
Track 2
DataNet
DataNet
DataNet
![Page 14: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/14.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
Viz
XD
National CI Blueprint
Track 1
Track 2
Track 2
Track 2
OSG OSGOSGLC LC LC
DataNet
DataNet
DataNet
![Page 15: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/15.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
Viz
XD
National CI Blueprint
Track 1
Track 2
Track 2
Track 2
OSG OSGOSGLC LC LC
Campus Campus Campus Campus Campus Campus CampusCampus
DataNet
DataNet
DataNet
![Page 16: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/16.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
Viz
XD
National CI Blueprint
Track 1
Track 2
Track 2
Track 2
OSG OSGOSGLC LC LC
Campus Campus Campus Campus Campus Campus CampusCampus
DataNet
DataNet
DataNet
Nets
![Page 17: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/17.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
Viz
XD
National CI Blueprint
Track 1
Track 2
Track 2
Track 2
OSG OSGOSGLC LC LC
Campus Campus Campus Campus Campus Campus CampusCampus
DataNet
DataNet
DataNet
Nets
![Page 18: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/18.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
Viz
XD
National CI Blueprint
Track 1
Track 2
Track 2
Track 2
OSG OSGOSGLC LC LC
Campus Campus Campus Campus Campus Campus CampusCampus
DataNet
DataNet
DataNet
Nets
Nets (campus)
![Page 19: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/19.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
Viz
XD
National CI Blueprint
Track 1
Exascale(multi-agency?)
Track 2
Track 2
Track 2
OSG OSGOSGLC LC LC
Campus Campus Campus Campus Campus Campus CampusCampus
DataNet
DataNet
DataNet
Nets
Nets (campus)
![Page 20: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/20.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
Viz
XD
National CI Blueprint
Track 1
Exascale(multi-agency?)
Track 2
Track 2
Track 2
OSG OSGOSGLC LC LC
Campus Campus Campus Campus Campus Campus CampusCampus
DataNet
DataNet
DataNet
Software
Nets
Nets (campus)
![Page 21: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/21.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
Viz
XD
National CI Blueprint
Track 1
Exascale(multi-agency?)
Track 2
Track 2
Track 2
OSG OSGOSGLC LC LC
Campus Campus Campus Campus Campus Campus CampusCampus
DataNet
DataNet
DataNet
Software Algorithms
Nets
Nets (campus)
![Page 22: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/22.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
Viz
XD
National CI Blueprint
Track 1
Exascale(multi-agency?)
Track 2
Track 2
Track 2
OSG OSGOSGLC LC LC
Campus Campus Campus Campus Campus Campus CampusCampus
DataNet
DataNet
DataNet
Software Algorithms
Nets
Nets (campus)
Apps
AppsApps
Apps
Apps
Apps
Apps
![Page 23: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/23.jpg)
Edward Seidel
National Science Foundation
Where Discoveries BeginOffice of Cyberinfrastructure
Viz
XD
National CI Blueprint
Track 1
Exascale(multi-agency?)
Track 2
Track 2
Track 2
OSG OSGOSGLC LC LC
Campus Campus Campus Campus Campus Campus CampusCampus
DataNet
DataNet
DataNet
Software Algorithms
Nets
Nets (campus)
Apps
AppsApps
Apps
Apps
Apps
Apps
VO
VO
![Page 24: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/24.jpg)
Edward
Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
Impact
TG Aggregate 6-07TACC RangerUT-K Phase 1UT-K Phase 2
TF
/s P
eak
180
854684
1,652
Greatly expanding capacity of the TeraGrid for
digital exploration with reduced oversubscription
and queue wait times.
Now
![Page 25: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/25.jpg)
Edward
Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
Impact
TG Aggregate 6-07TACC RangerUT-K Phase 1UT-K Phase 2
TF
/s P
eak
180
854684
1,652
Greatly expanding capacity of the TeraGrid for
digital exploration with reduced oversubscription
and queue wait times.
Now
Track1, Track 2d
bring this up by almost 10x!
![Page 26: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/26.jpg)
Edward Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
TeraGrid Phase III (XD)
• XD is looking for innovative proposals for a new infrastructure to deliver the next generation of high-end national digital services
• Goal is to advance science and engineering by providing researchers and educators with the capability to work with extremely large amounts of digitally represented information and making it easy to move between local and national resources
• Anticipate researchers working with much larger range of digital artifacts, including digital text, digitized physical samples, real-time data streams, …
![Page 27: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/27.jpg)
Edward Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
$100M DataNet Program(Sustainable Digital Data Preservation & Access Network Partners)
• Goals:
• Catalyze development of multi-disciplinary science & engineering data collections: open, extensible & evolvable, sustainable over 50+ years.
• Support development of a new generation of tools & services facilitating data acquisition, mining, integration, analysis, visualization.
• Status: Recommendations to NSB in Dec. Round 2 pre-proposals due Nov. 13, w/invited full proposals due May 15, 2009.
Federal
State
Local
International
Non-profit
College
University
USER
Commercial
! Multi-Sector
! Sustainable ! Extensible
! Evolvable
! Nimble
! Reliable
! User-centric
![Page 28: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/28.jpg)
Edward Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
Virtual Organizations & VOSS
• VOSS
• What constitutes effective virtual organizations? How do they enhance scientific, engineering, and education production and innovation?
• Anthropology, CS, complexity, economics, ...
• Science Gateways
• NanoHub, NEES, LEAD...
• Grand Challenges: Collaborations for complex problems
![Page 29: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/29.jpg)
National Science Foundation
Where Discoveries Begin
Edward Seidel & Fahmida Chowdhury
[email protected] & [email protected]
Office of Cyberinfrastructure
Social, Behavioral & Economic
Sciences Directorate
“Universities must significantly change organizational structures: multidisciplinary & collaborative research are needed [for US] to remain competitive in global science”
Collaborations for Complex ProblemsPITAC Report Summary
![Page 30: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/30.jpg)
National Science Foundation
Where Discoveries Begin
Edward Seidel & Fahmida Chowdhury
[email protected] & [email protected]
Office of Cyberinfrastructure
Social, Behavioral & Economic
Sciences Directorate
Collaborations for Complex ProblemsPITAC Report Summary
“Together with theory and experimentation, computational science now constitutes the “third pillar” of scientific inquiry, enabling researchers to build and test models of complex phenomena...”
![Page 31: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/31.jpg)
National Science Foundation
Where Discoveries Begin
Edward Seidel & Fahmida Chowdhury
[email protected] & [email protected]
Office of Cyberinfrastructure
Social, Behavioral & Economic
Sciences Directorate
Collaborations for Complex ProblemsPITAC Report Summary
“...inadequate and outmoded structures within the Federal government and the academy today do not effectively support this critical multidisciplinary field”
![Page 32: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/32.jpg)
National Science Foundation
Where Discoveries Begin
Edward Seidel & Fahmida Chowdhury
[email protected] & [email protected]
Office of Cyberinfrastructure
Social, Behavioral & Economic
Sciences Directorate
Collaborations for Complex ProblemsPITAC Report Summary
“Among the obstacles to progress are rigid disciplinary silos in academia...that stifle the development of multidisciplinary research and educational approaches essential to computational science.[We] must fundamentally change organizational structures to promote and reward collaborative research.”
![Page 33: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/33.jpg)
Edward Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
My Ideas for Rough Plan for Future
• Attempt to fill out holes in current CI coverage
• Software, applications, networks
• Alternate computing modalities
• Workforce development!!
• Taskforces for community input
• Expand preliminary work on VOs across NSF
• Launch new complex problems at frontiers of science and engineering
• This is all computational science: needs a home!
• CI-driven, with above pieces in place first
![Page 34: The Importance of Cyberinfrastructure for Research and ... · (Sustainable Digital Data Preservation & Access Network Partners) ¥ Goals: ¥ Catalyze development of multi-disciplinary](https://reader034.fdocuments.us/reader034/viewer/2022050123/5f8dd530af152601480d83ad/html5/thumbnails/34.jpg)
Edward Seidel
National Science Foundation
Where Discoveries Begin
Office of
Cyberinfrastructure
What are SBE Frontier Problems?
• How can we move forward together?
• Examples:
• Disaster and emergency response forecasting
• How does the human brain function?
• Understanding world economy?
• Each of these frontier problems will involve computing, data, sensors, observation, networks, VOs, ...
• Please discuss!