Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award...

14
http://jetstream- cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for Underresourced Higher Education Communities Jeremy Fischer – [email protected] ORCID 0000-0001-7078-6609 A national science & engineering cloud

Transcript of Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award...

Page 1: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

funded by the National Science FoundationAward #ACI-1445604

Jetstream: A Distributed Cloud Infrastructure for Underresourced Higher Education Communities

Jeremy Fischer – [email protected] 0000-0001-7078-6609

A national science & engineering cloud

Page 2: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

What is Jetstream?• Jetstream is the first-of-a-kind distributed cyberinfrastructure (DCI)

system• It will be the first cloud facility funded by the NSF supporting all areas

of science and engineering within NSF’s scope• It will be a “science production” quality resource, rather than an

experimental system supporting computer science research such as FutureGrid, Chameleon, or CloudLab.

• Part of the NSF eXtreme Digital (XD) program - an advanced, nationally distributed, open cyberinfrastructure comprised of various computational and scientific resources connected by high-bandwidth networks, integrated by coordinated policies and operations

• The primary goal set by IU and its partners in implementing Jetstream is to create a resource that expands the users of XD program resources beyond the current community of users.

Page 3: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

What is Jetstream?• Jetstream will be a user-friendly, widely accessible cloud environment

designed to give researchers and research students access to interactive computing and data analysis resources “on demand.”

• It will provide a user-selectable library of virtual machines that users can select from to do their research.

• Software creators and researchers will also be able to choose from a VM library, create their own customized virtual machines -or- their own “private computing system” within Jetstream.

• It will enable countless discoveries across disciplines such as biology, atmospheric science, economics, network science, observational astronomy, and social sciences.

• Reproducibility: Store, publish via IU Scholarworks (DOI)

Page 4: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

Jetstream System Overview

• Distributed cyberinfrastructure; 0.5 PetaFLOPS• Globus for large scale file transfer, authentication

Page 5: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

VM Instance Sizes

Instance Type vCPUs RAM Storage Instances/NodeTiny 1 2 20 46

Small 2 4 40 23

Medium 6 16 130 7

Large 10 30 230 4

X-Large 22 60 460 2

XX-Large 44 120 920 1

Node config: 2 Intel 2680 v3 “Haswell.” 2.5 GHz base frequency. Floating point intensive operations utilizing the AVX instruction set run at 2.1 GHz.

Page 6: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

Software Stack: Metal to Atmosphere

Page 7: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

Page 8: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

Page 9: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

CI as a Technology Adoption Challenge• Performance expectancy• Effort expectancy• Perceived cost of use• Networking• Federation

Page 10: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

Page 11: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

Promoting Ease of Use and Providing Resources to the Underserved Communities

Underserved Communities

Cornell Virtual Workshops

XSEDE Campus Champions

XSEDE Training, Education, and

Outreach (TEOS)

User Guides / XSEDE KB

Page 12: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

Accessing Jetstream

Page 13: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

Jetstream Partner OrganizationsIn

itia

l co

nst

ruct

ion

(fu

nd

ed p

artn

ers)

Planned funded partners (O&M phase) Unfunded partners

Page 14: Http://jetstream-cloud.org/ Award #1445604 funded by the National Science Foundation Award #ACI-1445604 Jetstream: A Distributed Cloud Infrastructure for.

http://jetstream-cloud.org/Award #1445604

Questions?

Project website: http://jetstream-cloud.org/Project email: [email protected] - Direct email: [email protected]

License Terms

• Fischer, Jeremy. 2015. Jetstream: A Distributed Cloud Infrastructure for Underresourced higher education communities - Prepared for SCREAM15. 2015. Indiana University, Bloomington, IN. Also available at: http://hdl.handle.net/2022/20107

• Items indicated with a © are under copyright and used here with permission. Such items may not be reused without permission from the holder of copyright except where license terms noted on a slide permit reuse.

• Except where otherwise noted, contents of this presentation are copyright 2015 by the Trustees of Indiana University. • This document is released under the Creative Commons Attribution 3.0 Unported license

(http://creativecommons.org/licenses/by/3.0/). This license includes the following terms: You are free to share – to copy, distribute and transmit the work and to remix – to adapt the work under the following conditions: attribution – you must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). For any reuse or distribution, you must make clear to others the license terms of this work.

• This research was supported in part by the National Science Foundation through Award ACI-1445604. This research was supported in part by the Indiana University Pervasive Technology Institute, which was established with the assistance of a major award from the Lilly Endowment, Inc. Opinions presented here are those of the author(s) and do not necessarily represent the views of the NSF, IUPTI, IU, or the Lilly Endowment, Inc.