CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013
-
Upload
gigaom -
Category
Technology
-
view
105 -
download
3
description
Transcript of CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013
![Page 1: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/1.jpg)
Tuesday, October 1, 13
![Page 2: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/2.jpg)
CERN’S GRAND COLLISION EXPERIMENT: CLOUD
SPEAKER: Tim BellInfrastructure ManagerCERN
Tuesday, October 1, 13
![Page 3: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/3.jpg)
Tuesday, October 1, 13
![Page 4: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/4.jpg)
@noggin143
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 5: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/5.jpg)
19/09/2013 CERN Infrastructure Evolution
CERN was founded 1954: 12 European States “Science for Peace”
Today: 20 Member States
Member States: Austria, Belgium, Bulgaria, the Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway, Poland, Portugal, Slovakia, Spain, Sweden, Switzerland and the United Kingdom Candidate for Accession: RomaniaAssociate Members in Pre-Stage to Membership: Israel, SerbiaApplicant States for Membership or Associate Membership:Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine Observers to Council: India, Japan, Russia, Turkey, United States of America; European Commission and UNESCO
~ 2,300 staff ~ 1,000 other paid personnel > 11,000 users Budget (2013) ~1,000 MCHF
Tuesday, October 1, 13
![Page 6: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/6.jpg)
What are the Origins of Mass ?
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 7: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/7.jpg)
Matter/Anti Matter Symmetric?
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 8: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/8.jpg)
Where is 95% of the Universe?
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 9: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/9.jpg)
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 10: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/10.jpg)
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 11: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/11.jpg)
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 12: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/12.jpg)
Collisions
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 13: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/13.jpg)
A Big Data Challenge
19/09/2013 CERN Infrastructure Evolution 11
Tuesday, October 1, 13
![Page 14: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/14.jpg)
The CERN Meyrin Data Centre
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 15: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/15.jpg)
New Data Centre in Budapest
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 16: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/16.jpg)
Good News, Bad News
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 17: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/17.jpg)
We’re Not Special
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 18: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/18.jpg)
19/09/2013
Bamboo
Koji, Mock
AIMS/PXEForeman
Yum repoPulp
Puppet-DB
mcollective, yum
JIRA
Lemon /Hadoop /
LogStash /Kibana
OpenStack Nova
Hardware database
Puppet
Active Directory /LDAP
CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 19: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/19.jpg)
The Agile Experience
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 20: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/20.jpg)
Cultural Barriers
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 21: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/21.jpg)
Cultural Barriers
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 22: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/22.jpg)
Cultural Barriers
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 23: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/23.jpg)
Cultural Barriers
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 24: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/24.jpg)
Status• Toolchain implemented in 18 months with
enhancements and bug fixes submitted back to the community
• Now in production in 3 OpenStack clouds (over 50,000 cores in total) in Geneva and Budapest managed by Puppet
• Target is more than 300,000 cores by 2015 and 90% compute resources in the private cloud
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 25: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/25.jpg)
Summary• Constraints on resources have led to major
technology transformations at CERN• Open source community participation helps
drive cultural change and motivates staff• CERN benefits and contributes back through
code and outreach
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 26: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/26.jpg)
Questions ?
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 27: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/27.jpg)
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 28: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/28.jpg)
Service Models
19/09/2013 CERN Infrastructure Evolution
• Pets are given names like pussinboots.cern.ch • They are unique, lovingly hand raised and cared for• When they get ill, you nurse them back to health
• Cattle are given numbers like vm0042.cern.ch• They are almost identical to other cattle• When they get ill, you get another one
Tuesday, October 1, 13
![Page 29: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/29.jpg)
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 30: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/30.jpg)
19/09/2013 CERN Infrastructure Evolution
http://www.eucalyptus.com/blog/2013/04/02/cy13-q1-community-analysis-%E2%80%94-openstack-vs-opennebula-vs-eucalyptus-vs-cloudstack
Tuesday, October 1, 13
![Page 31: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/31.jpg)
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 32: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/32.jpg)
19/09/2013 CERN Infrastructure Evolution
Tier-‐1 (11 centres):•Permanent storage•Re-‐processing•Analysis
Tier-‐0 (CERN):•Data recording•Ini7al data reconstruc7on•Data distribu7on
Tier-‐2 (~200 centres):• Simula7on• End-‐user analysis
• Data is recorded at CERN and Tier-1s and analysed in the Worldwide LHC Computing Grid• In a normal day, the grid provides 100,000 CPU days executing over 2 million jobs
Tuesday, October 1, 13
![Page 33: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/33.jpg)
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
![Page 34: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/34.jpg)
19/09/2013 CERN Infrastructure Evolution
Microsoft Active Directory
CERN DB on Demand
CERN Network Database
Account mgmt system
Horizon
Keystone
NetworkCompute
Glance
Scheduler
Cinder
Nova
Block Storage Provider
Tuesday, October 1, 13
![Page 35: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/35.jpg)
Training for Newcomers
19/09/2013 CERN Infrastructure Evolution
Buy the book rather than guru mentoring
Tuesday, October 1, 13
![Page 36: CERN'S GRAND COLLISION EXPERIMENT: CLOUD from Structure:Europe 2013](https://reader034.fdocuments.us/reader034/viewer/2022051819/54c7a60c4a7959e7478b465f/html5/thumbnails/36.jpg)
Tuesday, October 1, 13