EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain:...
-
Upload
european-data-forum -
Category
Technology
-
view
692 -
download
3
description
Transcript of EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain:...
![Page 1: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/1.jpg)
www.rethinkbig-project.eu
This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 619788.
RETHINK big Project
Adrián CristalBarcelona Supercomputing Center
20th, March 2014
![Page 2: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/2.jpg)
3
Mission
To identify and evaluate the existing competencies across European Big Data Hardware and Networking technology sectors and application domains
To prioritize the complementary interests and the shared opportunities to unlock the highest return on their respective investments
Resulting in a roadmap that would be irrational not to follow.
![Page 3: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/3.jpg)
4
Why Hardware matters?
All Software runs on hardware….MapReduceCUDAOpenCLMPIOpenMP…
You might not want to admit it but…
You are constrained by hardware and the network
![Page 4: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/4.jpg)
5
In the next 10 years, the HW will change more dramatically than it has in the past 10 years
HW will influence the products and services that you provide
![Page 5: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/5.jpg)
6
The world in 3D (3D Stacking)
Very large bandwidthVery low latencyLarge amounts of memory on a chipLocality will be extremelyimportantThermal problems
Figure from EPFLhttp://esl.epfl.ch/page-58161-en.html
![Page 6: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/6.jpg)
7
Non-volatile memory
New technologies (STT-RAM, CB-RAM, RRAM, …)More densityReplacement for DRAMs
Endurance problem
Large influence on softwareData base systemsFile systems
![Page 7: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/7.jpg)
8
Dark Silicon Era
Thermal problemsNot all cores will be able to be on all the time
Extensive use of AcceleratorsReconfigurable computing
![Page 8: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/8.jpg)
9
What happens if HW does not consider SW
Many changes in HW architecture do not survive
Cell processor (Playstation 3 processor)Itanium processor
![Page 9: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/9.jpg)
10
What happens if SW does not consider HW
Terasort contest: sorting 100TB dataNumber 1: Hadoop
2100 nodes, 12 cores per node, 64 Gb per node 24.000 cores134 Tb memory
Time: 4300 segs
Number 2: Tritonsort 52 nodes, 8 cores per node, 24 Gb
416 cores1,2 Tb memory
Time: 8300 segs and 6400 segs
Hadoop is easy to program, but needs 57X more cores, 100X more memory, and only gets 2X performance
![Page 10: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/10.jpg)
11
New Technologies
Neural NetworksAnalog Memristor-based
Graphene transistorsQuantum ComputingDNA computing…
![Page 11: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/11.jpg)
12
Challenges
Work with different areasApplications and end usersSoftware ToolsSystemsNetworkHardware
Work with different requirementsSpeedVolumeReal TimeSensorsVariabilityPower consumption
![Page 12: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/12.jpg)
13
Building an Ecosystem
Consortium
Working groupApplication Challeges
Working groupEnabling Technologies
Big Data Related Communities
![Page 13: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/13.jpg)
14
Building an Ecosystem
Big Data Related Communities
![Page 14: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/14.jpg)
15
Ways to Participate
Webhttp://www.RETHINKbig-project.eu
Linkedinhttps://www.linkedin.com/groups/RETHINKbig-7457953
Twitterhttps://twitter.com/RETHINKbig
![Page 15: EDF2014: Adrian Cristal, Barcelona Supercomputing Center, RETHINK big Project Coordinator, Spain: The RETHINK big Project NEEDS YOU](https://reader035.fdocuments.us/reader035/viewer/2022062614/5459b5a0b1af9f37608b5723/html5/thumbnails/15.jpg)
16
Thank you
Stop by our standhttp://www.RETHINKbig-project.eu