Astronomy and Astrophysics - Requirements and experiences with use of MPI in Grid Infrastructures
Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo...
-
Upload
trinhhuong -
Category
Documents
-
view
218 -
download
0
Transcript of Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo...
![Page 1: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/1.jpg)
Astronomy: from Networks Astronomy: from Networks
to the Gridto the Grid
Leopoldo Benacchio
INAF (National Institute for Astrophysics)
Padova Astronomical Observatory
Italy
![Page 2: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/2.jpg)
What really Astronomy is ?What really Astronomy is ?
![Page 3: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/3.jpg)
.. What �bout instruments ..... What �bout instruments ...
![Page 4: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/4.jpg)
.. And what .. And what reallyreally people people
think astronomers are�think astronomers are�
![Page 5: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/5.jpg)
What Astronomy really is What Astronomy really is
... ...
1 : Machinery
2 : Communication
![Page 6: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/6.jpg)
Once upon a time Once upon a time
up to dateup to date supercomputersupercomputer
![Page 7: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/7.jpg)
More recent efforts : More recent efforts :
ephemeredes ephemeredes
![Page 8: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/8.jpg)
The mother of all the The mother of all the cpu�scpu�s
![Page 9: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/9.jpg)
Communication and Communication and
AstronomyAstronomy
Roots are in the Renaissance
![Page 10: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/10.jpg)
The first �The first �globalisedglobalised� �
ScienceScience
1900 IAU
Telegram
![Page 11: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/11.jpg)
Why communication is so Why communication is so
important in Astronomy important in Astronomy
from centuries?from centuries?
![Page 12: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/12.jpg)
Farthest and farthest �Farthest and farthest �
1906 Los Angeles 1990
![Page 13: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/13.jpg)
Best places are mountains Best places are mountains
in the middle of a desert�in the middle of a desert�
![Page 14: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/14.jpg)
Where the weather is Where the weather is
(generally) good ...(generally) good ...
![Page 15: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/15.jpg)
And partners are wonderful And partners are wonderful
![Page 16: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/16.jpg)
Anyway results are Anyway results are
encouragingencouraging
![Page 17: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/17.jpg)
Last 25 years revolution in Last 25 years revolution in
Astronomy : IAstronomy : I
![Page 18: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/18.jpg)
Last 25 years revolution in Last 25 years revolution in
Astronomy : IIAstronomy : II
![Page 19: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/19.jpg)
Last 25 years revolution in Last 25 years revolution in
Astronomy : IIIAstronomy : III
![Page 20: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/20.jpg)
And the most important �And the most important �
Farewell to the
blinding atmosphere
![Page 21: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/21.jpg)
Space Astronomy: �more Space Astronomy: �more
Physics� or a different one?Physics� or a different one?
![Page 22: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/22.jpg)
Different glasses different Different glasses different
phenomena �phenomena �
![Page 23: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/23.jpg)
Astronomy and NetworksAstronomy and NetworksAstronomy is in the network
Development task from the beginning
(Span, Italian Astronet)
Second step in Italy (Garr)
In the �80 Astronomy is, maybe, the
First �All digital Science�
Nowadays GRID
![Page 24: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/24.jpg)
An �All digital Science�An �All digital Science�End to End cycle on the network:
�Observation preparation,
�Remote observing,
�Data Reduction and Analysis,
�Archiving,
�Data mining (virtual observatories),
�Modelling (theoretical astronomy),
�Literature,
�New ideas for new observation, theory etc.
![Page 25: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/25.jpg)
That is : ready for the Grid !That is : ready for the Grid !
�Network allowed strong
communication
�The Web allowed documentation
sharing
�Is the Grid a change of metaphor ?
(sharing the work!)
![Page 26: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/26.jpg)
First steps for the GridFirst steps for the Grid
We are working on Astrophysical applications within the
framework of the Italian Grid for Science
(funded by MIUR: 2003-2006)
3 main poles engaged : Padova Trieste, Napoli
7 poles forecasted for the end of the year
Main objective is to determine �astrophysical� requirements
for the Grid itself
![Page 27: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/27.jpg)
Applications: Case study IApplications: Case study IDatabase and Astrophysical Archives
(Planck, TNG, GSCII)
TNG at Canarias
![Page 28: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/28.jpg)
Applications: Case study IIApplications: Case study IIImage reduction and Analysis of the
VST survey
VST is a 2 m.
Telescope with
a 32.000 x CCD
A �pilot fish�
For the 4 VLT giants
![Page 29: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/29.jpg)
Applications: Case study IIIApplications: Case study IIITelescopes and the Grid : to distribute
remote observing
Before grid After grid
![Page 30: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/30.jpg)
Planck 2007: mapping the Planck 2007: mapping the
microwave Universemicrowave Universe
![Page 31: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/31.jpg)
Data Processing for ESA/PlanckData Processing for ESA/Planck
� Highly distributed environment (9 sites)
� Collaborative development � inputs to data processing pipeline coming from over 30 institutes in over a dozen countries, in Europe and North America)
� Each of the DPC �Levels� perform well-specified tasks (simulations, handling of telemetry, production of frequency maps, separation of astrophysical components, preparation of final products)
� Need to share efficiently data (raw and at different levels of processing), information, documents, procedures, software
� Grid technology likely to be used (EU FP6 SSA proposal to support feasibility study)
![Page 32: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/32.jpg)
MOC
LFI
DPC
HFI
DPC
PSO
Level S
Garching
Level 1
Level 2
Paris
ERCSC
Pasadena
Level 4
Garching
Level 3
Cambridge
Level 1
Level 2
Level 3
Level S
Trieste
Darmstadt
Noordwijk
Orsay
![Page 33: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/33.jpg)
Network, Grid, (Radio) Network, Grid, (Radio)
telescopestelescopes
Observing the heavenly bodies at radio frequency
![Page 34: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/34.jpg)
Network, Grid, (Radio) Network, Grid, (Radio)
telescopestelescopes
Resolution is the key point (distance between antennas)
4.5 cm
binocular
![Page 35: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/35.jpg)
Network, Grid, (Radio) Network, Grid, (Radio)
telescopestelescopes
Observing the heavenly bodies at radio frequency
If a desert
Is available
Resolution
is better.
![Page 36: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/36.jpg)
Network, Grid, (Radio) Network, Grid, (Radio)
telescopestelescopes
Low resolution
![Page 37: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/37.jpg)
Network, Grid, (Radio) Network, Grid, (Radio)
telescopestelescopes
better resolution
![Page 38: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/38.jpg)
Network, Grid, (Radio) Network, Grid, (Radio)
telescopestelescopes
and even better
![Page 39: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/39.jpg)
Network, Grid, (Radio) Network, Grid, (Radio)
telescopestelescopes
using different distant telescope is the idea
Very Large Base interferometry
![Page 40: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/40.jpg)
Network, Grid, (Radio) Network, Grid, (Radio)
telescopestelescopes
Correlation
of events is
critical and
require very-
broad-band
![Page 41: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/41.jpg)
better resolution
![Page 42: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/42.jpg)
Geant Geant and and
seems enough strong
![Page 43: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/43.jpg)
Next Step: going farther Next Step: going farther
www.cieloblu.it www.polare.it
![Page 44: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory](https://reader030.fdocuments.us/reader030/viewer/2022011808/5c6a07cd09d3f2310b8c0129/html5/thumbnails/44.jpg)
We are in pool position We are in pool position
because� because�
The Universe
is a GRID !