Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo...

44
Astronomy: from Networks Astronomy: from Networks to the Grid to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory Italy

Transcript of Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo...

Page 1: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Astronomy: from Networks Astronomy: from Networks

to the Gridto the Grid

Leopoldo Benacchio

INAF (National Institute for Astrophysics)

Padova Astronomical Observatory

Italy

Page 2: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

What really Astronomy is ?What really Astronomy is ?

Page 3: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

.. What �bout instruments ..... What �bout instruments ...

Page 4: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

.. And what .. And what reallyreally people people

think astronomers are�think astronomers are�

Page 5: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

What Astronomy really is What Astronomy really is

... ...

1 : Machinery

2 : Communication

Page 6: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Once upon a time Once upon a time

up to dateup to date supercomputersupercomputer

Page 7: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

More recent efforts : More recent efforts :

ephemeredes ephemeredes

Page 8: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

The mother of all the The mother of all the cpu�scpu�s

Page 9: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Communication and Communication and

AstronomyAstronomy

Roots are in the Renaissance

Page 10: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

The first �The first �globalisedglobalised� �

ScienceScience

1900 IAU

Telegram

Page 11: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Why communication is so Why communication is so

important in Astronomy important in Astronomy

from centuries?from centuries?

Page 12: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Farthest and farthest �Farthest and farthest �

1906 Los Angeles 1990

Page 13: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Best places are mountains Best places are mountains

in the middle of a desert�in the middle of a desert�

Page 14: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Where the weather is Where the weather is

(generally) good ...(generally) good ...

Page 15: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

And partners are wonderful And partners are wonderful

Page 16: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Anyway results are Anyway results are

encouragingencouraging

Page 17: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Last 25 years revolution in Last 25 years revolution in

Astronomy : IAstronomy : I

Page 18: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Last 25 years revolution in Last 25 years revolution in

Astronomy : IIAstronomy : II

Page 19: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Last 25 years revolution in Last 25 years revolution in

Astronomy : IIIAstronomy : III

Page 20: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

And the most important �And the most important �

Farewell to the

blinding atmosphere

Page 21: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Space Astronomy: �more Space Astronomy: �more

Physics� or a different one?Physics� or a different one?

Page 22: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Different glasses different Different glasses different

phenomena �phenomena �

Page 23: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Astronomy and NetworksAstronomy and NetworksAstronomy is in the network

Development task from the beginning

(Span, Italian Astronet)

Second step in Italy (Garr)

In the �80 Astronomy is, maybe, the

First �All digital Science�

Nowadays GRID

Page 24: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

An �All digital Science�An �All digital Science�End to End cycle on the network:

�Observation preparation,

�Remote observing,

�Data Reduction and Analysis,

�Archiving,

�Data mining (virtual observatories),

�Modelling (theoretical astronomy),

�Literature,

�New ideas for new observation, theory etc.

Page 25: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

That is : ready for the Grid !That is : ready for the Grid !

�Network allowed strong

communication

�The Web allowed documentation

sharing

�Is the Grid a change of metaphor ?

(sharing the work!)

Page 26: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

First steps for the GridFirst steps for the Grid

We are working on Astrophysical applications within the

framework of the Italian Grid for Science

(funded by MIUR: 2003-2006)

3 main poles engaged : Padova Trieste, Napoli

7 poles forecasted for the end of the year

Main objective is to determine �astrophysical� requirements

for the Grid itself

Page 27: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Applications: Case study IApplications: Case study IDatabase and Astrophysical Archives

(Planck, TNG, GSCII)

TNG at Canarias

Page 28: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Applications: Case study IIApplications: Case study IIImage reduction and Analysis of the

VST survey

VST is a 2 m.

Telescope with

a 32.000 x CCD

A �pilot fish�

For the 4 VLT giants

Page 29: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Applications: Case study IIIApplications: Case study IIITelescopes and the Grid : to distribute

remote observing

Before grid After grid

Page 30: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Planck 2007: mapping the Planck 2007: mapping the

microwave Universemicrowave Universe

Page 31: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Data Processing for ESA/PlanckData Processing for ESA/Planck

� Highly distributed environment (9 sites)

� Collaborative development � inputs to data processing pipeline coming from over 30 institutes in over a dozen countries, in Europe and North America)

� Each of the DPC �Levels� perform well-specified tasks (simulations, handling of telemetry, production of frequency maps, separation of astrophysical components, preparation of final products)

� Need to share efficiently data (raw and at different levels of processing), information, documents, procedures, software

� Grid technology likely to be used (EU FP6 SSA proposal to support feasibility study)

Page 32: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

MOC

LFI

DPC

HFI

DPC

PSO

Level S

Garching

Level 1

Level 2

Paris

ERCSC

Pasadena

Level 4

Garching

Level 3

Cambridge

Level 1

Level 2

Level 3

Level S

Trieste

Darmstadt

Noordwijk

Orsay

Page 33: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Network, Grid, (Radio) Network, Grid, (Radio)

telescopestelescopes

Observing the heavenly bodies at radio frequency

Page 34: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Network, Grid, (Radio) Network, Grid, (Radio)

telescopestelescopes

Resolution is the key point (distance between antennas)

4.5 cm

binocular

Page 35: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Network, Grid, (Radio) Network, Grid, (Radio)

telescopestelescopes

Observing the heavenly bodies at radio frequency

If a desert

Is available

Resolution

is better.

Page 36: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Network, Grid, (Radio) Network, Grid, (Radio)

telescopestelescopes

Low resolution

Page 37: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Network, Grid, (Radio) Network, Grid, (Radio)

telescopestelescopes

better resolution

Page 38: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Network, Grid, (Radio) Network, Grid, (Radio)

telescopestelescopes

and even better

Page 39: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Network, Grid, (Radio) Network, Grid, (Radio)

telescopestelescopes

using different distant telescope is the idea

Very Large Base interferometry

Page 40: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Network, Grid, (Radio) Network, Grid, (Radio)

telescopestelescopes

Correlation

of events is

critical and

require very-

broad-band

Page 41: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

better resolution

Page 42: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Geant Geant and and

seems enough strong

Page 43: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

Next Step: going farther Next Step: going farther

www.cieloblu.it www.polare.it

Page 44: Astronomy: from Networks to the Grid - CUC 2017 · Astronomy: from Networks to the Grid Leopoldo Benacchio INAF (National Institute for Astrophysics) Padova Astronomical Observatory

We are in pool position We are in pool position

because� because�

The Universe

is a GRID !