GLAST LAT Project ISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 3.41 Gamma-ray Large Area...

GLAST LAT Project ISOC CDR, 4 August 2004

Document: LAT-PR-04500 Section 3.4 1

Gamma-ray Large Gamma-ray Large Area Space Area Space TelescopeTelescope

GLAST Large Area Telescope:GLAST Large Area Telescope:

Instrument Science Operations Center Instrument Science Operations Center CDRCDR

Section 3.4Science Data Products and Science Analysis Software

Richard DuboisSAS System Manager



OutlineOutline

• Introduction to SAS Scope and Requirements

• Overall Test Plan

• Data Challenges

• DC1 Summary



Science Analysis Software OverviewScience Analysis Software Overview

• Data Pipelines– Prompt processing of Level 0 data through to Level 1 event

quantities– Providing near real time monitoring information to the ISOC – Transient sources– Monitoring and updating instrument calibrations – Reprocessing of instrument data

• Performing bulk production of Monte Carlo simulations • Higher Level Analysis

– Creating high level science products from Level 1• Point source catalogue

– Providing access to event and photon data for higher level data analysis

• Interfacing with other sites (sharing data and analysis tool development)

– Mirror PI team site(s)– SSC

• Supporting Engineering Model and Calibration tests • Supporting the collaboration for the use of the tools



Level III Requirements SummaryLevel III Requirements SummaryRef: LAT-SS-00020

Function Requirement Expected Performance (if applicable)

Verification

perform prompt processing from Level 0 through Level 1

keep pace with up to 10 GB Level 0 per day and deliver to SSC within 24 hrs

demonstration

provide near-real time monitoring to IOC

within 6 hrs demonstration

maintain state and performance tracking

demonstration

facilitate monitoring and updating of iinstrument calibrations

demonstration

archive all data passing through

> 50 TB on disk and tape backup

demonstration

Create simulation tool, based on instrument geometry, that reproduces the interactions of photons and background

system test - comparison to balloon flight and existing data

Create physics model of expected photons and backgrounds incident upon the instrument

system test - comparison to balloon flight and existing data

Create algorithms to interpret the data from the instrument to identify the interaction and estimate photon direction and energy

system test - comparison to engineering model tests

Create algorithms to generate calibration constants for the subsystem components

system test - in conjunction with engineering model tests

Interface with the SSC and PI mirror sites, sharing selected data and algorithms

demonstration

Create High-Level Science products. Development of analysis tools

. demonstration

Mission Support Support the Software system for the life of the mission

demonstration

Flight Ground Processing

Instrument Design Support

High Level Tools



RD

LAT sim/recon ScienceTools Infrastructure

System Architect Simulation

Recon Event Interpretation

System Tests

Architects Analysis Tools

Likelihood

Pulsars

GRBs

Obs Sim

User Interface

Code Distribution Release Manager

System Tests Data Server

Release Manager

Release Manager

Issues Tracker

Sundry Utilities

Documentation

SLAC Linux environment

SLAC WindowsEnvironment

ACD

CAL

TKR

ACD

CAL

TKR

Flight IntSupport

Caliibrations

I/O

I/O

GEANT4

Event DisplayCode Management

Tool

There is a name for each box, except Infrastructure lead.Asking for SLAC to fill this position. Making do for now.



Mission Operations Center

Science AnalysisSoftw are Group

InstrumentPerformance

Evaluation Group

ScienceSupportCenter

Instrument Operations Center(IOC)

Data Processing Facility

HousekeepingData

Science DataProduction

Commanding

Level 1 Products

Instrument Monitoring

Flight Softw areSupport Group

Science Analysis

LAT Operations Steering Committee(Suggested)

LAT UserCommunity

Lev

el 0

& H

SK

Tel

emet

ry

Nom inalCom manding

ContingencyCom manding

LAT TEAM

Operation Communication & Interfaces

Burst AlertMessages via GCN

SAS in the Ground System SAS in the Ground System

Pipeline (Gino) is robotic backbone of ISOC process handling – Performs L1 & L2 processing

Keep everything on disk and archive to tape

Gino server and database can handlemultiple arbitrary sequences of tasks:L1 pipeline; reprocessing; MC; ….



Pipeline SpecPipeline Spec

• Function– The Pipeline has five major functions

• automatically process Level 0 data through reconstruction (Level 1) • provide near real-time feedback to IOC • facilitate the verification and generation of new calibration constants • produce bulk Monte Carlo simulations • backup all data that passes through

• Must be able to perform these functions in parallel• Fully configurable, parallel task chains allow great flexibility for use online as

well as offline– Will test the online capabilities during Flight Integration

• The pipeline database and server, and diagnostics database have been specified (will need revision after prototype experience!)

– database: LAT-TD-00553 – server: LAT-TD-00773 – diagnostics: LAT-TD-00876



Pipeline in PicturesPipeline in Pictures

State machine + complete processing record

Configurable linked list of applications to run

Expandable and configurable set of processing nodes



Overall Test PlanOverall Test Plan

• Combination of Engineering Model tests, Data Challenges and LAT Integration Support

• EM tests

– EM1 demonstrated ability to simulate/reconstruct real data from single (non-standard) tower

• All within standard code framework/tools

• Data analyzed with SAS tools

• Data Challenges

– End to end tests of sky simulation through astro analysis

– Exercise pipeline

• LAT Flight Integration

– Combine tools from EM & DC applications

– Sim/recon/analysis & pipeline processing and record keeping



Processing FlowProcessing Flow

Data Pipeline

Sim

Raw Data

Level 0

Recon

Level 1 Science Tools

Level 2

Recon: interpret LAT readout and estimate directions and energies; flag background

Sim: full modeling of e//p interactions and readout in

the LAT



Level 1 Sim/Recon ChainLevel 1 Sim/Recon Chain

SourceFluxes

Geometry

ParticleTransport

“Raw”Data

Recon

BackgroundRejection

-Particle ID

SourceFluxes

Geometry

ParticleTransport

“Raw”Data

Recon

BackgroundRejection

-Particle ID

Real Data

3 GeV

Level 1



Sim/Recon ToolkitSim/Recon ToolkitPackage Description Provider Status

ACD, CAL, TKR Recon

Data reconstruction

LAT 90% done

In use

ACD, CAL, TKR Sim

Instrument sim LAT 95% done

In use

GEANT4 Particle transport sim

G4 worldwide collaboration

In use

xml Parameters World standard In use

Root C++ object I/O HEP standard In use

Gaudi Code skeleton CERN standard In use

doxygen Code doc tool World standard In use

Visual C++/gnu Development envs World standards In use

CMT Code mgmt tool HEP standard In use

cvsweb cvs web viewer World standard In use

cvs File version mgmt World standard In use



Software Development ApproachSoftware Development Approach

• Enable distributed development via cvs repository• Extensive use of electronic communications

– Web conferencing (VRVS), Instant Messaging (icq), Wikis• CMT tool permits equal development on Windows and Linux

– Coupled with cvs gives machinery enables config control– Superior development environment on Windows; compute

cycles on linux• documentation and coding reviews enforce coding rules• JIRA issue tracking system• “Continuous integration”

– Eliminate surprises for incoming code releases– Build code every night; alert owners to failures in build or

running of unit tests. Results tracked in database.– Developing comprehensive system tests in multiple source

configurations. Track results in database; web viewable.



Using Jira Issue TrackerUsing Jira Issue Tracker



Nightly BuildsNightly Builds

Past release

Release in progress

Future release

Display created from database query

Performing buildsfor Science Toolsnow also

Build status

Unit test status



System TestsSystem Tests

Comparison ofcurrent to previousrelease.



Main Science ToolsMain Science Tools

Package Description First Use

Likelihood Workhorse model fitting for detection & characterization of cosmic gamma-ray sources

DC1

Level 1 database access

Extracts desired event dataDC1

Exposure calculation Uses IRFs, pointing, livetime etc. for deriving calibrated source fluxes

DC1

Source identification Identifies gamma-ray sources with cataloged counterparts at other wavelengths

DC2

GRB analysis Temporal and spectral analyses of burst profiles DC1

Pulsar analysis Phase folding & period searching of gamma-ray pulsars and candidates DC2

Observation simulator

High level simulation of observations of the gamma-ray sky with the LAT

DC1



Science Tools ToolkitScience Tools Toolkit

Package Description Provider Status

PIL, PIL++ IRAF parameter access

HEASARC In use

cfitsio, CCFits FITS file manipulation

HEASARC In use

XSPEC, Sherpa For GRB spectral modeling

HEA standards Under consideration

Root gui etc HEP standard Under consideration

python Scripting World standard Under consideration

doxygen Code doc tool World standard In use

Visual C++/gnu Development envs World standards In use

CMT Code mgmt tool HEP standard In use

cvsweb Cvs web viewer World standard In use

cvs File version mgmt World standard In use



Data ProductsData Products

DC1

DC1

DC1

DC2

DC2

DC2

underdiscussion

DC2/3?



Purposes of the Data Challenges Purposes of the Data Challenges

• “End-to-end” testing of analysis software.

• Familiarize team with data content, formats, tools and realistic details of analysis issues (both instrumental and astrophysical).

• If needed, develop additional methods for analyzing LAT data, encouraging alternatives that fit within the existing framework.

• Provide feedback to the SAS group on what works and what is missing from the data formats and tools.

• Uncover systematic effects in reconstruction and analysis.

Support readiness by launch time to do all first-year science.

S.Ritz



SAS ChecklistSAS Checklist

Detailed Simulation

Event Reconstruction

Event Classification

Instrument Calibration

ACD CAL TKR

Processing Pipeline

MC I&T

Re-processing

High Level Analysis

GRBs, AGN, Pulsars

Catalogue, Diffuse

User Support

Code distribution

Data Distribution

Institutional Mirrors

SSC

LAT Mirrors

High Level Instr Diags

Quicklook

DC1

DC2

DC3

I&T EM

I&T Flight



Data Challenge Planning ApproachData Challenge Planning Approach

• Walk before running: design a progression of studies.• DC1. Modest goals. Contains most essential features of a data

challenge. Original plan:• 1 simulated day all-sky survey simulation, including backgrounds• find flaring AGN, a GRB• recognize simple hardware problem(s)• a few physics surprises• exercise:

– exposure, orbit/attitude handling, data processing pipeline components, analysis tools

• DC2, start end of CY04. More ambitious goals. Encourage further development, based on lessons from DC1. One simulated month.

• DC3. Support for flight science production.

S.Ritz



Data Challenge 1 CloseoutData Challenge 1 Closeout12-13 Feb 200412-13 Feb 2004

http://www-glast.slac.stanford.edu/software/Workshops/Feb04DC1CloseOut/coverpage.htm



DC1 ComponentsDC1 Components

• Focal point for many threads

– Orbit, rocking, celestial coordinates, pointing history

– Plausible model of the sky

– Background rejection and event selection

– Instrument Response Functions

– Data formats for input to high level tools

– First look at major science tools – Likelihood, Observation Simulator

– Generation of datasets

– Populate and exercise data servers at SSC & LAT

– Code distribution on windows and

• Involve new users

• Teamwork!



Science Tools in DC1Science Tools in DC1

User Interface aspects of the standard analysis environment, such as Image/plot display (UI2), Command line interface & scripting (UI4), and GUI & Web access (UI5) are not shown explicitly.

1 This tool also performs periodicity tests and the results can be used to refine ephemerides2 These tools can also take as input binned data from other instruments, e.g., GBM; the corresponding DRMs must also be available.

14 Sept 2002

Pulsarephem. (D4)

Level 1 (D1)

LAT Point sourcecatalog (D5)

Interstellar em.model (U5)

Pointing/livetimehistory (D2) Astron.

catalogs (D6)

Level 0.5

IRFs (D3)

Alternative source for testing high-level analysis

Alternative for making additional cuts on already-retrieved event data

Pt.ing/livetimesimulator (O1)

Observationsimulator (O2)

Pt.ing/livetimeextractor (U3)

Data sub-selection (U2)

Data extract(U1)

Exposurecalc. (U4)

Likelihood (A1)

Map gen(U6)

Src. ID (A2)

Eventdisplay (UI1)

Pulsarprofiles (A3)1

CatalogAccess (U9)


Pulsar phaseassign (U12)

Pulsar periodsearch (A4)

GRB spectral-temporalmodeling (A10)

Source modeldef. tool (U7)

Arrival timecorrection (U10)

GRB temporalanalysis (A7)2

GRB LAT DRMgen. (U14)

GRB spectralanalysis (A8)2

GRB eventbinning (A5)

GRB unbinnedspectral analysis (A9)

GRB visual-ization (U13)

IRF visual-ization (U8)

Ephemerisextract (U11)

GRB rebinning(A6)2

The big picture:Details are changing, but still basically right

DC3DC3

Standard Analysis Environment

S.Digel and P.Nolan



Science Tools in DC1Science Tools in DC1

Level 1 (D1)

Interstellar em.model (U5)

Pointing/livetimehistory (D2)

IRFs (D3)

Alternative source for testing high-level analysis

Alternative for making additional cuts on already-retrieved event data

Pt.ing/livetimesimulator (O1)

Observationsimulator (O2)


Data sub-selection (U2)

Data extract(U1)

Exposurecalc. (U4)

Likelihood (A1)

Map gen(U6)


Source modeldef. tool (U7)

GRB LAT DRMgen. (U14)

GRB spectralanalysis (A8)2

GRB eventbinning (A5)

• All components are still prototypes

The DC1 functionality isData extractionLimited visualizationModel definitionModel fittingObservation simulation

S.Digel and P.Nolan



The dataThe data

on to individual components!

T.Burnett



http://www-glast.slac.stanford.edu/software/DataChallenges/DC1/DC1_StatusAndInfo.htm

Documentation• User’s Guide• Data Description• Likelihood Tutorial

DC-1 Discussion List

Analysis Code download sites

Wiki page forsharing results!



Lessons LearnedLessons Learned

• Analysis Issues

– Astrophysical data analysis

– Software usage and reliability

– Documentation

– Data access and data server usage

– UI stuff

– Software installation and release

– Software infrastructure & framework

– Communication and Time frame

• Infrastructure Issues

– SciTools did not run on windows at the last minute

– We discovered problems with sources and ACD ribbons late

– Manual handling of the processing

– No checking of file integrity

– Large failure rate in batch jobs (~10%)

– Tools are not checking inputs much

– Code distribution scripts were written manually

Issues have been addressed



• DC2, based on lessons from DC1– 1 simulated month of all-sky survey gammas (backgrounds: see next

slide)– key sky addition: source variability

• AGN variability, including bright flares, quiescent periods• expand burst variety (and include GBM? see later slides)• pulsars, including Gemingas, w/ orbit position effects.

– more realistic all-sky attitude profile– background rate varies with orbit position– more physics surprises, and add nominal hardware problems (and

misalignments?), add deadtime effects and corrections

– Analysis Goals:• produce toy 1-month catalog and transient releases produce toy 1-month catalog and transient releases • detailed point source sensitivity and localization studies• first systematic pulsar searches (timing!); detailed diffuse analyses• recognize simple hardware problems (connect with ISOC/SOG)

– benchmark:• processing times, data volume, data transfers.

Strawperson Updated Plan for DC2Strawperson Updated Plan for DC2

S.Ritz



SAS Support of Flight IntegrationSAS Support of Flight Integration

• Expected Deliverables– Automated processing pipeline with bookkeeping

• Gino: in test now• Revised draft pipeline spec at

http://confluence.slac.stanford.edu/display/pipe/Functional+Spec+for+Processing+Pipeline

– Stable Simulation/Reconstruction package• Frozen as of 8/4 (more versions will be necessary before actual use)• Special system tests for surface muon data

– Calibration algorithms for TKR, CAL – due by 1 Sept• TKR hot/dead strips

– Later: ToT gains, inter-tower alignment• CAL peds, gains, light tapers

– Calibration infrastructure for input to recon - rdbGui• Next step is allowing for binary format of parameters (800k ToT gains!)

– Event display – FRED• Ready

– Will inaugurate CCB process for code used in Pipeline

– Plan to extend System Tests scheme to deliver the High Level Diagnostics



Pipeline ViewPipeline View



Example of FREDExample of FRED



SummarySummary

• We believe that EMs, DCs and Flight Integration will leave us ready for flight

• EM1 worked with our tools

• DC1 worked well, showing very good capabilities from sky modeling through astronomical analysis– Plenty of work still to so, but reasonably understood– Will be demonstrated in DC2, 3 and LAT Integration, 16-

tower cosmic ray tests and the beam test prior to launch

• LAT Flight Integration prep in full swing now

• DC2 within a year (being negotiated)

GLAST LAT Project ISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 3.41 Gamma-ray Large Area...

Documents

Transcript of GLAST LAT Project ISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 3.41 Gamma-ray Large Area...