HEASARC Supported Activities at SAO

April 12 - 13, 2006HEASARC Users Group

Roger Brissenden 1

HEASARC Supported Activities at SAO

Roger Brissenden


Roger Brissenden 2

OutlineOutline

1. SAO/HEASARC Coordination2. Feb 04 HUG Issues3. Chandra Mission Status4. HEASARC Activities at SAO5. Chandra Data Archive (CDA)6. CalDB7. SAOImage ds9


Roger Brissenden 3

1. SAO/HEASARC Coordination1. SAO/HEASARC Coordination• HEASARC established partnership with SAO in 1999 in order to strengthen the

ties between the two groups, access expertise of both groups, maximize common approaches, and allow integration of the Chandra archive

• Steve Murray assumed HEASARC Associate Director role

• Funding for ~1.25 FTE provided to support closer ties in the areas of archive standards, CalDB and software development (e.g., DS9)

• Partnership has been effective with coordinated extensions to archive standards, CalDB and providing direct support for DS9 development

• Steve Murray stepped down as HEASARC AD Feb 2004 to concentrate on new responsibilities and Roger Brissenden assumed PI role

• Roger’s role as HEAD AD and CXC Manager provides an opportunity for even closer ties with the CXC, and maximizes resource leverage

• Effort during the present 4 years focused on full Chandra archive integration, extending CalDB, support for DS9 and VO, with an opportunity to locate the Chandra archive at SAO for the long term


Roger Brissenden 4

Staff at SAOStaff at SAO

Who SAO Role HEASARC Role FTE %

Roger Brissenden CXC Manager Associate Director <5Arnold Rots Chandra Archive Scientist Archive Integration 25Dale Graessle Chandra CalDB Scientist CalDB Interface 25Bill Joye SAOImage ds9 Developer SAOImage ds9 75


Roger Brissenden 5

2. Feb ‘04 HUG Issues2. Feb ‘04 HUG Issues

(a) Long term plan for the Chandra Archive• Plan to establish the Chandra permanent archive

at SAO as part of the HEASARC included in proposal to Senior Review

• Approach ensures data remain co-located with expertise

(b) Chandra Data Archive Plans• CXC data archive formats are HEASARC/OGIP

FITS compatible• CXC uses the CalDB format and is working

actively to extend standard


Roger Brissenden 6

• 7 years of Operation on 23 July 2006• Cycle 7 observations on track, observing

efficiency close to optimal• Spacecraft and Science Instruments continue to

operate well; no significant anomalies• NASA funding baseline for 10 year mission;

planning for 15+• Consumables not a factor in extending lifetime

3. Chandra Mission Status3. Chandra Mission Status


Roger Brissenden 7

4. HEASARC Activities at SAO4. HEASARC Activities at SAOGoals Presented to Senior Review

1. Full Chandra Data Archive (CDA) integration with the HEASARC to provide complete access to Chandra archive metadata through the multi-mission search and retrieval software. Allows for Chandra Archive at SAO/HEASARC long term.

2. Upgrade to CalDB and CalDB tools to allow more effective support for current and future missions.

3. SAOImage ds9 maintenance, ports and as resources allow, selected new functionality.


Roger Brissenden 8

• Current volume:– 2.85 TB in 10.65 million files (currently growing faster

during reprocessing run)– Essential data at second server at CfA

• Active mirror sites (public primary and secondary data products only)– LEDAS, UK (2000)– ASDC, Rome, Italy (2004)– HEASARC (2005)– IUCAA, Pune, India (2005)

5. Chandra Data Archive (CDA)5. Chandra Data Archive (CDA)


Roger Brissenden 9

CDA Holdings (TB)

0

0.5

1

1.5

2

2.5

3

May-00Nov-00May-01Nov-01May-02Nov-02May-03Nov-03May-04Nov-04May-05Nov-05

CDA: HoldingsCDA: Holdings


Roger Brissenden 10

• Distributed over the course of the mission:– 4751 proprietary observations

• Publicly available:– 4079 Scientific observations– 1399 Calibration observations

CDA: ObservationsCDA: Observations


Roger Brissenden 11

CDA Download Volume (GB/month)

0

200

400

600

800

1000

Aug-99Feb-00Aug-00Feb-01Aug-01Feb-02Aug-02Feb-03Aug-03Feb-04Aug-04Feb-05Aug-05Feb-06

QL Prods

Prepack'ed

CALDB

Data Prods

CDA: DownloadsCDA: Downloads


Roger Brissenden 12

Life of the Mission

Data Prods,

13924.3708

CALDB,

3054.177649

Prepack'ed,

256.545038

QL Prods,

0.527949

Last 6 months

Data Prods,

1464.44

CALDB,

520.77

Prepack'ed,

4.05QL Prods,

0.02

CDA: DownloadsCDA: Downloads


Roger Brissenden 13

• 2003: The CDA integrated in HEASARC Browse – i.e., Chandra looks like other missions at the HEASARC website

• 2005: The CDA mirror at HEASARC fully integrated in HEASARC Browse – i.e., Chandra data access identical to other missions at the HEASARC website

CDA: HEASARC IntegrationCDA: HEASARC Integration


Roger Brissenden 14

• Comprehensive dictionary of all keywords used in Chandra data products

• User query interface from CDA web page

• Status: awaiting completion of keyword descriptions (2006)

CDA Plans: FITS DictionaryCDA Plans: FITS Dictionary


Roger Brissenden 15

• Complete through 2005– 6891 articles, of which 4038 refereed– 6299 data–literature references:

• 1685 papers• 2978 distinct observations

– Categories:• 2920 Present specific observations• 2949 Refer to published results (including multi-

wavelength, follow-up analysis, theory to explain Chandra data)

• 417 Instrumentation, software, operations• 206 Predict Chandra results• 329 Cannot be classified

• User access:• Chaser• Dedicated CDA interface• ADS

CDA Plans: BibliographyCDA Plans: Bibliography


Roger Brissenden 16

• Available as multi-mission tool (2006)• Contains:

– Configurable database• Mission-specific flags and lists, database links• Associated literature keywords• Literature – dataset links

– Maintenance interface• Automatic ADS mission-specific keyword search of abstract

and body• GUI for processing candidate papers, including

categorization, flag assignment, access to paper

• Provided to XMM GOF

CDA: Bibliography PackageCDA: Bibliography Package


Roger Brissenden 17

Chandra Metrics:

• 13 CalDB upgrades

• 126 new files added– 10 new codename types– ~158 old files retired

• Current CalDB index includes 814 paired files and extensions.

6. CalDB6. CalDB


Roger Brissenden 18

• Adapting CalDB to mission-independent tool design: coord. with Mike Corcoran

– Automate setting of CalDB file selection parameters (2006-7)

• Higher-level processing of archival data– Ensure calibration version consistency with

the calibration history of input data (2007)

• CalDB system for new missions and software architecture

– Improve data structure extensibility (2008)

CalDB: HEASARC TasksCalDB: HEASARC Tasks


Roger Brissenden 19

• Current version 4.0b9 (released today)– Supported on 9 hardware platforms

• Last Year– 3 Incremental beta releases– over 30,000 downloads

• In addition to HEASARC supported missions, collaborating with ground based:– DEIMOS, GEMINI, MMT

7. SAOImage ds97. SAOImage ds9


Roger Brissenden 20

• Catalogs– Load / Save / Filter / Sort– Supports VizieR (CDS) catalog servers

• Regions– Composite Regions– Templates– Instrument Field of View

• New Optional GUI Configurations

ds9: New Featuresds9: New Features


Roger Brissenden 21

• New Infrastructure– Pure Tcl/Tk implementation

• New Windows version

• New MacOSX Aqua version

• Internationalization

ds9: Current Developmentds9: Current Development


Roger Brissenden 22

Catalog Support

• Full support for loading, displaying, sorting, filtering, and saving catalogs

• Example shows overlays of the HST and GSC catalogs


Roger Brissenden 23

Catalog Tool

• Interface for catalog downloads. Support includes sorting and filtering


Roger Brissenden 24

Instrument Fields

• SAOImage ds9 now provides support for loading, displaying, and saving Instrument Field of Views

• FOVs for Chandra, XMM, and SAO MMT are provided


Roger Brissenden 25

Optional GUI Layout

• Vertical layout, conserves screen space

• Feature turn-on/off


Roger Brissenden 26

• 3D Slicer

• 3D Volume Render

• Bad Pixel Maps

• WCS Editor

• Image Statistics

• Suggestions welcome:

http://hea-www.harvard.edu/RD/ds9

ds9: Future Developmentds9: Future Development






HEASARC Supported Activities at SAO

Documents

Transcript of HEASARC Supported Activities at SAO