The development of the LSST Data Management System (DMS) includes a series of four Data Challenges that take place during the Design and Development phase of the project. The Data

Challenges are partial prototypes of the full DMS, each validating different aspects of the system. DC1, which was executed in 2006, emphasized scalability of the overall processing and data

flows. DC2, which was executed in 2007, prototyped the nightly processing pipelines and the middleware that supports them. DC3, planned for execution in 2008, will prototype the data

release pipelines. DC4, the final Data Challenge before construction begins, will focus on data access by the astronomical community and the data processing that supports scientific use of

the LSST data.

The LSST Data ChallengesT. Axelrod (Steward/LSSTC), R. Allsman (LSSTC), A. Becker (UW), J. Becla (SLAC), D. Burke (SLAC), A. Connolly (UW), C. Cribbs

(NCSA), G. Daues (NCSA), D. Dossa (LLNL), D. Gehrig (NCSA), Z. Ivezic (UW), A. Jagatheesan (SDSC), J. Kantor (LSSTC), D. Levine

(IPAC), K-T. Lim (SLAC), R. Lupton (Princeton), S. Monkewitz (IPAC), J. Myers (U. Arizona), R. Owen (UW.), F. Pierfederici (LSSTC),

S. Pietrowicz (NCSA), M. Nieto-Santisteban (JHU), R. Plante (NCSA), N. Silvestri (UW), C. Smith (NOAO), A. Thakar (JHU),

J.A. Tyson (UCD), D. Wittman (UCD)

Relational Database Management System

Nightly Processing

at Base Facility

Data Release Processing

at Archive Center

Query Interface

Auxiliary

Telescope

Raw Science

Images

Image Stacking

All-sky Photometric

and Astrometric Calibration

Object Classification

Deep Detection /

Co-measurement

Image Processing

Image Subtraction

Moving Object

Processing

DIA Source Detection and

Association

Observation

Metadata

Orbit

Catalog

Object

Catalog

Database contains multiple

Data Releases DR1 - DR11, one per year. The

DR1 Object Catalog contains:

Average 80 epochs per field (total for all filters)

1.9 x 1010 stars (dominated by Galactic

plane/center)

2.3 x 109 galaxies

Image Store

Stacked

Science

Images

Calibration

Images

Alerts

Source

Catalog

Object Catalog contents

ra / dec

proper motion / parallax

average calibrated magnitude for each filter

parameterized lightcurve for each filter

object classification

shape parameters

photo-Z

processing flags

VO Event Distribution

Data Product

Provenance

Auxiliary Instrument Data

Weather

Sounding

Data

IR Sky

Camera

Science Mosaic Data

Observation

Metadata

Calibration

Images

The Object Catalog links to the Source

Catalog, which contains individual

measurements derived from

comeasurement of image stacks.

The number of individual measurements

is SNR dependent. High SNR objects

have a Source entry for every visit;

marginal SNR objects may have only a

single entry for the entire survey.

The DIASource Catalog contains

individual measurements from difference

imaging.

Science

Users

EPO

Users

DIASource

Catalog

Alerts are generated within 60

sec of shutter close for the

second exposure of a visit.

Number of alerts is highly

dependent on alerting

parameters and fields covered

(eg Galactic center). Can be

up to 105 per night.

Alert

Processing

Image ProcessingImage Processing

Calibrated

Science

Images

Alert

Consumers