Key Performance Metrics and End-to-End Testing

Tim Jenness

2

Key Performance Metrics

• LSST Science Requirements (LPM-17) and LSST System Requirements (LSE-29) specify the performance of LSST.

• Key Performance Metrics (KPM) are important metrics used to monitor pipeline development.

• They are monitored annually.

3

4

End-to-End Testing

• Raw data on disk to visualization of catalogs and images in a web browser.

• Does not have to be fully automated. Manual intervention is okay.

• What are we missing?• Do we have enough of a system to calculate

S15 KPMs? Which can’t we attempt?

5

End-to-End Testing

• Alert Production end-to-end requires OCS and other infrastructure.– diffim performance only.

• Focus on Data Release Production– Use HSC data– Use NCSA systems– Scale to LSST for performance metrics.

• Five sessions at this meeting.

6

7

8

Support Documents

• Confluence:https://confluence.lsstcorp.org/display/DM/Data+Processing+End+to+End+Testing