MA PM performance, Adriaan Rijllart Post Mortem data handling and performance Adriaan Rijllart, Beno t Pannetier, Boris Khomenko, Greg Kruk, Dmitriy Kudryavtsev, Alessandro Raimondo, Hubert Reymond, Nikolai Trofimov PM client data PM server PM viewer ? ? MA PM performance, Adriaan Rijllart Post Mortem data handling and performance Outline 1.PM system dataflow view 2.Data model and formats 3.Transmission 4.Storage 5.Conversion 6.Access 7.Conclusion MA PM performance, Adriaan Rijllart PM PM system dataflow view LoggingAlarms PM analyser Data bases Meas. PMD objectSDDS QPS PM view PC PM view PIC PM view result PM converter and data manager Collection HWC PM viewer Conversion Analysis and display MA PM performance, Adriaan Rijllart PM PM conversion 1 and 2 PMD objectSDDS PMC Collection Conversion 1 PMX 2 PMD file + PMX description file MA PM performance, Adriaan Rijllart Data formatting, collection and storage (v1.0) Data model A set of conventions and rules on structuring the PM data and associated metadata Data collection and storage MA PM performance, Adriaan Rijllart Data transfer speed Test data: 1540 Kb (FGC) Client on cfc-sr4-dl4de (LHC FIP gateway), server on cs-ccr-pm1 100 Mb/s connection, pure technical network compresssendwritetotal 50 ms -> 98 Kb12 ms1-2 ms64 ms MA PM performance, Adriaan Rijllart PMD file conversion speed (v1.0) Test data: 10 signal arrays of different types (length = 10000) + metadata PMD file size = 172Kb, SDDS ASCII = 712Kb, SDDS bin = 621Kb Converter (Java) runs on cs-ccr-pm1, all files on the local disk Read PMDuncompressdecodeGenerate SDDS (Gregs SDDSFile) Total 1-2 ms 52 ms14 ms17 ms binary 325 ms ASCII 85 ms binary 393 ms ASCII MA PM performance, Adriaan Rijllart PMX data converter and manager PMD object SDDS bin + SDDS ascii PM system PM converter and data manager MA PM performance, Adriaan Rijllart PMD file conversion speed FGC file size 400 kB, QPS file size 100 kB. (1) BinX format change of text strings into numerical codes FGC 700 ms -> 420 ms QPS 150 ms (not affected) (2) binX -> PMX transition FGC 420 ms -> 270 ms (measured for old (5 buffers) data format) QPS 150 ms -> 80 ms (3) Further optimised PMX conversion (and FGC - new format) ascii+bin -> bin only FGC 310 ms -> 100 ms QPS 70 ms -> 30 ms MA PM performance, Adriaan Rijllart PM analyser and viewer LoggingAlarms Data bases Meas. SDDS bin result PM system HWC PM viewer QPS PMA PC PMA PIC PMA PM analyser Interaction analysis PC PMA view Panel can show Interaction view MA PM performance, Adriaan Rijllart Reading, analysis and graphing speed LabVIEW on Linux, data read from PMserver using NFS FGC: FGC File reading speed ASCII SDDS, size 1.8 MB, 200 ms. FGC Creating text table with 10 columns and lines, 4 s. FGC Creating graph with 6 traces points each, 1 s. QPS: QPS File reading, 500 kB, analysis and output table + graph, 2 s. PIC: PIC (logging DB) reading, size 270 kB, 4.1 s. analysis and table + graph, 15 s. MA PM performance, Adriaan Rijllart PM multi step analysis sequence QPS PMA PC PMA PIC PMA Express interaction analysis Global analysis QPS PMA PC PMA PIC PMA FlagsAnalog signalsGlobal signalsFinal IST analysis Express PM conclusion Full PM conclusion Time IST conclusion MA PM performance, Adriaan Rijllart PIC Data Analyser Automatically recognised events within time window. Results displayed in colour. Three events are shown in plots. Events can be selected and the other scroll down. MA PM performance, Adriaan Rijllart QPS data analyser Example: Automatic verification of the QPS tests for quality assurance. 1. The quench detection signal gets driven over the 100 mV threshold View of QPS signals to see that the system triggered and the quench heaters fired Automatic analysis of the quench heater discharge (log scale) showing the results Automatic analysis of the event with passed/not passed indication. MA PM performance, Adriaan Rijllart PC Data Analyser 1. Select event 2. Show table 3. Show plot MA PM performance, Adriaan Rijllart HWC PM analyser QPS PC PIC BI RF HWC PM analyser/viewer System selection System Files Alert BT PMA MA PM performance, Adriaan Rijllart Extract from HWC test procedure HCP-0002 Circuit typesActionReaction requiredResult of PM analysis Quench heater error OK Quench detector error MA PM performance, Adriaan Rijllart HWC PM test application MA PM performance, Adriaan Rijllart PM project: Milestones 1.June 06: Data analyser & viewer for QPS, PIC and PC data -> We are late with PC analysis: new buffers, new browser requirements, new directory structure, 2.Sept. 06: Extended PM data storage model for new clients -> Model implemented, testing by BI. 3.Sept. 06:Dry run, correlation of QPS, PIC and PC data -> Test with Sequencer done in August, but more work is needed to integrate systems analysis into HWC. 4.Oct. 06:PM system scaling test, including BI, BT and RF 5.Nov. 06:HW commissioning analysis, as defined in LHC-D-HCP During07:Analysis for Beam Commissioning -> Discussions about XPOC started