NSCLDAQ: The Past, Present, and...

19
NSCLDAQ: The Past, Present, and Future Jeromy Tompkins 1/29/2015 Tompkins - Research Discussion

Transcript of NSCLDAQ: The Past, Present, and...

Page 1: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

NSCLDAQ: The Past, Present, and Future

Jeromy Tompkins

1/29/2015 Tompkins - Research Discussion

Page 2: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

Outline

• What is NSCLDAQ?

• The need for NSCLDAQ 11.0• Why do we need a new major version?

• Major features in 11.0

• A case study – Unification of CAESARDaq and S800Daq

• So what?

• Procedural tid bits

• Towards the future

1/29/2015 Tompkins - Research Discussion

Page 3: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

What is NSCLDAQ?

• Suite of applications and services

• Provides data flow management and run control

• Flexible

• Extensible

• Composable

• A set of drivers

1/29/2015 Tompkins - Research Discussion

Page 4: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

NSCLDAQ Concepts

SourceRing

BufferRing

BufferSinkFilter

MergerRing

BufferSource

Ring Buffer

Sink

1/29/2015 Tompkins - Research Discussion

Page 5: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

The suite…

Merging

EVB tcl packageglomteeringunglomringFragmentSourceofflineordererstartOrderer

Buffering/Streaming

ringbuffer(RingBuffer API)

stdintoringringtostdout

Filters

BufferToRingcompatibilitybufferconvert10to11Filter framework

Data Sinks

dumperScalerDisplaysclclienteventlog

Run Control

ReadoutShell

Data Sources

VMUSBReadoutCCUSBReadoutProduction Readouts800toring

1/29/2015 Tompkins - Research Discussion

Page 6: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

We are about to move from version 10.2 to 11.0 !!

1/29/2015 Tompkins - Research Discussion

Page 7: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

Why NSCLDAQ 11.0?

• Increased demand for event building

• Need to simplify the unification of separate DAQs• Data flow management

• Run control

1/29/2015 Tompkins - Research Discussion

Page 8: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

Major Features

• Improved support for event building

• Updated data format

• Revamped ReadoutGUI

• Filter framework

1/29/2015 Tompkins - Research Discussion

Page 9: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

Event Builder Improvements

• Diagnostics• Input and output rates

• Error detection• Duplicate timestamp values• Out-of-order timestamps• Late fragments• Incomplete barriers

• Input flow control

• Simplified setup

• Offline orderer

1/29/2015 Tompkins - Research Discussion

Page 10: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

Data Format – Addition of the “body header”

• Ring items continue to be standard NSCLDAQ data format

• Adds ability to embed timestamp and source id into data.

Header Size (bytes)

Type

Body Data …

Header Size (bytes)

Type

Body Header Size (bytes) = 0

Body Data …

Header Size (bytes)

Type

Body Header Size (bytes) = 20

Timestamp

Source id

Barrier type

Body Data …

10.2 11.0 (no body header)

11.0 (with body header)

1/29/2015 Tompkins - Research Discussion

Page 11: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

The 11.0 ReadoutGUI

• Simplified system building

• Controls an arbitrary subcomponents

• Extensible

• Remote controllable

1/29/2015 Tompkins - Research Discussion

Page 12: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

Filter Framework

• Streamlines development of online and offline tools

• Skeleton provides boilerplate code

• ROOT compatible!

• USES: data formatting, integrity checker, analysis platform, “traffic control”

Filter program

stdinRing Buffer

File

stdoutRing Buffer

File

1/29/2015 Tompkins - Research Discussion

Page 13: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

The Final Product

VMUSB

CCUSB

EVB CSRFilter filt

ReadoutGUI

VMUSB

CCUSB

EVB

RunControl

s800_eCaesar

s80

0to

rin

g

EVB

Masterbuilt

ReadoutGUI

spdaq45

spdaq48

u6pc2

s800SclrFilter

s800SclrRing

csrSclrFilter

csrSclrRing

1/29/2015 Tompkins - Research Discussion

Page 14: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

So What?

• “Current” link will change to point to 11.0. • Make sure your system still works after this changes

• Earlier releases will not see new development• May be asked to upgrade to 11.0 to fix bugs if running an older system

1/29/2015 Tompkins - Research Discussion

Page 15: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

Don’t Panic!

• All previous releases will remain accessible.

• Compatibility software will exists for converting 8.x and 10.x data to 11.0 formats

• Documentation is available at docs.nscl.msu.edu/daq

• We are here if you still have questions.

1/29/2015 Tompkins - Research Discussion

http://docs.nscl.msu.edu/daq/
Page 16: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

How do I…

• Request a new feature or new device support? • Contact the DAQ committee. [translation: email Sean Liddick (chair)]

• Contribute a new feature to NSCLDAQ?• Ultimately needs to go through the DAQ committee, but feel free to chat with Ron or

myself first.

• Report a bug?• High urgency (e.g. beam on target) Phone call• Normal urgency

• File a bug against NSCLDAQ at https://swdev-redmine.nscl.msu.edu• Email [email protected] or [email protected]

• Find documentation?• Go to docs.nscl.msu.edu/daq• man –M /usr/opt/daq/11.0/share/man

1/29/2015 Tompkins - Research Discussion

https://swdev-redmine.nscl.msu.edu/
mailto:[email protected]
mailto:[email protected]
Page 17: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

Towards Versions 11.1, 11.2, 11.3, … , 12.0

What do you need that you don’t have now in NSCLDAQ 11.0?

Planned improvements

• Improve diagnostics

• Stability enhancements

• Improve support for legacy data formats

• Further simplification of experiment setup

1/29/2015 Tompkins - Research Discussion

Page 18: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

Summary

• NSCLDAQ is a suite of software tools to manage data flow and run control.

• NSCLDAQ 11.0 is upon us and brings a host of improvements for event building

• Flexibility is built in to meet the wide range of experimental needs at the NSCL and beyond

• Future of NSCLDAQ is in your hands…we’re listening.

1/29/2015 Tompkins - Research Discussion

Page 19: NSCLDAQ: The Past, Present, and Futuredocs.nscl.msu.edu/daq/ResearchDiscussions/tompkins_1_29...NSCLDAQ Concepts Source Ring Buffer Ring Buffer Filter Sink Merger Ring Buffer Source

Thank you.

• Ron Fox

• Sean Liddick

1/29/2015 Tompkins - Research Discussion


Research Article Noise Source Identification of a Ring ...downloads.hindawi.com/journals/mpe/2013/875929.pdf · Research Article Noise Source Identification of a Ring-Plate Cycloid

Research Article Noise Source Identification of a Ring ...downloads.hindawi.com/journals/mpe/2013/875929.pdf · Research Article Noise Source Identification of a Ring-Plate Cycloid

Realization 4. DB Buffer Management - - TU …. DB Buffer Management Theo Härder ... DB buffer mgmt Role of DB Buffer Management in a DBMS ... • effective DB buffer management ...

Realization 4. DB Buffer Management - - TU …. DB Buffer Management Theo Härder ... DB buffer mgmt Role of DB Buffer Management in a DBMS ... • effective DB buffer management ...

Storage cells for internal experiments with Atomic Beam Source at the COSY storage ring

Storage cells for internal experiments with Atomic Beam Source at the COSY storage ring

Data Communication and Networks Lecture 2 ADTs in Protocol Design (Ring Buffer, Queue, FSM) September 16, 2004 Joseph Conron Computer Science Department.

Data Communication and Networks Lecture 2 ADTs in Protocol Design (Ring Buffer, Queue, FSM) September 16, 2004 Joseph Conron Computer Science Department.

Survey and Alignment for Taiwan Photon Source Storage Ring · storage ring girders. The whole equipment of storage ring can be aligned smoothly as shown in Figure 6. Figure 6: The

Survey and Alignment for Taiwan Photon Source Storage Ring · storage ring girders. The whole equipment of storage ring can be aligned smoothly as shown in Figure 6. Figure 6: The

Will Bring in a New Ring Milestone in Advanced Light Source … · 2020-02-01 · Milestone in Advanced Light Source Upgrade Project Will Bring in a New Ring Construction of innovative

Will Bring in a New Ring Milestone in Advanced Light Source … · 2020-02-01 · Milestone in Advanced Light Source Upgrade Project Will Bring in a New Ring Construction of innovative

WorkshopHandout TC2 Database Server - Beckhoff · Topic: TwinCAT Database Server ... Finally use the write function block with the ring buffer mode “RingBuffer_Count” to write

WorkshopHandout TC2 Database Server - Beckhoff · Topic: TwinCAT Database Server ... Finally use the write function block with the ring buffer mode “RingBuffer_Count” to write

Buffer Overflowpeople.cs.vt.edu/~gangwang/class/cs4264/4-buffer-overflow.pdf · Buffer Overflow Attacks 3 •What is a buffer? •A memory space in which data/code can be held •Buffer

Buffer Overflowpeople.cs.vt.edu/~gangwang/class/cs4264/4-buffer-overflow.pdf · Buffer Overflow Attacks 3 •What is a buffer? •A memory space in which data/code can be held •Buffer

Using a Network Ring Buffer for Science and Outreach · DataTurbine®, also called Ring-Based Network Buffer (RBNB), is licensed by Creare [4] and is available free to non-commercial

Using a Network Ring Buffer for Science and Outreach · DataTurbine®, also called Ring-Based Network Buffer (RBNB), is licensed by Creare [4] and is available free to non-commercial

50' UNDISTURBEDVEGETATIVE BUFFER · 15 6 17 3 25' state buffer 50' undisturbedvegetative buffer 50' undisturbed vegetative buffer 50' undisturbedvegetative buffer asphalt asphalt

50' UNDISTURBEDVEGETATIVE BUFFER · 15 6 17 3 25' state buffer 50' undisturbedvegetative buffer 50' undisturbed vegetative buffer 50' undisturbedvegetative buffer asphalt asphalt

SAFETY DATA SHEET - Pro-Lab Diagnostics...Buffer Solution pH 5.0 Buffer Solution pH 5.5 Buffer Solution pH 6.0 Buffer Solution pH 6.5 Buffer Solution pH 7.0 Buffer Solution pH 7.5

SAFETY DATA SHEET - Pro-Lab Diagnostics...Buffer Solution pH 5.0 Buffer Solution pH 5.5 Buffer Solution pH 6.0 Buffer Solution pH 6.5 Buffer Solution pH 7.0 Buffer Solution pH 7.5

BUFFER SOLUTIONS. CONTENTS What is a buffer solution? Uses of buffer solutions Acidic buffer solutions Alkaline buffer solutions Buffer solutions - ideal.

BUFFER SOLUTIONS. CONTENTS What is a buffer solution? Uses of buffer solutions Acidic buffer solutions Alkaline buffer solutions Buffer solutions - ideal.

STEEL/ALUMINUM FORKLIFT & BUFFER CYLINDERS...Manchester Tank’s Forklift & Buffer Cylinders are a perfect, cost effective fuel source for small commercial engine lifts, floor sweepers,

STEEL/ALUMINUM FORKLIFT & BUFFER CYLINDERS...Manchester Tank’s Forklift & Buffer Cylinders are a perfect, cost effective fuel source for small commercial engine lifts, floor sweepers,

Air Source Heat Pump Installation and Maintenance … Source Heat Pump Installation and Maintenance Manual Model ... as possible to the pump, ... We don’t normally use buffer vessels

Air Source Heat Pump Installation and Maintenance … Source Heat Pump Installation and Maintenance Manual Model ... as possible to the pump, ... We don’t normally use buffer vessels

Ring: a Unifying Meta-Model and Infrastructure for Smalltalk Source ...

Ring: a Unifying Meta-Model and Infrastructure for Smalltalk Source ...

Engineering Integration of the Double- Double Bend Achromat (DDBA) into the Diamond storage ring Jim Kay Diamond Light Source Low emittance ring 2013 workshop.

Engineering Integration of the Double- Double Bend Achromat (DDBA) into the Diamond storage ring Jim Kay Diamond Light Source Low emittance ring 2013 workshop.

Buffer-to-Buffer Credits Exchanges andBuffer Credits ... · Buffer-to-Buffer Credits Exchanges andBuffer Credits, Exchanges, ... 456789101112131415161718 12345678. 0 ... 91011121314151617181920

Buffer-to-Buffer Credits Exchanges andBuffer Credits ... · Buffer-to-Buffer Credits Exchanges andBuffer Credits, Exchanges, ... 456789101112131415161718 12345678. 0 ... 91011121314151617181920

Project of construction of a cottage community “Manor Springs” · Ring road 142,000 m2 Buffer zone of the ring road 62,000 m2 Territory of water reservoirs 264,864 m2 Net area

Project of construction of a cottage community “Manor Springs” · Ring road 142,000 m2 Buffer zone of the ring road 62,000 m2 Territory of water reservoirs 264,864 m2 Net area

Positron Source Relocation Damping Ring @ 10Hz S. Guiducci (INFN-LNF)

Positron Source Relocation Damping Ring @ 10Hz S. Guiducci (INFN-LNF)

YT. Media Type Composition –Buffer (phosphate based) –Nitrogen source (ammonium chloride or ammonium sulfate) –Carbon Source (glucose or glycerol) –Trace.

YT. Media Type Composition –Buffer (phosphate based) –Nitrogen source (ammonium chloride or ammonium sulfate) –Carbon Source (glucose or glycerol) –Trace.