CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly...

18
Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 CMS RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002

Transcript of CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly...

Page 1: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/20021

CMS

RCMS – Plan of work

Michele Gulmini

DAQ Weekly7th May 2002

Page 2: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/20022

CMS

RCMS SRCMS Summaryummary

SecurityService UserDB

• Run Session– the hardware and software needed to

operate a physics or test run with the entire or a partition of the CMS apparatus.

– Multiple Run Sessions may coexist and run concurrently

– Every activated run session has the own Session Manager

• Services– SECURITY SERVICE (SS)

• login and authentication procedures – RESOURCE SERVICE (RS)

• It manages the elements of the DAQ system:

– configuration of the components

– Session and Partition mngrs– Information and Monitor System (IMS)

• It collects all the information originated from the sub-systems, and provides them to the requesting clients

– JOB CONTROL• It starts, monitor and kill the

software infrastructure of the RCMS– PROBLEM SOLVER

• It uses the information provides by IMS to catch severe malfunctions of the apparatus and try to fix them

ResourceService

Info&MonService

Job Ctrl

ProblemSolver

Sub-SystemController

Ser

vice

s C

onne

ctio

n

Session Manager

RCMS

UIUI

UI

ConfDB

LogDB

RunBkkpng

All the Services are accessible via well defined

APIs. So they can work independently to serve a

specific application (e.g. configure a XDAQ system)

or fully integrated in the RCMS to provide a full

Run Control System.

Page 3: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/20023

CMS

RCMS prototype statusRCMS prototype status

InternetXML -http

InternetXML -http

Sub-SystemXDAQ Resources

SecurityService

ResourceService

Info&MonService

Job Ctrl

ProblemSolver

FunctionManager

XM

L ov

er h

ttp

prot

ocol

s

Session Manager

RCMS

UIUIGUI

UserDB

ConfDB

LogDB

RunBkkpng

UIUIGUI Servlet ContainerApache TomCat XML:DB +

mySQL

FSM

XDAQ Adapter

FSM

Page 4: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/20024

CMS

RCMS prototype statusRCMS prototype status

• Resource Service with Security Service. Interactive GUI to handle run sessions, partitions, etc. Customizable according to the application needs (e.g. Test beams, simple test environment, etc.)

• Session Manager

• Function Manager

• XDaq adapter (XDAQ december version)

• Finite State Machine

• First integration and tests with xdaq nodes

• GUI: work in progress

• IMS: under development

Page 5: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/20025

CMS

Resource Service ImplementationResource Service Implementation

Java Servlet

Resource Service Servlet

XML XML:DB

REL DBJava Objs

XML Parser(Castor)

http

XML

ResourceSubscribing

Handler

Still aliveheartbeat

Session,Partition

management

AvailableResources

PartitionData Base

SoftwareData Base

New Nodesubscribe request

ping all the Registered nodes

Sessions, Partitionsdefinition

Session,Partition Setup

Manual Resources

Handler

CO

NF

IG D

B

API to add, modify

delete, retrieve a resource

description.

Resources can be:

sessions, partitions, hrdw

description, sftw, FSM

description, FSM code, etc.

Page 6: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/20026

CMS

Session and Function Manager ImplementationSession and Function Manager Implementation

SM servletSM servletResource ServiceResource Service

download def. + download def. + impl.impl.

FM servletFM servlet FM servletFM servlet

XML definitionXML definitionJavaJava

Impl.Impl.

FF

SS

MM

XML definitionXML definitionJavaJava

Impl.Impl.

FF

SS

MM

XML definitionXML definitionJavaJava

Impl.Impl.

FF

SS

MM

XML definitionXML definitionJavaJava

Impl.Impl.

FF

SS

MM

XML definitionXML definitionJavaJava

Impl.Impl.

FF

SS

MM

XML definitionXML definitionJavaJava

Impl.Impl.

FF

SS

MM

Function Managers and Function Managers and Session Manager have a Session Manager have a built in FSM to track the built in FSM to track the status of the related status of the related controlled components. controlled components. The FSM is composed of The FSM is composed of a XML definition and a a XML definition and a Java class Java class implementation implementation reppresenting the actions reppresenting the actions to be performed.to be performed.

FSM definition and FSM definition and implementation are implementation are managed by the managed by the Resource Service.Resource Service.

ResourcesResources ResourcesResources

XML/HTTPXML/HTTP

XDAQXDAQ

SOAPSOAP

Page 7: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/20027

CMS

RCMS Light to configure small systemsRCMS Light to configure small systems

PC1PC1

PC2PC2

TomcatTomcat

FMFM

GUIGUI

XDAQ resourcesXDAQ resources

RSRS

SSSS

• This light version of RCMS allows to handle (store, retrieve, download) configurations of small systems and control them

• The version can include:– Simple command and resource configuration GUI– A single Tomcat managing SS, RS and FM and the download mechanism to the

XDAQ resources

Page 8: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/20028

CMS

RCMS prototype statusRCMS prototype status

Sub-SystemXDAQ Resources

SecurityService

ResourceService

Info&MonService

Job Ctrl

ProblemSolver

XM

L ov

er h

ttp

prot

ocol

s

RCMS

GUI

UserDB

ConfDB

LogDB

RunBkkpng

Servlet ContainerApache TomCat XML:DB +

mySQL

FunctionManager

FSM

XDAQ Adapter

Page 9: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/20029

CMS

RCMS prototype statusRCMS prototype status

Sub-SystemXDAQ Resources

SecurityService

ResourceService

Info&MonService

Job Ctrl

ProblemSolver

XM

L ov

er h

ttp

prot

ocol

s

RCMS

GUI

UserDB

ConfDB

LogDB

RunBkkpng

Servlet ContainerApache TomCat XML:DB +

mySQL

FunctionManager

FSM

XDAQ Adapter

FSM

SessionManager

Page 10: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/200210

CMS

RCMS prototype statusRCMS prototype status

Sub-SystemXDAQ Resources

SecurityService

ResourceService

Info&MonService

Job Ctrl

ProblemSolver

XM

L ov

er h

ttp

prot

ocol

s

RCMS

GUI

UserDB

ConfDB

LogDB

RunBkkpng

Servlet ContainerApache TomCat XML:DB +

mySQL

FunctionManager

FSM

XDAQ Adapter

FSM

SessionManager

Page 11: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/200211

CMS

• IMS requirements:

• collecting all the information coming from any DAQ resource or RCMS internal component

• storing the information in a DBMS

• providing the information to the clients “on request”

• providing the information ‘asynchronously’ to the clients who subscribed to receive it (publish/subscribe protocol)

The information can be of several types:

- log and error messages (information, warning, error, failure)

- resource status change

- monitor information (statistics, histograms,...)

- others...

Information and Monitor ServiceInformation and Monitor Service

Page 12: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/200212

CMS

Information and Monitor Service - ExampleInformation and Monitor Service - Example

XDAQXDAQ

Appl.Appl.

SMSM

FMFM FMFM

Error, monitor Error, monitor msgsmsgs

status change status change msgmsg

IMSIMS

SystemState Display

Query/responseQuery/response subscribesubscribepublishpublish

Page 13: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/200213

CMS

IMS logical viewIMS logical view

ResourceStatus Change

Error StatisticsError Statistics

MessageLogger (DB)

State logger

Monitor - HistoryDB

Mes

sage

F

ilter

ing

and

Dis

patc

her

Monitor Info

SystemState Display

Error Statistics Alarm Display

MonitorSystems

Clie

nt S

ubsc

riber Log Messages

More … More … Info

Page 14: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/200214

CMS

IMS prototype (I)IMS prototype (I)

IMS

XMLDBXMLDB

FilterFilter

EngineEngine

XPath XPath basedbased

subscriber 1

subscriber nJAXM

XML message

Soap

Messages Tomcat servlet containerTomcat servlet container

NOTIFY

Soap

SUBSCRIBE

QUERY

• Web Services technology– Sun JWSDP (Java Web Services Development Package)

• Tomcat servlet container• JAXM (SOAP XML Messaging)• JAXP (XML Processing – SAX, DOM, XSLT + Xpath)• JAX-RPC (Java API for XML-based RPC)JAX-RPC (Java API for XML-based RPC)• JAXR (XML Registries)JAXR (XML Registries)

• XMLDB: Exist, mySQL

Page 15: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/200215

CMS

IMS Prototype (II)IMS Prototype (II)

• IMS: “standalone” or integrated in the RCMS• IMS core: new services can be plugged in

XML Registries:

statusstatusLogLog

??IMSIMS

corecore

Service 1Service 1

Service nService n

UDDIUDDIWSDLWSDL

The single servlet container describes its services by means of the Web Service Description Language (WSDL) and then publishes them to the Universal Description Discovery and Integration (UDDI) registries

clientclientService 1Service 1

Clients looking for services, query first the UDDI server to discover the location of the service and then access to it

Tomcat 1Tomcat 1

Tomcat 2Tomcat 2

Page 16: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/200216

CMS

IMS plansIMS plans

• IMS protocol definition (XML schema)– First proposal delivered end of March– This proposal is the reference of the first prototype

• First prototype: (June CMS Week)– Log service– Subscribe/Publish mechanism– XPath based filtering mechanism– RCMS integration

• Full prototype: (September)– XML Registries– Documentation– Software packaging and Distribution (release 0.1 delivering)

Page 17: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/200217

CMS

RCMS PlansRCMS Plans

• June CMS Week:– RCMS prototype with RS and “IMS first prototype” integrated– Functionality tests with small (xdaq based) DAQs (e.g.: muon DAQ) (Legnaro-

Cern)– First performances tests on a XDAQ enabled Linux cluster (Legnaro)– RCMS Light: packaging, documentation and distribution (release 0.1) to be

discussed (Legnaro)

• September CMS Week:– IMS full prototype (Cern)– Moving Resource Service, Session and Function Managers communication

protocol to SOAP (Legnaro)– RCMS services compliant to web services technologies– Packaging, software distribution, documentation (RCMS release 0.1 delivering)

• Other issues:– XML:DB product investigations:

• Apache Xindice • Oracle 9i vers. 2 (May) (Legnaro)

– GUI product investigations:• Flash Mx (embedded Flash code into Java) (Legnaro)

– XML Registries investigation (Cern-Legnaro)

Page 18: CMS Michele Gulmini, Cern, DAQ Weekly 07/05/2002 1 RCMS – Plan of work Michele Gulmini DAQ Weekly 7th May 2002.

Michele Gulmini, Cern, DAQ Weekly 07/05/200218

CMS

ProblemSolver

Info&MonServiceResource

Service

RCMS – a step forwardRCMS – a step forward

Sub-SystemXDAQ Resources

SecurityService

Job Ctrl

Sub-SystemCtrl

Servlet Containers = web services

SOAPSOAP

Session ManagerSession

Manager

UIUIGUI

UDDI

1 2

WSDL

DataMoverService

DCS GTWService

ConditionsDB Srvc

Event Ctlg Srvc

WebCamService