CUTS UNITE DSML for

Dataflow Modeling

By Pooja Varshneya

Component Workload Emulator (Coworker) Utilization Test Suite

(CUTS)

CUTS is a framework comprising of various system execution modeling (SEM) and system trace analysis tools.

Enable system developers and tester to conduct system integration testing during the early stages of the software lifecycle.

Assists in locating and rectifying quality-of-service problems during development phase of DRE systems.

Facilitates continuous system integration testing throughout the software lifecycle.

CUTS

UNITE UNITE is a system execution trace analysis tool.

Uses a dataflow model that is used to extract metrics of interest based for QoS evaluation.

Log messages are used to capture metrics of interests, such as time an event was sent or values of elements in an event.

Metrics of interest within the log messages are identified using message constructs.

QoS evaluation equation to applied to a dataflow model to evaluate QoS attributes, such as end-to-end response time, latency, and scalability.

EXAMPLE

SQLite DB

LF1: {STRING owner} receive request{INT reqid} at {INT recvtime}

LF2: granting access at {INT replytime} to request{INT reqid}

LF2.replytime – LF1.recvtime

Evaluation Function

Log Format

LF1.reqid = LF2.reqid

Relation

Need for DSML As dataflow models increase in size in terms of

number of log formats and relations amongst them, it becomes difficult for DRE developers to manage the complexity.

DSML provides an easy to use visual interface for creating dataflows.

Preserves the semantics of the language.

Enforces creation of valid relations between log formats by constraint checking.

Prevents duplication of dataflows.

CUTS UNITE DSMLCUTS UNITE DSML Datagraphs can be defined as

DM = (LF, CR, f)

A set LF of log formats that have variables V identifying what data to extract from log messages.

A set CR of causal relations that specify the order of occurrence for each log format such that

C Ri,j means LFi → LFj , or LFi occurs before LFj

A user-defined evaluation function f based on the variables in LF.

CUTS UNITE DSMLCUTS UNITE DSML Unit Test can be defined as

UT = (fa , fe ,G, S)

fa is an aggregation function used to convert a data set to a single value. Examples : AVERAGE, MIN, MAX, and SUM.

fe is an evaluation function used to evaluate log-format attributes.

For a given aggregation function fa, grouping G is used to identify data sets that should be treated independent of each other.

A Service S defines any external utility that can process the results generated by UNITE. Examples : gnuplot

CUTS DSML Meta-Model

CUTS DSML Constraints View

Connection.src (“Type”) == Connection.dst(“Type”)

DaDatagraph Example

Log Format

Relation

Key

CUTS UNITE InterpreterUDM based interpreter

Validates the models against XML schema definition.

Parses the datagraphs and unit tests to generate XML based configuration files

<datagraph_name>.datagraph <UnitTest_name>.unite

Uses Xerces DOM parser to create XML Document.

Interpreter Output

UnitTest_Login.uniteDatagraph_Login.datagrap

h

Project Website

http://www.dre.vanderbilt.edu/CUTS/

DEMO