The Open Source Messaging Powering Wall Street
-
Upload
angelo-corsaro -
Category
Technology
-
view
1.484 -
download
0
description
Transcript of The Open Source Messaging Powering Wall Street
![Page 1: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/1.jpg)
Angelo Corsaro, Ph.D.Chief Technology Officer
OMG RTESS and DDS SIG [email protected]
Delivering Performance, Openness, and Freedom
OpenSplice DDS
The Open Source Messaging Accelerating Wall Street
![Page 2: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/2.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Agenda
‣ The Big News‣ What is OpenSplice DDS‣ DDS vs AMQP‣ Why OpenSplice DDS?‣ Concluding Remarks
![Page 3: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/3.jpg)
D e l i v e r i n g P e r f o r m a n c e , O p e n n e s s , a n d F r e e d o m
OpenSplice DDS
:: http://www.opensplice.org
April 20th, 2009 OpenSplice|DDS Goes Live!
![Page 5: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/5.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Agenda
‣ The Big News‣ What is OpenSplice DDS‣ DDS vs AMQP‣ Why OpenSplice DDS?‣ Concluding Remarks
![Page 6: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/6.jpg)
D e l i v e r i n g P e r f o r m a n c e , O p e n n e s s , a n d F r e e d o m
OpenSplice DDS
High Performance Pub/Sub
![Page 7: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/7.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
High Performance Pub/Sub
‣ Fully distributed, Peer-to-Peer Communication
‣No Single Point of Failure
‣No Single Point of Bottleneck
‣Multicast-enabled
‣High performance and highly scalable
‣High availability
‣hot-swap
‣hot-hot architecture
The right data, at the right place, at the right time
-- All the Time.
Publisher
SubscriberPublisher
Publisher
Subscriber
Subscriber
Brokers
![Page 8: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/8.jpg)
D e l i v e r i n g P e r f o r m a n c e , O p e n n e s s , a n d F r e e d o m
OpenSplice DDS
Data-CentricPub/Sub
![Page 9: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/9.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Data-Centric Pub/Sub
‣ Distributed Relational Data Model
‣ Local Queries
‣ Continuous Queries / Content Based Subscriptions
‣Windows
‣ Object/Relational Mapping
‣ Support for a subset of SQL-92
Perfect Blend of Data-Centric and Real-Time Publish/Subscribe Technologies
‣ Data-Centric Features are built-in and don’t rely on an external DBMS
‣ Providing thus performance, scalability, and availability
A
B
CD
E
F
m
J
K
Publisher
SubscriberPublisher
Publisher
Subscriber
Subscriber
DBMS
![Page 10: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/10.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Data-Centric Pub/Sub
A
B
CD
E
F
m
J
K
Publisher
SubscriberPublisher
Publisher
Subscriber
Subscriber
![Page 11: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/11.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Data-Centric Pub/Sub
A
B
CD
E
F
m
J
K
Publisher
D
E
J
K
A F
CD
A
B D
E
J
K
Subscriber
Subscriber
Subscriber
CD
A
B
Publisher
J
K
A F
Publisher
D
E
![Page 12: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/12.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Topics and Data-Centric Pub/Sub‣ Topics. Unit of information exchanged between
Publisher and Subscribers.
‣ Data Types. Type associated to a Topic must be a structured type expressed in IDL
‣ Topic Instances. Key values in a datatype uniquely identify a Topic Instance (like rows in table)
‣ Content Awareness. SQL Expressions can be used to do content-aware subscriptions, queries, joins, and correlate topic instances
struct TempSensor { int tID; float temp; float humidity; };#pragma keylist TempSensor tID
tID temp humidity
1
2
3
21 62
27 78
25.5 72.3
TempSensor
Instances
tID
temp
humidity
1
21
62
tID
temp
humidity
1
23
65
tID
temp
humidity
1
22
63
Timet1 t2 t3
Samples
Topic Type
Topic
SELECT * FROM TempSensor t WHERE t.temp > 25
tID temp humidity
2
3
27 78
25.5 72.3
![Page 13: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/13.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Distributed Relational Information Modeling
‣ Topic Keys can be used to identify instances as well as relationships
‣ Relationships can be navigated by relying on a subset of SQL 92
‣ One-to-many relationships can be captured using foreign keys
‣ Many-to-many relationships need to be modeled using a topics
‣ Keys can be represented by an arbitrary number of Topic fields
tID: inttemp: floathumidity: floatrID: int
TempSensorrID: intwidth: floatheight: floatlength: floatfID: int
Room
fID: intlevel: intopen: int
Floor
![Page 14: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/14.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Object/Relational Mapping
‣ Arbitrary object reconstructions
‣ Automatic Relationships Management
‣ Inheritance
‣ Local Operations
‣ Local/Distributed State
getTemp()getHumidity()
temp: floathumidity: float
TempSensor
set_climate();
width: floatheight: floatlength: floatclimate: int
Room
set_status()set_climate()get_level()
level: intopen: intclimate: int
Floor
setTemp()setHumidity()setFanLevel()start()stop()pause():
temp: floathumidity: float
Conditioner * 1
*
1
*1
tID: inttemp: floathumidity: floatrID: int
TTempSernsor
rID: intwidth: floatheight: floatlength: floatfID: int
TRoom
fID: intlevel: intopen: int
TFloor
cID: inttemp: floathumidity: floatfan_level: intstatus: intrID: int
TConditioner
![Page 15: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/15.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Data Centric Publish/Subscribe
Fully Distributed Global Data Space
struct TempSensor { int tID; float temp; float humidity; };#pragma keylist TempSensor tID
tID temp humidity
1 18 60
tID temp humidity
1
2
3
18 60
22 75
21 71
tID temp humidity
3 21 71
TempSensor
TempSensor
tID temp humidity
2 22 75
TempSensor
Publishers Subscribers
TempSensor
tID temp humidity
2
3
22 75
21 71
TempSensor
SELECT * FROM TempSensor t WHERE s.temp > 20
tID temp humidity
1 18 60
TempSensor
s.tID == 1
![Page 16: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/16.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Data Centric Publish/Subscribe
Fully Distributed Global Data Space
tID temp humidity
1
2
3
21 62
22 75
21 71
tID temp humidity
3 21 71
TempSensor
TempSensor
tID temp humidity
2 22 75
TempSensor
Publishers Subscribers
TempSensor
TempSensor
SELECT * FROM TempSensor t WHERE s.temp > 20
tID temp humidity
1 21 62
TempSensor
s.tID == 1
tID temp humidity
1 21 62
tID temp humidity
1
2
3
21 62
22 75
21 71
struct TempSensor { int tID; float temp; float humidity; };#pragma keylist TempSensor tID
![Page 17: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/17.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Processing Content & Structure
P
S1
S2
S3
{iID = 1}
{temp > 21 | humidity > 75}
{ temp <16 }
OpenSplice DDS some of the most useful features found in Complex Event Processing platforms!
Complex Event Processing...
tID temp humidity
3 21.5 72.3
tID temp humidity
2 20 78tID temp humidity
1 21 62
‣ Local Queries
‣ Continuous Queries (Content-based Subscriptions)
‣ Topics Joins & Projections
‣ Events windows (via History QoS)
![Page 18: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/18.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Processing Content & Structure
P
S1
S2
S3
{iID = 1}
{temp > 21 | humidity > 75}
{ temp <16 }
Complex Event Processing...
tID temp humidity
1 21 62
tID temp humidity
2
3
20 78
21.5 72.3
OpenSplice DDS some of the most useful features found in Complex Event Processing platforms!
‣ Local Queries
‣ Continuous Queries (Content-based Subscriptions)
‣ Topics Joins & Projections
‣ Events windows (via History QoS)
![Page 19: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/19.jpg)
D e l i v e r i n g P e r f o r m a n c e , O p e n n e s s , a n d F r e e d o m
OpenSplice DDS
QoS-EnabledPub/Sub
![Page 20: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/20.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
QoS Model
‣ QoS-Policies are used to control relevant properties of OpenSplice DDS entities, such as:‣ Temporal Properties
‣ Priority
‣ Durability
‣ Availability
‣ ...
‣ Some QoS-Policies are matched based on a Request vs. Offered Model thus QoS-enforcement
Publisher
DataWriter
Topic
Type
QoS
Name
writes
QoS
DataWriter
Topic
Typewrites
Subscriber
DataReaderreads
DataReaderreads
...
QoS
Name
QoS
QoS QoS
QoS matching
......
QoS QoS
Type Matching
‣ Publications and Subscriptions match only if the declared vs. requested QoS are compatible ‣ e.g., it is not possible to match a publisher which delivers data unreliably with a subscriber which requires reliability
![Page 21: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/21.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Sample QoS Policies
‣ Rich set of QoS allow to configure several different aspects of data availability, delivery and timeliness
‣ QoS can be used to control and optimize network as well as computing resource
Publisher
DataWriter
Topic
Type
QoS
Name
writes
QoS
QoS
DataWriter
Topic
Typewrites
Subscriber
DataReaderreads
QoS
DataReaderreads
...
QoS
Name
QoS
QoS QoS
QoS matching
QoS matching
QoS Policy Applicability RxO Modifiable
DURABILITY
DURABILITY SERVICE
LIFESPAN
HISTORY
PRESENTATION
RELIABILITY
PARTITION
DESTINATION ORDER
OWNERSHIP
OWNERSHIP STRENGTH
DEADLINE
LATENCY BUDGET
TRANSPORT PRIORITY
TIME BASED FILTER
RESOURCE LIMITS
USER_DATA
TOPIC_DATA
GROUP_DATA
T, DR, DW Y N Data AvailabilityT, DW N N
Data Availability
T, DW - Y
Data Availability
T, DR, DW N N
Data Availability
P, S Y N Data DeliveryT, DR, DW Y N
Data Delivery
P, S N Y
Data Delivery
T, DR, DW Y N
Data Delivery
T, DR, DW Y N
Data Delivery
DW - Y
Data Delivery
T, DR, DW Y Y Data TimelinessT, DR, DW Y Y
Data Timeliness
T, DW - Y
Data Timeliness
DR - Y Resources
T, DR, DW N N
Resources
DP, DR, DW N Y ConfigurationT N Y
Configuration
P, S N Y
Configuration
![Page 22: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/22.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Mapping QoS
Data Latency
LatencyBudget TransportPriority
Throughput
DeadlineTimeBasedFilter
Control over Latency/Throughput tradeoff Control over data latency Control over data priority
Which properties does QoS controls?
![Page 23: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/23.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Mapping QoS
Data Latency
LatencyBudget TransportPriority
Throughput
DeadlineTimeBasedFilter
Control over Latency/Throughput tradeoff Control over data latency Control over data priority
Data Availability
OwnershipOwnershipStrength
Durability
History
Lifespan
Control over data queueing Control over data persistency Control over data sources hot-swap
Which properties does QoS controls?
![Page 24: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/24.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Mapping QoS
Data Latency
LatencyBudget TransportPriority
Throughput
DeadlineTimeBasedFilter
Control over Latency/Throughput tradeoff Control over data latency Control over data priority
Data Availability
OwnershipOwnershipStrength
Durability
History
Lifespan
Control over data queueing Control over data persistency Control over data sources hot-swap
Data Delivery
Reliability
DestinationOrder
Presentation
Control over data distribution reliability Control over data ordering Control over presentation
OpenSplice DDS provides programmatic QoS-driven support for configuring the most important properties of data distribution!
Which properties does QoS controls?
![Page 25: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/25.jpg)
D e l i v e r i n g P e r f o r m a n c e , O p e n n e s s , a n d F r e e d o m
OpenSplice DDS
Zero-ConfPub/Sub
![Page 26: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/26.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Zero-Conf Pub/Sub
‣ Dynamic Discovery. Publisher, Subscriber, and Topics are dynamically discovered
‣ Separation of Concerns. Applications are agnostic from networking details. Thus you can re-deploy the same business logic with different network, partitioning, configurations
‣ Tool Based. All configuration is tool assisted and happens outside of your application
CodeBloat
![Page 27: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/27.jpg)
D e l i v e r i n g P e r f o r m a n c e , O p e n n e s s , a n d F r e e d o m
OpenSplice DDS
Standard-BasedPub/Sub
![Page 28: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/28.jpg)
Object/Relational Mapping
Ownership DurabilityContent
Subscription
Minimum Profile
Data Centric Publish/Subscribe (DCPS)
Data Local Reconstruction Layer (DLRL)
DDS Interoperability Wire Protocol
Application
UDP/IP
Real-Time Publish/Subscribe Protocol
DD
SI v
2.1
DD
S v
1.2
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
The OMG Data Distribution Service Data Distribution Service for Real-Time Systems
‣ Leap forward in Topic-based Publish/Subscribe Middleware state of the art
‣ Carefully specified to allow very high performance, scalable, predictable and high-availability implementations
‣ Language Independent, OS and HW architecture independent
Fully Standardized Solution
‣ Data Distribution Service (DDS) for Real-Time Systems v1.2
‣ RTPS, DDS Interoperability Wire Protocol
The OMG Data Distribution Service satisfies the most challenging information dissemination requirements across a wide set of application domains, ranging from multi-board systems to system-of-systems
![Page 29: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/29.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
DDS RecommendationsIncreasingly Mandated/Recommended by Administrations
‣US Navy: Open Architecture
‣DISR/DISA: Net-centric Systems
‣EuroControl: Air Traffic Control Center Operational Interoperability
‣QinetiQ: Recommending DDS for VSI
A Great Time for DDS!
! The infrastructure evolution cycle is churning…– New -> Emerging -> Standard -> Commodity
– Middleware is emerging as OS declines
! …DDS is maturing…– OMG focus
– Wire spec
– Tools
– Enterprise integration
– Multiple products fielded
– Deployed applications!
! …and adoption is on the rise– Navy
– DISR
– FCS/SoSCOE
– Many significant applications
![Page 30: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/30.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Agenda
‣ The Big News‣ What is OpenSplice DDS‣ DDS vs AMQP‣ Why OpenSplice DDS?‣ Concluding Remarks
![Page 31: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/31.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Scope of Standardization
Object/Relational Mapping
Ownership DurabilityContent
Subscription
Minimum Profile
Data Centric Publish/Subscribe (DCPS)
Data Local Reconstruction Layer (DLRL)
DDS Interoperability Wire Protocol
Application
UDP/IP
Real-Time Publish/Subscribe Protocol
DD
SI
v2
.1D
DS
v1
.2
Interoperability Wire Protocol
(TCP, SCTP, UDP)/IP
Advanced Message Queuing Protocol
AM
QP
v0
.10
API (?)
Application
AMQP OMG DDS
![Page 32: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/32.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Scope of Standardization
Object/Relational Mapping
Ownership DurabilityContent
Subscription
Minimum Profile
Data Centric Publish/Subscribe (DCPS)
Data Local Reconstruction Layer (DLRL)
DDS Interoperability Wire Protocol
Application
UDP/IP
Real-Time Publish/Subscribe Protocol
DD
SI
v2
.1D
DS
v1
.2
Interoperability Wire Protocol
(TCP, SCTP, UDP)/IP
Advanced Message Queuing Protocol
AM
QP
v0
.10
API (?)
Application
Wire Protocol Standard
AMQP OMG DDS
![Page 33: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/33.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Scope of Standardization
Object/Relational Mapping
Ownership DurabilityContent
Subscription
Minimum Profile
Data Centric Publish/Subscribe (DCPS)
Data Local Reconstruction Layer (DLRL)
DDS Interoperability Wire Protocol
Application
UDP/IP
Real-Time Publish/Subscribe Protocol
DD
SI
v2
.1D
DS
v1
.2
Interoperability Wire Protocol
(TCP, SCTP, UDP)/IP
Advanced Message Queuing Protocol
AM
QP
v0
.10
API (?)
Application
Wire Protocol Standard
Pub/Sub Standard API
AMQP OMG DDS
![Page 34: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/34.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Scope of Standardization
Object/Relational Mapping
Ownership DurabilityContent
Subscription
Minimum Profile
Data Centric Publish/Subscribe (DCPS)
Data Local Reconstruction Layer (DLRL)
DDS Interoperability Wire Protocol
Application
UDP/IP
Real-Time Publish/Subscribe Protocol
DD
SI
v2
.1D
DS
v1
.2
Interoperability Wire Protocol
(TCP, SCTP, UDP)/IP
Advanced Message Queuing Protocol
AM
QP
v0
.10
API (?)
Application
Wire Protocol Standard
Pub/Sub Standard API
Object Relational Mapping Standard API
AMQP OMG DDS
![Page 35: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/35.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Architectural Style
Publisher
SubscriberPublisher
Publisher
Subscriber
Subscriber
Broker
OMG DDS
Publisher
SubscriberPublisher
Publisher
Subscriber
Subscriber
Broker
Broker
Broker
Broker
Broker
AMQP
![Page 36: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/36.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Key Differences in Summary
‣ Brokered Communication Architecture
‣ Peer-to-Peer Communication Architecture
AMQP
‣ Wire Protocol Standard‣ Interoperability across AMQP
implementations
‣ Wire Protocol + API Standard‣ Interoperability across DDS implementations
‣ Application Portability across DDS Implementation
‣ Header Based Routing ‣ Content-Based Filtering/Quering
‣ Not geared for High-Performance ‣ Designed bottom-up for maximum performance and determinism
DDS
![Page 37: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/37.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Agenda
‣ The Big News‣ What is OpenSplice DDS‣ DDS vs AMQP‣ Why OpenSplice DDS?‣ Concluding Remarks
![Page 38: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/38.jpg)
D e l i v e r i n g P e r f o r m a n c e , O p e n n e s s , a n d F r e e d o m
OpenSplice DDS
Best Performance
![Page 39: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/39.jpg)
© 2009, PrismTech. All Rights Reserved
Fast and Furious
The Fastest Open Source Ultra-Low Latency Messaging Middleware
‣Millions of Market Data Updates per Second
‣ < 60 micro-seconds latency on 1GBps Ethernet
‣ Negligible inter-core latency
Stay Ahead of Market Data Rates
![Page 40: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/40.jpg)
© 2009, PrismTech. All Rights Reserved
Advanced Traffic Spikes-Absorption Technology
Stable and Reliable
Stability, Reliability, and Predictability, Under all Conditions
‣Stable under the most extreme traffic spikes
‣Three configurable level of Spike Absorption
‣Guaranteed Reliability
![Page 41: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/41.jpg)
D e l i v e r i n g P e r f o r m a n c e , O p e n n e s s , a n d F r e e d o m
OpenSplice DDS
Best Architecture
![Page 42: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/42.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Multi-Core Ready Architecture
![Page 43: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/43.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Networking Architecture
Scalability and Efficiency
‣ Single shared library for applications & services
‣ Ring-fenced shared memory segment
‣ Data urgency driven network-packing
Architecture
‣ Network-channels
‣ Priority bands
‣ Network-partitions
‣ Multicast Groups
‣ Traffic-shaping‣ Burst/Throughput
Determinism & Safety
‣ Preemptive network-scheduler
‣ Data importance based network-channel selection
‣ Partition based multicast-group selection
‣ Managed critical network-resource
Traffic Shaping
OpenSplice DDSBinding
Networking
Shared
Memory
OpenSplice DDSBinding
Networking
Shared
Memory
Network Channels
Priority Bands
Pre-emptive Network Scheduer
Priority Scheduler
Data Urgency Traffic Pacing
Single Copy per Node
Pack Across Topics/Applications
Optimal Unmarshaling
![Page 44: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/44.jpg)
D e l i v e r i n g P e r f o r m a n c e , O p e n n e s s , a n d F r e e d o m
OpenSplice DDS
Best Technology Ecosystem
![Page 45: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/45.jpg)
© 2009, PrismTech. All Rights Reserved
Advanced Features‣Relational Data Modeling
‣Object/Relational Mapping
‣Event Processing‣Queries
‣Continuous Queries
‣Join/Projections
‣High Performance Caching
‣Persistency
‣Security
‣Development Tools
Object/Relational Mapping
Ownership PersistenceContent
Subscription
Minimum Profile
Real-Time Pub/Sub(DCPS)
Object-Oriented Pub/Sub (DLRL)
Networking Technology
Application
UDP/IP
Interoperable Wire Protocol (DDSI)
DD
SI v
2.1
DD
S v
1.2
Real-Time Networking
SOAPSecure Networking
DBMS
Spike Absorber
Connectors
PowerTools
MDE
Tuner
Connectors
![Page 46: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/46.jpg)
© 2009, PrismTech. All Rights Reserved
High Performance Caching‣Fully Distributed Caching Technology
‣Supports SQL Queries on local Cache
‣Support for Continuous SQL Queries on the whole distributed Cache
‣High-Performance, ultra-low-latency communication engine based on OpenSplice DDS
‣Fully exploits Data Locality and Prefetching
Disk
Key Value
Key Value
Key Value
Key Value
OpenSplice Cache
OpenSplice DDS
Disk
OpenSplice Cache
Key Value
Key Value
Key Value
Key Value
Disk
OpenSplice Cache
Key Value
Key Value
Key Value
Key Value
Disk
OpenSplice Cache
Key Value
Key Value
Key Value
Key Value
Disk
OpenSplice Cache
Key Value
Key Value
Key Value
Key Value
![Page 47: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/47.jpg)
D e l i v e r i n g P e r f o r m a n c e , O p e n n e s s , a n d F r e e d o m
OpenSplice DDS
Best of Open Source
![Page 48: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/48.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
OpenSplice DDS is Open Source
Delivering Performance, Openness, and Freedom
OpenSplice DDS
Enterprise Ed.
Community Ed.
Compact Ed.
Professional Ed.
‣ Product reorganized into Editions‣ Community Edition
‣ Compact Edition
‣ Professional Edition
‣ Enterprise Edition
‣ Product Editions provide a a growing set of functionality to address the needs of increasingly more sophisticated users
‣ The Community Edition is Open Source
‣ Compact, Enterprise and Professional Edition are available only through Commercial Subscriptions
![Page 49: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/49.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
A Feature Rich Community Edition
Object/Relational Mapping
Ownership DurabilityContent
Subscription
Minimum Profile
Data Centric Publish/Subscribe (DCPS)
Data Local Reconstruction Layer (DLRL)
DDS Interoperability Wire Protocol
Application
UDP/IP
Real-Time Publish/Subscribe Protocol
DD
SI
v2
.1D
DS
v1
.2
Interoperability Wire Protocol
(TCP, SCTP, UDP)/IP
Advanced Message Queuing Protocol
AM
QP
v0
.10
API (?)
Application
Delivering Performance, Openness, and Freedom
OpenSplice DDSAMQP
![Page 50: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/50.jpg)
D e l i v e r i n g P e r f o r m a n c e , O p e n n e s s , a n d F r e e d o m
OpenSplice DDS
Best Way of Spending Your Money
![Page 51: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/51.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Financial AdvantagesOpenSplice DDS subscriptions provides key advantages:
Community Edition
‣ Free like free speech, and
‣ Free like free beer!
Commercial Editions
‣ Cash/Flow Friendly
‣ Lower Total Cost of Ownership (TCO)
‣ Flexible model to tune needs vs. subscription
0
25
50
75
100
Y1Y2
Y3Y4
Y5
License vs. Subscription
License Subscription
![Page 52: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/52.jpg)
D e l i v e r i n g P e r f o r m a n c e , O p e n n e s s , a n d F r e e d o m
OpenSplice DDS
Hottest Technology
![Page 53: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/53.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
DDS AdoptionDefense
‣ Combat Management Systems
‣ Tactical Systems
‣ Communication Systems
‣ Radar Processing
‣ Submarine Systems
‣ Future Combat Systems
SCADA/Utilities
‣ Industrial Automation
‣ Power Grids (Smart Grids)
‣ Complex Telemetry (e.g. NASA Rocket Launch System)
![Page 54: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/54.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
DDS Adoption
Transportation
‣ Air Traffic Management/Control
‣ Metropolitan Traffic Management
‣ Underground Metropolitan Transportation
Financial Services
‣ Automated Trading
‣ Market Data Platforms
‣ Compliance Systems
‣ Risk Management
![Page 55: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/55.jpg)
© 2009, PrismTech. All Rights Reserved
Customers
Nokia
![Page 56: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/56.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Agenda
‣ The Big News‣ What is OpenSplice DDS‣ DDS vs AMQP‣ Why OpenSplice DDS?‣ Concluding Remarks
![Page 57: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/57.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Concluding Remarks‣ OpenSplice DDS is the ideal fit for addressing
several of the data distribution and management challenges faced by financial firms, such as:‣ Market Data Distribution
‣ High Performance Caching
‣ Real-Time Business Intelligence
‣ OpenSplice DDS has great performance on standard COTS HW and its architecture is designed for exploiting at best high-end multi-cores such as the Intel XEON 5500
‣ OpenSplice DDS is Commercially Supported Open Source Software
Delivering Performance, Openness, and Freedom
OpenSplice DDS
Enterprise Ed.
Community Ed.
Compact Ed.
Professional Ed.
Embrace Performance, Openness and Freedom. Join the OpenSplice DDS Community at www.opensplice.org
![Page 58: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/58.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
Online Resources
http://www.opensplice.com/
emailto:[email protected]
http://www.youtube.com/OpenSpliceTube
http://opensplice.blogspot.com http://bit.ly/1Sreg
http://www.dds-forum.org
http://portals.omg.org/dds
© 2009, PrismTech. All Rights Reserved
http://twitter.com/acorsaro/
![Page 59: The Open Source Messaging Powering Wall Street](https://reader033.fdocuments.us/reader033/viewer/2022060108/554f5472b4c905423f8b5436/html5/thumbnails/59.jpg)
Pro
prie
tary
Info
rmat
ion
- D
istri
butio
n w
ithou
t Exp
ress
ed W
ritte
n P
erm
issi
on is
Pro
hibi
ted.
© 2009, PrismTech. All Rights Reserved
Upcoming Webcasts on April 28
Why Should I Attend?
• Learn everything about the OpenSplice DDS Forge
• Discover the Roadmap and Plans for OpenSplice DDS
• Understand how you might contribute to incubator projects
An Introduction to OpenSplice DDS Open Source OpenSplice | DDS Webcast Series
April 28, 2009