RTI Technical Road Show SPAWAR SD
-
Upload
real-time-innovations-rti -
Category
Documents
-
view
2.962 -
download
3
description
Transcript of RTI Technical Road Show SPAWAR SD
Your systems. Working as one.Your systems. Working as one.
RTI Technical Road Show
October 11, 2012
RTI Invests in Standards
DDS: The Interoperability Standard for Mission Critical Systems• Data Distribution Service from OMG• OMG: world’s largest systems
software standards org– 470+ members– UML, DDS, CORBA, more
• No vendor lock-in– ~12 implementations– Proven interoperability– Choice of middleware vendors– Choice of subsystem vendors
Navy Embraces OA
• Next-generation of the U.S. Navy Aegis Weapon System, by Lockheed
• Highly distributed system including radar, weapons, displays and controls
• Standards-based, high-performance middleware avoids vendor lock-in and future-proofs the architectural design
Government Adopts Standards
• Dominant in military– DISA: DISR mandated– Navy: Open Architecture,
FORCEnet– Air Force, Navy and DISA: NESI– Army, OSD: UCS– NATO, UK MOD, South Korea,
many more• Many other applications
– Air traffic control, industrial automation, transportation, medical
• Hundreds of active programs– Multiple interoperable
implementations
New Government Standards
Interoperability between the applications demonstrated by six different vendors in 2012
OCI ETRI PrismTech IBM RTI TwinOaks
© 2012 RTI 7
Your systems. Working as one.Your systems. Working as one.
Working as One™
Agenda
• DDS standard– Motivation– Applicability
• RTI Connext– Overview– What’s new
• RTI’s Infrastructure Community (IC) model– RTI DDS free as Open Community Source– Low-cost commercial licenses and support
Trend: Increasing System ScaleDrivers• Increased situational awareness,
information sharing• Responsiveness, timeliness,
speed of command
Implications• More CPUs, nodes, apps, data• More developers, teams,
suppliers, integration
System of systems
Cost Constrains ScaleLimits Information Sharing & Connectivity
Time & cost of integration,
maintenance and upgrades
System Scale and Age
O(n2)
Challenges
• Business– Cost reduction: lifecycle and procurement
Development, integration, maintenance, upgradesLegacy system integration and modernization
– Agility: timely fielding of new capabilities• Technical
– Scalability: information volume– Reliability and availability
Solution
• Interoperability– Easily share data across (sub)systems– Minimize need for integration– Goal: “plug and play”
• Modularity– Decompose systems into interoperable
components– Components can evolve and be competed
independently– Reduces complexity
• Decentralization– Systems of systems are inherently
distributed, span organizations– Eliminates performance bottlenecks
?
Achieving Interoperability
• Communicate via explicit, well-defined interfaces– Independent of:
• Implementation• Programming language• Platform (operating system, CPU type)• Physical location, proximity (edge, data center, cloud, same server)
– Standard network protocol• Integration requires no knowledge of internals
– No need for reverse engineering, code inspection• A lingua franca
– Integration effort is O(1) to O(n), not O(n2)• Components are evolvable, interchangeable, swappable,
shareable, reusable• Foundation of SOA, OA
DDS Enables Interoperability
S/W S/W S/WS/W
Data Distribution Service
Independently developed and loosely coupledsoftware modules, applications, subsystems and systems
DDS Overview
• Standardizes:– Means to define domain- and
system-specific interfaces– Network protocol– Programming interface
• Designed for mission-critical systems, systems of systems– Decentralized– Scalability– Availability– Disparate Quality of Service
requirements
Cross-vendor source portability
Cross-vendor interoperability
Standard Protocol
DDS ImplementationData centricity, QoS
Standard API Schema
DDS Applicability
Increase:• Information sharing• Responsiveness
• Enable reuse, sharing, competition• Simplify maintenance, upgrades
– Decouples components– Eliminates complexity
Composition, Systems of Systems
Data Distribution Service
MappingMissionPlanning
VehicleComms
Data Distribution Service
Decomposition
Deployment
• Alternative to traditional Enterprise Service Bus (ESB)• Open: integration logic not specific to an ESB implementation• Decentralized for high scalability and availability
DisparateComponent
DDS-RTPS Wire Interoperability Protocol
AdapterDDS Library
DisparateComponent
AdapterDDS Library
Natively InteroperableComponentDDS Library
Natively InteroperableComponentDDS Library
DDS or other protocol
API
Native Interoperability InterfaceIntegration Bus
Paradigm:Data-Centric Publish/Subscribe
• Components:– Publish the data they produce– Subscribe to the data they consume
• DDS middleware:– Routes data between matching publishers and subscribers– Maintains consistent shared state
PublishSubscribe
Virtual Global Data Space
Squawk Long Lat Alt
1234 37.4-
122.0500.
0
7654 40.7 -74.0250.
0
Line FlightDes
tArv
UA 567 SFO7:3
2
AA 432 LAX9:1
5
SquawkLin
eFlight
1234 UA 567
7654 AA 432
DDS Data Centricity
Like a database• Simple integration
– Data and schema are discoverable– Producers and consumers are decoupled– New components don’t impact existing ones– Standard, application-independent CRUD operations: Create, Read, Update, Delete– …not specific to data source, type of processing/algorithms, or business processes
• Fosters information sharing• Single source of truth
– Robust– Temporal decoupling– Automatic state synchronization
Component
DDS
Component
DDS
Component
DDS
Optional Persistence
DDS Data Centricity
Unlike a database• Event driven for real-time and low-latency processing• Decentralized
– Highly scalable: no performance bottlenecks or expensive servers– No single point of failure: non stop availability‑– Peer-to-peer communication: low latency
• Data cached locally for instant access
Component
DDS
Component
DDS
Component
DDS
Optional Persistence
DDS Quality of Service
• Each component specifies its QoS capabilities and requirements– Data volatility: Durability, History, Lifespan– Data delivery: Reliability, Time based filter, Content filter, Deadline– High availability: Liveliness, Ownership, Ownership Strength
• DDS implements and enforces contracts
Squawk Long Lat Alt
1234 37.4-
122.0500.
0
7654 40.7 -74.0250.
0
Line FlightDes
tArv
UA 567 SFO7:3
2
AA 432 LAX9:1
5
SquawkLin
eFlight
1234 UA 567
7654 AA 432
Reliable,100 Hz
Reliable, 2 Hz,Western U.S.
Reliable
Best Effort,1 Hz, SAN area
Best Effort, 0.2 Hz,UA flights
DDS QoS Benefits
• Reduces complexity and associated lifecycle costs
– Decoupling: publishers don’t need to know subscribers’ requirements
– Disparate subscribers almost always have different requirements
– Moves logic from applications to DDS middleware
• Efficiently scales with data volumes– Only required data is distributed, delivered– Reduces network and processor overhead
• Fault tolerance– Redundancy management– Components notified if QoS not satisfied or
connectivity lost– Can take remedial action
Squawk Long Lat Alt
1234 37.4-
122.0500.
0
7654 40.7 -74.0250.
0
Line FlightDes
tArv
UA 567 SFO7:3
2
AA 432 LAX9:1
5
SquawkLin
eFlight
1234 UA 567
7654 AA 432
Reliable,100 Hz
Reliable, 2 Hz,Western U.S.
Reliable
Best Effort,1 Hz, SAN area
Best Effort, 0.2 Hz,UA flights
Support for Mission-Critical Systems
• Autonomous operation– Automatic discovery of applications– Requires no system admin or
centralized infrastructure• Non-stop: no single point of failure• QoS provides visibility into real time ‑
behavior and system health• Embeddable• TRL 9 implementations
Integration ApproachesPoint-to-point, application-centricTightly coupled: complex, stovepipe, brittleIntegration logic embedded in appsHigh lifecycle costs: development, integration, maintenance & upgradesPoor information sharing, robustness (state maintained in each app)
CentralizedPoor scalability and performanceSingle point of failure: slow failoverIll-suited for autonomous systemsESB integration logic is vendor-specific,
can be complex within ESB
DDSDatabase’s simplicity, information sharing & robustnessHighly scalable, available, performantSuitable for critical, autonomous, real-time, embeddedIntegration logic is vendor independent
ESBDatabase
Broker
Asset Tracking
Legacy design:• 12,000 tracks• 11 servers with 88 cores• Poor reliability and uptime• 1.5M SLOC• 2-8 years to develop• Custom, proprietary
DDS design:• 250,000 tracks• 80% of a single core• Full redundancy• 50k SLOC• Proof of concept in under a week• 100% standards based
DDS Summary
• Enables interoperability and portability by standardizing:
– Interface definitions– Network protocol– Programming interface
• Applicable to system composition and decomposition
• Data-centric publish/subscribe– Simplifies integration– Fosters information sharing– Improves robustness, particularly as
systems scale• Satisfies scalability, reliability and QoS
requirements of mission-critical system
Cross-vendor source portability
Cross-vendor interoperability
Standard Protocol
DDS ImplementationData centricity, QoS
Standard API Schema
RTI Connext
Reduce the time, cost and risk of system development and integration with the most proven, mature and comprehensive DDS solution
RTI Connext Product Family
DDS-RTPS Interoperability
ConnextDDS
API: Full DDS
New and Upgraded Apps with Native Interoperability
ConnextMessaging
DDS++ & JMS
ConnextMicro
DDS Subset
ConnextIntegrator
Adapters
DisparateApps/Systems
Connext Tools
Administration
Monitoring
Recording
Replay
LoggingSystem Viz
Connext DDS
• World’s leading DDS implementation• 70+% market share• 500+ customers• 315+ university and IR&D projects• 350,000+ deployed copies• Most versions are TRL 9• Includes library source code• DDS core is free as Open Community Source
Example Customers
32
U.S. DefenseBoeing – AWACSBoeing – B-1BGeneral Atomics – GCSLockheed Martin – AegisNorthrop Grumman – CLIPRaytheon – DDG 1000Raytheon – SSDSRaytheon – LPD-17
NASAConstellation launch controlHuman Robotic SystemsRobonaut
ScienceESO – TelescopeMax Planck – nuclear fusionSchilling – UUV
AutomotiveAudiVW
MedicalDocBoxMevionVarian
Industrial ControlNikon – semi mfgSchneider - PLCsSiemens Wind Power
SimulationCAE – flight simulatorForce Technology – tugboat
TelecomHarmonic – videoIPC – VoIP
International DefenseBase10 – RoboScoutCassidian – GCSQinetiQ – test & evaluationQinetiQ – vehicle integrationRheinmetall – camp protectionSaab – naval CMSSamsung –naval CMSUltra Electronics – OA platform
TransportationATLANTIDA – ATMCity of Tokyo – HighwayWi-Tronix – asset tracking
ITParemus – cloud platformPIMCO – bond tradingXuenn - sports betting
Application Code
Data Types
Data-Centric Publish/Subscribe
Automatic Discovery
HistoryCache
Monitoring*
Local API & rem
ote
Quality of Svc
API & file-based
Operating System and Network StackWindows, Linux, Unix, embedded, RTOS
Interface Compiler
Interface Definitions• IDL• XML / XSD• WSDL
Shared M
emory
UD
Pv4ucast &
mcast
TCP
UD
Pv6 ucast &
mcast
Custom
Pluggable Transport Interface
DDS: C, C++, C#, Java, Ada*
Generated
APIs – event-driven, polled & SQL query
Reliability • Serialization • DDS-RTPS Wire Protocol
Dynamically defined (API) Custom Pre-defined
<XML>Pluggable Discovery
Peer-to-peerFile-based*
Custom
*Add-on
<XML>
Included Tools
• Spreadsheet Add-in for Microsoft Excel
• Wireshark protocol analyzer
New with 5.0: Type Extensibility
• DDS Topics are strongly typed– Safety– Wire efficiency
• New XTypes interface allows types to be extended– Dynamically– While retaining type safety
• Subtype relationships match publications and subscriptions– Subscriptions to Track match publications of
AirTrack
struct Track { long id; //@key float range; float bearing;}
struct AirTrack { long id; //@key float range; float bearing; float elevation;}
Compatible or not?
New Experimental Feature:XML-Based Application Creation• Use XML for complete system definition
– Data Types – Quality of Service settings– Topics– All Entities: DomainParticipants, Publishers, Subscribers,
DataWriters and DataReaders.• Benefits
– Share system configuration– Reduce code size and errors– Simplify & Speedup development– Let developers focus on application the behavior– Prototype and execute without writing any code!!
Replaces Configuration and Setup CodeCreate
Participant
Create Publisher Create Subscriber
Register type
Create Topic
Create Writer Create Reader
Do the important
work
Static
Behavioral
SAVE
D
New Experimental Feature:Connext Prototyper
• Command-line tool included with XML Application Creation SDK
• Try out scenarios directly from their XML descriptions, without writing any code!– Directly see applications execute on the network– See impact of QoS, Topic Designs, Data Type
definition…– Specify data-values/ranges and publication rates
per topic
Connext Messaging:Built on Connext DDS• Additional enterprise integration patterns
– Request/reply– Guaranteed messaging
• Persistence service• Java Message Service (JMS) API• Additional transports
– Secure (TLS, DTLS)– WAN
• Future:– New security plugins– REST API
Application Code
Data Types
Data-Centric Publish/Subscribe
Automatic Discovery
HistoryCache
Monitoring*
Local API & rem
ote
Quality of Svc
API & file-based
Operating System and Network StackWindows, Linux, Unix, embedded, RTOS
Interface Compiler
Interface Definitions• IDL• XML / XSD• WSDL
Shared M
emory
UD
Pv4ucast &
mcast
TCP
TLS & DTLS
(SSL)
UD
Pv6 ucast &
mcast
Custom
Pluggable Transport Interface
JMSDDS: C, C++, C#, Java, Ada*
Generated
APIs – event-driven, polled & SQL query
Reliability • Serialization • DDS-RTPS Wire Protocol
Dynamically defined (API) Custom Pre-defined
<XML>Pluggable Discovery
Peer-to-peerFile-based*
Custom
*Optional
WAN
<XML>
Request/reply, Guaranteed Messaging
New with 5.0: Integration Patterns
• Request/Reply: Process commands
– Remote method invocation
– Request/async reply– Request/multiple-reply– Request/multiple repliers
• Guaranteed Messaging: Ensure action
– Persistent publications– Durable subscribers– Application
acknowledgement
Publisher
Message
Message
Message
Subscriber
Durable Subscriber
Message
Requester
Replier A
Replier C
Replier B
Request
Reply
New with 5.0: Enhanced Scalability
• Optimized writer-side filtering– Unlimited remote readers– Greatly optimized protocol*
• Ultra-scalable request-reply– 1000s of clients
PublisherPublisher
Subscriber
Subscriber
Subscriber
TemperatureUpdates
TemperatureUpdate Turbine 1
TemperatureUpdate Turbine 2
TemperatureUpdate Turbine N
…
* Still DDS compliant, backwards compatible
Persistence Service
• Data availability, even if publisher fails• Reduced load and memory for data writers
Publisher
Subscriber
Subscriber
PersistenceService
Domain
OpenSSL for TLS and DTLS
• OpenSSL: dominant industry solution for TLS• Point-to-point: TLS over TCP, DTLS over UDP• Integrity, authentication and encryption
– Authentication: X.509 based– Encryption: wide selection
• FIPS 140 Level 1 certified• Applied at the DDS DomainParticipant level
Future Security Support
• Finer grained access control– Topics– Read/write
• Multicast encryption– One encryption per sample– …not per subscriber
• Built-in key distribution
OMG Secure DDS Submission
App.
Other DDSSystem
Secure DDS middleware
AuthenticationPlug-in
Access ControlPlug-in Cryptography
Plug-in
Key ManagementPlug-in
Secure Transport
application componentcertificates
?
Datacache
ProtocolEngine
DDS Entities
Network
Encrypted DataTAG
Other DDSSystem
Other DDSSystem
App.App.
AuditingPlug-in
HTTP
Future: REST InterfacePreview Available Now
• Web interface to DDS• Access DDS from any application,
platform or language that can invoke a Web Service– Web applications, e.g., Google Maps– JavaScript, Flash, Perl, PHP, Python, CGI
scripts• Lightweight
– Clients do not need to link or load special libraries
• Basis for RTI submission to OMG Web Enabled DDS standard‑
DDS-RTPS
Connext MicroGenerally Available this Week!
• Scalable product line to accommodate resource constrained environments – Small memory footprint (~200KB library)– Low CPU load (< 10%)
• Designed to be certifiable component– Minimal lines of code (~20K ELOC)– Targeting DO-178 Level A
• Follows OMG DDS specification– Wire protocol RTPS compatible– Seamless integration with other DDS implementations– Subset of standard DDS API
© 2012 RTI 48
User-Configurable Feature Set
DDS API Subset
Transport API
Base-line configuration
Static Discovery
OS API
User Application
UDPv4 Linux 2.6
VxWorks 653APEX DynamicDiscovery
Queue API
Listeners
Required plug-in components
Linear Q
Keyed Q
Discovery API
Reliability
Durability & History
Other QoS
Optional APIs
Shared memory
VxWorks 5.5
Com
pile
-tim
e op
tions
RTPS
Connext Micro
© 2012 RTI 49
Platform Support
• Mainstream 32/64-bit processors• 16-bit micro-controllers with 32-bit integer support• Operating system support
– Windows, Linux– VxWorks, VxWorks Cert, VxWorks 653, FreeRTOS– Preview: iOS, Android
• Source code included for easy porting to other platforms
• Platform plug-in API
Compatibility
• Interoperable with general-purpose edition– RTPS 2.1 compliant
• Directly compatible with – rtiddsgen– Wireshark– Routing Service
• Compatible when using dynamic discovery or via Routing Service– Spreadsheet Add-in for Microsoft Excel– Real-Time Connect– Recording Service
Connext IntegratorCompose Systems of Systems
• Adapts non-DDS applications to DDS (e.g., legacy)
• Transforms between incompatible data models to achieve interoperability
• Bridges DDS systems– Across networks – LAN and WAN– Across security domains
Routing Service
App
Data-Centric Publish/Subscribe
Transformation(built-in and SDK)
Adapter SDK
DDS-RTPS
DDS-RTPS, JMS, socketsAdm
inistration • Monitoring
QoS • Security
Database Integration Service
SQLDatabase
Table.PassengersFlt Name Addrs----------------------C129 A. Johnson …C054 J. Smith ….……
Table.TracksFlt Lat. Long.----------------------C129 34.5 102.3C054 27.7 46.8……
Database Integration Svc
DDS App
DDS App
DDS App
Communications Storage
Real-timedata updates
Non-real-time
applications
Database changes
Connext Tools
Recording• Applications:
– Future analysis and debugging– Regulatory compliance– Replay for testing and simulation
purposes
• Record high-rate data arriving in real-time
• >15,000 messages/updates per second per disk
• Non-intrusive
Recorder
Status Topic
Control Topic
File DB
Domain
Publisher
Publisher
Subscriber
Subscriber
Playback
• Real-time playback of data– Captured by RTI Recorder– From any number of topics
• Applications:– Debugging – replay what happened– Live post-mission analysis, e.g., UAV– Replay for simulation and training
• Non-intrusive– Just another publisher– Transparent to subscribers
DataLog
Playback
DDS
RTI Analyzer
Detailed system topology display Displays QoS settings Helps debugging Writer to
Reader connections Helps to Track and tune QoS
parameters Helps in diagnosing unusual
behavior
Application Monitoring Features
• Detailed statistics on traffic, errors, and resource usage
• Detailed system topology display• Configurable alerts and thresholds• Helps to Track and tune
performance• Helps in diagnosing unusual
behavior
Admin Console
• Centralized console for infrastructure• Dashboard summary of all running services• Live status updates• Live distributed logging• Real-time statistics• System Performance statistics (CPU and memory)
• Remote administration of Connext Integrator• GUI interfaces for sending remote commands• Retrieving and updating current configurations• Built-in XML editor for modifying configuration files
• Built on top of Eclipse
System Overall Health
RTI Connext Add-on Products
• Limited bandwidth transport• CORBA compatibility kit• Ada 2005 language support• Add-on for National Instruments LabView
Limited-Bandwidth Transport
• Designed specifically for wireless or satellite comms• Limited-Bandwidth RTPS Transport Plug-in
– Increases data to packet ratio
• Compression Transport Plug-in– Further optimizes data to packet ratio
• Quasi-static Discovery Plug-in– Reduces meta-data traffic– Minimizes system set-up and reconnection times
• Simulator– Packet drops, limited bandwidth
RTI’s Infrastructure Community Business Model
Licensing and pricing to enable common architecture
Infrastructure CommunityBusiness Model
• Facilitates adoption of a DDS software infrastructure and interoperability interface
• …across development projects and organizations
• Community members get RTI DDS for free– Open Community Source license– Modifiable– Redistributable
What Is an Infrastructure Community?
• Any community sharing software– Seeking a common or interoperable software
infrastructure– Across projects, divisions, companies,
programs• Examples
– Software supply chains– Enterprises or corporate divisions– Government or industry standards
communities (FACE, UCS, COE, ICE)– Large projects
• “Everyone you care about”
Infrastructure Community Model
• Free core RTI DDS for entire IC– Full source & binary for latest RTI DDS
• Windows & Linux pre-built binaries• Share source & binaries within IC (original and modified)
– Royalty free– Optional support on a time and materials basis
• Low-cost commercial product for projects– Subscriptions start at $1,000 per developer (U.S.)– Adds tools, advanced functionality, platforms, transports– Warranty & bounded support costs– Still no royalties or deployment fees
Infrastructure Communities
IC: JHU APL
Paid commercial license
Scope: Project
Free Project
Free Project
Free ProjectPaid commercial
licenseScope: Project
Paid commercial license
Scope: Project
IC: ICE
Paid commercial license
Scope: Project
Free Project
Free Project
Free ProjectPaid commercial
licenseScope: Project
Paid commercial license
Scope: Project
IC: Audi
Paid commercial license
Scope: Project
Free Project
Free Project
Free ProjectPaid commercial
licenseScope: Project
Paid commercial license
Scope: Project
Summary
• DDS delivers the interoperability, scalability and availability required to cost-effectively integrate mission-critical systems of systems
• RTI provides the most proven, mature and comprehensive DDS solution
• RTI’s Open Community Source makes it easy to realize DDS’ benefits by facilitating sharing of infrastructure across organizations