SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

31
© 2013 Denodo Technologies 6 Sessions Covering Key Data Integration Challenges Solved with Data Virtualization Session 4: Capitalizing on your SOA with Data Virtualization Topics covered: *Making BI agile *Integrating Big Data *Combining SOA and Data Integration *Enhancing and Extending MDM and DW *Creating a single view of your customer

Transcript of SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

Page 1: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

6 Sessions Covering Key Data Integration Challenges Solved with Data Virtualization

Session 4: Capitalizing on your SOA with Data Virtualization

Topics covered: *Making BI agile

*Integrating Big Data *Combining SOA and Data

Integration *Enhancing and Extending MDM

and DW *Creating a single view of your

customer

Page 2: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Today’s Speaker

■ Paul Moxon Senior Director, Product Management

Page 3: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Agenda

■ Two Architectures, One Organization

■ Leveraging Data Virtualization Within Your SOA

■ Customer Examples – SOA and Data Virtualization

■ Data Virtualization & SOA - Product Demonstration

■ Summary

■ Q&A and Next Steps

Page 4: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Agenda

■ Two Architectures, One Organization

■ Leveraging Data Virtualization Within Your SOA

■ Customer Examples – SOA and Data Virtualization

■ Data Virtualization & SOA - Product Demonstration

■ Summary

■ Q&A and Next Steps

Page 5: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Two Enterprise Architectures…

■ Most organizations have two distinct system architectures • Application architecture • Information architecture

■ Different teams using different tools and addressing different requirements • Even talk different languages

■ But requirements are converging…

Page 6: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Typical Application Architecture – 10+ Years Ago

Page 7: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Service Oriented Architecture to the Rescue

■ ~10 years ago Enterprise Architects got ‘religion’

■ Merging technologies enabled Service Oriented Architectures • Web Services, ESB, etc.

■ Expose applications as reusable services • Services used by business process tools

■ Services are meaningful to ‘business user’ • Abstract away technical implementation details

■ Services encapsulate business logic and data • Data accessed from sources as needed

Page 8: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Typical Service Oriented Architecture

Page 9: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

The Reality of Data Access

Page 10: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Agenda

■ Two Architectures, One Organization

■ Leveraging Data Virtualization Within Your SOA

■ Customer Examples – SOA and Data Virtualization

■ Data Virtualization & SOA - Product Demonstration

■ Summary

■ Q&A and Next Steps

Page 11: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Data Services Architecture

Dat

a C

onsu

mer

s Enterprise Applications, ESB Reporting, BI, Portals Mobile, Web, Users

Dat

a Vi

rtua

lizat

ion Design Tools

Optimizer

Cache

Scheduler

Monitoring

Governance

Metadata

Security

Publish Real-time (Right-time) Data Services

Combine Transform, Improve Quality, Integrate

Connect Normalized Views of Disparate Data

Denodo Platform

Library of Wrappers Web Automation Any Data or Content Read and Write

Dat

a So

urce

s

Databases & Warehouses

Enterprise Applications

Cloud / SaaS Applications

XML, Excel, Flat Files

Big Data, NoSQL

Web 2.0 Soc. Media

PDF, Docs, Index, Emails

More Structured Less Structured

Business Solutions Access Information-

as-a-Service

Denodo Platform Right Information at the Right Time

Disparate Data Any Source Any Format

Multiple Protocols, Formats

Linked Data Services Query, Search, Browse

Request/Reply, Event Driven

Secure Delivery

Page 12: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Customer Entity

SOA with Data Services

Data Services Layer

Page 13: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Data Services Layer

■ Abstract complexities of different data sources • Provide reusable derived ‘business entity’ views on data

■ Control and Governance point for enterprise data • Security and access control • Governance – “Who is doing what and when?”

■ Provide different access methods • SQL (JDBC, ODBC), Web Services (REST, SOAP, …)

■ Sometimes, data is the service • Direct access to data service

Page 14: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Forrester’s Information Fabric

Page 15: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Information Fabric 3.0 Reference Architecture

Page 16: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Agenda

■ Two Architectures, One Organization

■ Leveraging Data Virtualization Within Your SOA

■ Customer Examples – SOA and Data Virtualization

■ Data Virtualization & SOA - Product Demonstration

■ Summary

■ Q&A and Next Steps

Page 17: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Data Challenges

Organization •Different owners and agendas •Skills required to consume data are varied because of differing technology platforms

Location •Stored in many locations •Maintainability of multiple copies of data can be difficult

Technology • Incompatible formats and protocols •Heterogeneous platforms provide inconsistent access mechanisms

•Cost to support multiple infrastructures for consuming systems

Page 18: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Data Challenges (Cont’d)

Application • Different identifiers • Level of granularity can differ between source systems • Complex interrelationships can already exist between systems and

must be honored • Many applications in silos, focused on own use of data

Data • Structured and unstructured • Different naming conventions • Complexity of data integration becomes onus of consumer • Accuracy and integrity of data is variable across implementations

Business Process • Inconsistent usage of data within the process • Semantics differ between processes that use data

Page 19: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Data Services for Development Teams

Page 20: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

R- Single View of Customer

Page 21: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

R – Services Architecture

Page 22: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

R – Data Services Metrics

■ Data Services + SOA used to power call center • Also support customer self-service portal

■ Provides single view of business data • All departments use same data

Page 23: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Agenda

■ Two Architectures, One Organization

■ Leveraging Data Virtualization Within Your SOA

■ Customer Examples – SOA and Data Virtualization

■ Data Virtualization & SOA - Product Demonstration

■ Summary

■ Q&A and Next Steps

Page 24: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Demo Scenario

■ Customer data in Teradata

■ Network Equipment data in MongoDB

■ Equipment log data in Excel

■ Provide integrated data views to developers for web app and mobile app development

■ Integrate data into existing business processes

Page 25: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Data Sources and Data Views

client_type address client customer_equipment log_data.xlsx

client_type address client network_equipment equipment_log_data

client_information

ntu

Page 26: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Agenda

■ Two Architectures, One Organization

■ Leveraging Data Virtualization Within Your SOA

■ Customer Examples – SOA and Data Virtualization

■ Data Virtualization & SOA - Product Demonstration

■ Summary

■ Q&A and Next Steps

Page 27: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Data Services & SOA

■ Business data requirements are going beyond traditional reporting and analytics • Agile/Self Service BI, support for multiple BI tools, Big

Data sources, real-time analytics, and so on

■ New data sources can add value to business • Internal and external • Differentiator? New business opportunity?

■ Need to enable, control, and manage access to all data • Internal and external, traditional and new sources

■ Opportunity for IT to extend its value to organization • Move beyond ETL, EDW, BI Analytics

Page 28: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Agenda

■ Two Architectures, One Organization

■ Leveraging Data Virtualization Within Your SOA

■ Customer Examples – SOA and Data Virtualization

■ Data Virtualization & SOA - Product Demonstration

■ Summary

■ Q&A and Next Steps

Page 29: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Data Virtualization & SOA – Questions?

Page 30: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Data Virtualization & SOA – Next Steps

Move forward at your own pace Data Virtualization R: A Success Story

http://www.denodo.com/en/resources/case_studies/r_cable_english/index.php

Attend Packed Lunch Webinar Sessions – Covering Data Virtualization for…

Making BI Agile

Integrating Big Data

Combining SOA and Data Integration

Enhancing and Extending MDM and DW

Creating a Single View of Your Customer

Move forward with one of our Data Virtualization experts Phone: (+1) 877-556-2531 (NA) | Email: [email protected]

Phone: (+44) (0)20 7869 8053 (EMEA)

www.denodo.com

Page 31: SOA with Data Virtualization (session 4 from Packed Lunch Webinar Series)

© 2013 Denodo Technologies

Next Session:

Topics covered: *Making BI agile

*Integrating Big Data *Combining SOA and Data

Integration *Enhancing and Extending MDM

and DW *Creating a single view of your

customer

Thank You!

Implementing Data Virtualization for DW and MDM Extensions

Wednesday, June 25th 2014